2024-09-21T00:53:01.837 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T00:53:01.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T00:53:01.966 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/fsync-tester}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913354' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGvu5qrF/PDSEIhKcAsjL5XbFA2kzjGRVcMruJtShPrevF47/S/VplY02QkLCCiwa7xj4xxXidjZKwsVJf+YJ3w= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBMidc5NvtLG1P/WX+VWO3AwxRDmdi+OaGYZ0Tjmz4kgXGmgDJa68FnSPTu+dJRIIm0Yr9lox2SB41IwsOq9Jgo= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCg9lNrJ/YtBYwSma+6V9pyq7bUSPi+Q2kbbHzzIv96noCenVM36piuOp1UPAuKQeVhJsOYCPTfxOAVyfhRTGPc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T00:53:01.967 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T00:53:01.967 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T00:53:01.968 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T00:53:01.970 INFO:teuthology.task.internal:Checking packages... 2024-09-21T00:53:01.995 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T00:53:01.995 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:53:01.995 INFO:teuthology.packaging:ref: None 2024-09-21T00:53:01.995 INFO:teuthology.packaging:tag: None 2024-09-21T00:53:01.995 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:53:01.996 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:53:01.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:53:02.145 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T00:53:02.146 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T00:53:02.152 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T00:53:02.152 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T00:53:02.157 INFO:teuthology.task.internal:Saving configuration 2024-09-21T00:53:02.177 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T00:53:02.183 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T00:53:02.204 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:47:15.752482', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGvu5qrF/PDSEIhKcAsjL5XbFA2kzjGRVcMruJtShPrevF47/S/VplY02QkLCCiwa7xj4xxXidjZKwsVJf+YJ3w='} 2024-09-21T00:53:02.224 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:47:15.751096', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBMidc5NvtLG1P/WX+VWO3AwxRDmdi+OaGYZ0Tjmz4kgXGmgDJa68FnSPTu+dJRIIm0Yr9lox2SB41IwsOq9Jgo='} 2024-09-21T00:53:02.244 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:47:15.749608', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCg9lNrJ/YtBYwSma+6V9pyq7bUSPi+Q2kbbHzzIv96noCenVM36piuOp1UPAuKQeVhJsOYCPTfxOAVyfhRTGPc='} 2024-09-21T00:53:02.244 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T00:53:02.250 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T00:53:02.250 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T00:53:02.250 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T00:53:02.250 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T00:53:02.318 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7bc926b520>, signals=[15]) 2024-09-21T00:53:02.318 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T00:53:02.324 INFO:teuthology.task.internal:Opening connections... 2024-09-21T00:53:02.324 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T00:53:02.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:53:02.407 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-09-21T00:53:02.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:53:02.485 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-09-21T00:53:02.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:53:02.560 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T00:53:02.566 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-21T00:53:02.585 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-21T00:53:02.585 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-21T00:53:02.643 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-09-21T00:53:02.643 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-09-21T00:53:02.643 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-09-21T00:53:02.643 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:53:02.644 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-09-21T00:53:02.644 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:53:02.644 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:53:02.644 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-09-21T00:53:02.644 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:53:02.644 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:53:02.644 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:53:02.644 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:53:02.644 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:53:02.644 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:53:02.645 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-21T00:53:02.665 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-09-21T00:53:02.684 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-09-21T00:53:02.684 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-09-21T00:53:02.741 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-09-21T00:53:02.741 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2024-09-21T00:53:02.741 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-09-21T00:53:02.741 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:53:02.741 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2024-09-21T00:53:02.741 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:53:02.742 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:53:02.742 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-09-21T00:53:02.742 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:53:02.742 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:53:02.742 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:53:02.742 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:53:02.742 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:53:02.742 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:53:02.742 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-09-21T00:53:02.764 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-09-21T00:53:02.783 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-09-21T00:53:02.783 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-09-21T00:53:02.841 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:53:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:53:02.843 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:53:02.843 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:53:02.843 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-09-21T00:53:02.864 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T00:53:02.877 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T00:53:02.919 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T00:53:02.920 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:53:02.922 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:53:02.925 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:53:02.942 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T00:53:02.947 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T00:53:02.947 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:53:02.980 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:53:02.982 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:53:03.086 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T00:53:03.159 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T00:53:03.173 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T00:53:03.174 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T00:53:03.174 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T00:53:03.174 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:53:03.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:53:03.192 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-21T00:53:03.250 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-503.el9.x86_64 2024-09-21T00:53:03.251 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.14.0-503.el9.x86_64 2024-09-21T00:53:03.251 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2024-09-21T00:53:05.851 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.3 MB 00:00 2024-09-21T00:53:08.901 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-21T00:53:14.277 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-21T00:53:15.919 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-21T00:53:18.583 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 23 MB 00:02 2024-09-21T00:53:23.946 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T00:53:24.118 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:01 ago on Sat 21 Sep 2024 12:53:23 AM UTC. 2024-09-21T00:53:25.828 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T00:53:25.828 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T00:53:25.922 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T00:53:25.932 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T00:53:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-21T00:53:25.932 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T00:53:25.932 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T00:53:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T00:53:25.932 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T00:53:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T00:53:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T00:53:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T00:53:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T00:53:25.933 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T00:53:25.933 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T00:53:25.933 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2024-09-21T00:53:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T00:53:25.933 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 79 M 2024-09-21T00:53:25.934 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 126 M 2024-09-21T00:53:25.934 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T00:53:26.081 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 283 kB/s | 36 kB 00:00 2024-09-21T00:53:27.456 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 21 MB/s | 29 MB 00:01 2024-09-21T00:53:28.223 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 6.9 MB/s | 16 MB 00:02 2024-09-21T00:53:28.831 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 12 MB/s | 35 MB 00:02 2024-09-21T00:53:28.832 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:53:28.832 INFO:teuthology.orchestra.run.smithi148.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-21T00:53:29.515 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T00:53:29.889 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T00:53:29.889 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T00:53:30.842 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T00:53:30.842 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T00:53:33.279 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T00:53:33.901 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:53:33.990 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:53:36.763 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:53:36.983 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:53:41.816 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:53:41.899 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:53:46.765 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:54:24.963 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:54:25.002 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:54:25.362 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:54:25.362 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:54:25.362 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:54:25.362 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:54:26.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:54:26.229 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T00:54:26.229 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T00:54:26.229 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T00:54:26.229 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T00:54:26.229 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T00:54:26.230 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T00:54:26.230 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T00:54:26.230 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T00:54:26.605 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:54:26.689 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:54:26.690 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:54:26.690 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T00:54:26.690 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T00:54:26.690 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T00:54:26.690 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T00:54:26.690 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T00:54:26.690 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:54:26.749 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:54:26.749 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:54:26.749 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2024-09-21T00:54:26.781 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2024-09-21T00:54:26.781 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2024-09-21T00:54:26.781 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2024-09-21T00:54:26.781 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 82.el9 2024-09-21T00:54:26.781 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2024-09-21T00:54:26.781 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T00:54:26.781 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8274670 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T00:54:26.782 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T00:54:26.783 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2024-09-21T00:54:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T00:54:26.783 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T00:54:26.783 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T00:54:26.784 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 5.14.0-508.el9.x86_64 2024-09-21T00:54:26.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T00:54:27.438 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-09-21T00:54:28.816 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T00:54:28.847 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-09-21T00:54:28.850 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-21T00:54:28.866 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.EiPxeiVgSi 2024-09-21T00:54:28.866 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EiPxeiVgSi 2024-09-21T00:54:28.939 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.EiPxeiVgSi 2024-09-21T00:54:29.085 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.EiPxeiVgSi is 6KB 2024-09-21T00:54:29.133 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.EiPxeiVgSi 2024-09-21T00:54:29.148 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T00:54:29.211 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T00:54:29.211 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T00:54:29.211 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T00:54:29.211 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T00:54:29.212 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T00:54:29.368 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-09-21T00:54:59.371 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T00:54:59.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T00:54:59.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:55:17.743 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-21T00:55:26.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T00:55:26.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:55:29.807 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-21T00:55:41.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T00:55:41.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:56:00.239 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-21T00:56:15.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T00:56:15.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:56:15.656 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-21T00:56:16.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T00:56:16.029 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T00:56:16.029 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-21T00:56:16.044 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-508.el9.x86_64 2024-09-21T00:56:16.044 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T00:56:16.044 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T00:56:16.044 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T00:56:17.045 DEBUG:teuthology.parallel:result is None 2024-09-21T00:56:17.045 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T00:56:17.052 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T00:56:17.053 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:56:17.055 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:56:17.057 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:56:17.076 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T00:56:17.082 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T00:56:17.090 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T00:56:17.090 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:56:17.108 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:56:17.116 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:56:17.213 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T00:56:17.219 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T00:56:17.219 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:56:17.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:56:17.236 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:56:17.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:56:17.252 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:56:17.255 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:56:17.279 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:56:17.339 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:56:17.341 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:56:17.363 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:56:17.374 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:56:17.376 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T00:56:17.383 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T00:56:17.383 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:56:17.385 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:56:17.388 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:56:17.431 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T00:56:17.439 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T00:56:17.439 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:56:17.448 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:56:17.456 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:56:17.487 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:56:17.537 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:56:17.590 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:56:17.667 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:56:17.726 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T00:56:17.726 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:56:17.750 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:56:17.787 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:56:17.847 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:56:17.927 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:56:17.972 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T00:56:17.972 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:56:18.040 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:56:18.085 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:56:18.145 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:56:18.187 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:56:18.231 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T00:56:18.231 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:56:18.298 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-21T00:56:18.300 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-09-21T00:56:18.303 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-09-21T00:56:18.339 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:56:18.339 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:56:18.381 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:56:18.781 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T00:56:18.790 INFO:teuthology.task.internal:Starting timer... 2024-09-21T00:56:18.790 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T00:56:18.800 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T00:56:18.808 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T00:56:18.808 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-09-21T00:56:18.914 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-09-21T00:56:18.919 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2024-09-21T00:56:18.989 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2024-09-21T00:56:18.991 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-09-21T00:56:19.044 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-09-21T00:56:19.046 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T00:56:19.046 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-09-21T00:56:19.081 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-09-21T00:56:19.081 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2024-09-21T00:56:19.104 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2024-09-21T00:56:19.105 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-09-21T00:56:19.130 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-09-21T00:56:19.131 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi148.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi157.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-09-21T00:56:19.131 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:56:19.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:56:19.192 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:56:19.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:56:19.221 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:56:19.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:56:19.247 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T00:56:19.247 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:56:19.571 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:56:19.608 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:56:19.638 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T00:56:19.646 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T00:56:19.649 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T00:56:19.750 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T00:56:21.257 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T00:56:21.258 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi148.front.sepia.ceph.com,smithi157.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T01:00:51.751 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi148.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-09-21T01:00:51.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T01:00:51.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:00:51.829 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-21T01:00:51.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T01:00:51.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-21T01:00:51.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:00:51.984 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-09-21T01:00:52.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-21T01:00:52.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-21T01:00:52.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:00:52.153 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-21T01:00:52.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-21T01:00:52.240 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T01:00:52.250 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T01:00:52.250 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:00:52.250 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:00:52.253 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:00:52.253 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:00:52.255 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:00:52.255 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:00:52.281 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:00:52.286 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:00:52.297 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:00:52.301 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:00:52.312 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:00:52.322 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-09-21T01:00:52.327 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:00:52.328 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2024-09-21T01:00:52.334 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-09-21T01:00:52.340 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2024-09-21T01:00:52.348 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:00:52.353 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-09-21T01:00:52.355 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:00:52.362 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:00:52.364 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-09-21T01:00:52.369 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:00:52.379 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:00:52.393 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:00:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:00:52.421 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:00:52.421 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-21T01:00:52.421 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.421 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.421 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.422 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.432 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:00:52.436 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:00:52.436 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-09-21T01:00:52.436 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.436 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.436 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.436 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.450 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:00:52.453 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:00:52.453 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-21T01:00:52.453 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.453 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.453 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.453 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:00:52.455 INFO:teuthology.run_tasks:Running task install... 2024-09-21T01:00:52.469 DEBUG:teuthology.task.install:project ceph 2024-09-21T01:00:52.469 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T01:00:52.469 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T01:00:52.469 INFO:teuthology.task.install:Using flavor: default 2024-09-21T01:00:52.474 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T01:00:52.474 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T01:00:52.474 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:00:52.475 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:00:52.476 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:00:52.477 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:00:52.477 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:00:52.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:00:52.635 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:00:52.636 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:00:52.639 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:00:52.639 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:00:52.647 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:00:52.647 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:00:52.745 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:00:52.745 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:00:52.745 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:00:52.754 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:00:52.754 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T01:00:52.754 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:00:52.756 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:00:52.756 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T01:00:52.756 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:00:52.772 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:00:52.772 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:00:52.782 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:00:52.782 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:00:52.783 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:00:52.783 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:00:52.837 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:00:52.846 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:00:52.848 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:00:52.912 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:00:52.921 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:00:52.923 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:00:52.977 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-09-21T01:00:52.978 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-09-21T01:00:52.986 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2024-09-21T01:00:52.987 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2024-09-21T01:00:52.988 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-09-21T01:00:52.989 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-09-21T01:00:53.211 INFO:teuthology.orchestra.run.smithi148.stdout:45 files removed 2024-09-21T01:00:53.212 INFO:teuthology.orchestra.run.smithi157.stdout:45 files removed 2024-09-21T01:00:53.214 INFO:teuthology.orchestra.run.smithi181.stdout:45 files removed 2024-09-21T01:00:53.237 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:00:53.239 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:00:53.241 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:00:53.783 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-21T01:00:53.796 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-21T01:00:53.799 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-09-21T01:00:54.081 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-21T01:00:54.083 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-21T01:00:54.116 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 83 kB/s | 24 kB 00:00 2024-09-21T01:00:54.347 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-21T01:00:54.359 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T01:00:54.393 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T01:00:55.881 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.3 MB 00:01 2024-09-21T01:00:55.967 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.3 MB 00:01 2024-09-21T01:00:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.3 MB 00:02 2024-09-21T01:00:57.832 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-21T01:00:59.310 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 20 MB 00:02 2024-09-21T01:01:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-21T01:01:03.434 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-21T01:01:04.919 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-21T01:01:05.449 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 12 MB/s | 23 MB 00:01 2024-09-21T01:01:06.670 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-21T01:01:08.349 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-21T01:01:10.886 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T01:01:12.800 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 20 MB 00:14 2024-09-21T01:01:13.131 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:01:13.132 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:01:13.146 INFO:teuthology.orchestra.run.smithi148.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:01:13.147 INFO:teuthology.orchestra.run.smithi148.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:01:13.148 INFO:teuthology.orchestra.run.smithi148.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:01:13.149 INFO:teuthology.orchestra.run.smithi148.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:01:13.151 INFO:teuthology.orchestra.run.smithi148.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:01:13.153 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:01:13.154 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:01:13.219 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T01:01:13.229 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T01:01:13.229 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T01:01:13.229 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T01:01:13.229 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T01:01:13.229 INFO:teuthology.orchestra.run.smithi148.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:01:13.230 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:01:13.231 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-09-21T01:01:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:01:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:01:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:01:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:01:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:01:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:01:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:01:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:01:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:01:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:01:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:01:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:01:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:01:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:01:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:01:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:01:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:01:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:01:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout:Install 149 Packages 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 8 Packages 2024-09-21T01:01:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:01:13.243 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 228 M 2024-09-21T01:01:13.243 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T01:01:13.796 INFO:teuthology.orchestra.run.smithi148.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 55 kB/s | 6.6 kB 00:00 2024-09-21T01:01:13.971 INFO:teuthology.orchestra.run.smithi148.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-21T01:01:13.988 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T01:01:14.038 INFO:teuthology.orchestra.run.smithi148.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T01:01:14.180 INFO:teuthology.orchestra.run.smithi148.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T01:01:14.255 INFO:teuthology.orchestra.run.smithi148.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T01:01:14.297 INFO:teuthology.orchestra.run.smithi148.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 13 MB/s | 1.5 MB 00:00 2024-09-21T01:01:14.614 INFO:teuthology.orchestra.run.smithi148.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.0 MB 00:00 2024-09-21T01:01:14.914 INFO:teuthology.orchestra.run.smithi148.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 16 MB/s | 20 MB 00:01 2024-09-21T01:01:14.964 INFO:teuthology.orchestra.run.smithi148.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T01:01:15.356 INFO:teuthology.orchestra.run.smithi148.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T01:01:15.465 INFO:teuthology.orchestra.run.smithi148.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T01:01:15.490 INFO:teuthology.orchestra.run.smithi148.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.7 MB/s | 226 kB 00:00 2024-09-21T01:01:15.515 INFO:teuthology.orchestra.run.smithi148.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T01:01:15.541 INFO:teuthology.orchestra.run.smithi148.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 635 kB/s | 32 kB 00:00 2024-09-21T01:01:15.582 INFO:teuthology.orchestra.run.smithi148.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 11 MB/s | 766 kB 00:00 2024-09-21T01:01:15.608 INFO:teuthology.orchestra.run.smithi148.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T01:01:15.633 INFO:teuthology.orchestra.run.smithi148.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T01:01:15.669 INFO:teuthology.orchestra.run.smithi148.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.1 MB/s | 507 kB 00:00 2024-09-21T01:01:15.727 INFO:teuthology.orchestra.run.smithi148.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 778 kB/s | 45 kB 00:00 2024-09-21T01:01:15.811 INFO:teuthology.orchestra.run.smithi148.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T01:01:15.989 INFO:teuthology.orchestra.run.smithi148.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.3 MB 00:00 2024-09-21T01:01:16.020 INFO:teuthology.orchestra.run.smithi148.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 774 kB/s | 161 kB 00:00 2024-09-21T01:01:16.062 INFO:teuthology.orchestra.run.smithi148.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 4.3 MB/s | 321 kB 00:00 2024-09-21T01:01:16.087 INFO:teuthology.orchestra.run.smithi148.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T01:01:16.113 INFO:teuthology.orchestra.run.smithi148.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T01:01:16.117 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:01:16.118 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:01:16.131 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:01:16.132 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:01:16.133 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:01:16.134 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:01:16.136 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:01:16.138 INFO:teuthology.orchestra.run.smithi148.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T01:01:16.139 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:01:16.140 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:01:16.188 INFO:teuthology.orchestra.run.smithi148.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T01:01:16.202 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-21T01:01:16.217 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-21T01:01:16.218 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-21T01:01:16.219 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-21T01:01:16.219 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-21T01:01:16.219 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:01:16.219 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:01:16.219 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:01:16.219 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:01:16.219 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:01:16.220 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:01:16.220 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:01:16.220 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:01:16.221 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:01:16.221 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:01:16.221 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:01:16.221 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:01:16.221 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:01:16.222 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:01:16.222 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:01:16.222 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:01:16.222 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:01:16.222 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:01:16.222 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:01:16.222 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:01:16.223 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:01:16.223 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:01:16.223 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:01:16.223 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:01:16.223 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:01:16.223 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:01:16.224 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:01:16.224 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:01:16.224 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:01:16.224 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:01:16.224 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:01:16.224 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:01:16.224 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:01:16.225 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:01:16.225 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:01:16.225 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:01:16.225 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:01:16.225 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-09-21T01:01:16.225 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:01:16.225 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:01:16.225 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:01:16.226 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:01:16.226 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:01:16.226 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:01:16.226 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:01:16.226 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:01:16.226 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-21T01:01:16.226 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:01:16.227 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:01:16.227 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:01:16.227 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:01:16.227 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:01:16.227 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:01:16.227 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:01:16.228 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:01:16.228 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:01:16.228 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:01:16.228 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:01:16.228 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:01:16.228 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:01:16.228 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:01:16.228 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:01:16.228 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:01:16.228 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:01:16.229 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:01:16.229 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:01:16.229 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:01:16.229 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:01:16.230 INFO:teuthology.orchestra.run.smithi181.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:01:16.230 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:01:16.230 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:01:16.230 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:01:16.230 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:01:16.230 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:01:16.230 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:01:16.230 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:01:16.231 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:01:16.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:01:16.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:01:16.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:01:16.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:01:16.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:01:16.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:01:16.232 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:01:16.233 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:01:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:01:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:01:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout:Install 149 Packages 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 8 Packages 2024-09-21T01:01:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:01:16.238 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 228 M 2024-09-21T01:01:16.238 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-21T01:01:16.263 INFO:teuthology.orchestra.run.smithi148.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 21 MB/s | 3.1 MB 00:00 2024-09-21T01:01:16.289 INFO:teuthology.orchestra.run.smithi148.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 342 kB/s | 34 kB 00:00 2024-09-21T01:01:16.314 INFO:teuthology.orchestra.run.smithi148.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T01:01:16.731 INFO:teuthology.orchestra.run.smithi148.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 18 MB/s | 7.4 MB 00:00 2024-09-21T01:01:16.790 INFO:teuthology.orchestra.run.smithi148.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T01:01:16.815 INFO:teuthology.orchestra.run.smithi181.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 44 kB/s | 6.6 kB 00:00 2024-09-21T01:01:16.856 INFO:teuthology.orchestra.run.smithi148.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 743 kB/s | 49 kB 00:00 2024-09-21T01:01:16.915 INFO:teuthology.orchestra.run.smithi148.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 282 kB/s | 16 kB 00:00 2024-09-21T01:01:17.015 INFO:teuthology.orchestra.run.smithi181.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.3 MB/s | 873 kB 00:00 2024-09-21T01:01:17.065 INFO:teuthology.orchestra.run.smithi181.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.9 MB/s | 148 kB 00:00 2024-09-21T01:01:17.199 INFO:teuthology.orchestra.run.smithi181.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 17 MB/s | 2.3 MB 00:00 2024-09-21T01:01:17.282 INFO:teuthology.orchestra.run.smithi148.stdout:(35/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T01:01:17.299 INFO:teuthology.orchestra.run.smithi181.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 15 MB/s | 1.5 MB 00:00 2024-09-21T01:01:17.307 INFO:teuthology.orchestra.run.smithi148.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 727 kB/s | 285 kB 00:00 2024-09-21T01:01:17.483 INFO:teuthology.orchestra.run.smithi148.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T01:01:17.500 INFO:teuthology.orchestra.run.smithi181.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 25 MB/s | 5.0 MB 00:00 2024-09-21T01:01:17.508 INFO:teuthology.orchestra.run.smithi148.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 92 kB/s | 18 kB 00:00 2024-09-21T01:01:17.533 INFO:teuthology.orchestra.run.smithi148.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.1 MB/s | 784 kB 00:00 2024-09-21T01:01:17.600 INFO:teuthology.orchestra.run.smithi148.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 683 kB/s | 80 kB 00:00 2024-09-21T01:01:17.667 INFO:teuthology.orchestra.run.smithi148.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-21T01:01:17.692 INFO:teuthology.orchestra.run.smithi148.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T01:01:17.726 INFO:teuthology.orchestra.run.smithi148.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-21T01:01:17.751 INFO:teuthology.orchestra.run.smithi148.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T01:01:17.776 INFO:teuthology.orchestra.run.smithi148.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T01:01:17.800 INFO:teuthology.orchestra.run.smithi181.stdout:(7/157): ceph-base-19.3.0-5120.g18432218.el9.x8 4.9 MB/s | 5.5 MB 00:01 2024-09-21T01:01:17.801 INFO:teuthology.orchestra.run.smithi148.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T01:01:17.827 INFO:teuthology.orchestra.run.smithi148.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T01:01:17.861 INFO:teuthology.orchestra.run.smithi148.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-09-21T01:01:17.902 INFO:teuthology.orchestra.run.smithi148.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 6.7 MB/s | 689 kB 00:00 2024-09-21T01:01:17.928 INFO:teuthology.orchestra.run.smithi148.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-21T01:01:17.944 INFO:teuthology.orchestra.run.smithi148.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-09-21T01:01:17.987 INFO:teuthology.orchestra.run.smithi148.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-09-21T01:01:18.012 INFO:teuthology.orchestra.run.smithi148.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-21T01:01:18.037 INFO:teuthology.orchestra.run.smithi148.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 354 kB/s | 33 kB 00:00 2024-09-21T01:01:18.062 INFO:teuthology.orchestra.run.smithi148.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-21T01:01:18.088 INFO:teuthology.orchestra.run.smithi148.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T01:01:18.113 INFO:teuthology.orchestra.run.smithi148.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T01:01:18.125 INFO:teuthology.orchestra.run.smithi181.stdout:(8/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 29 MB/s | 18 MB 00:00 2024-09-21T01:01:18.138 INFO:teuthology.orchestra.run.smithi148.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T01:01:18.163 INFO:teuthology.orchestra.run.smithi148.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-09-21T01:01:18.175 INFO:teuthology.orchestra.run.smithi181.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 505 kB/s | 25 kB 00:00 2024-09-21T01:01:18.205 INFO:teuthology.orchestra.run.smithi148.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-21T01:01:18.239 INFO:teuthology.orchestra.run.smithi148.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-21T01:01:18.264 INFO:teuthology.orchestra.run.smithi148.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-21T01:01:18.290 INFO:teuthology.orchestra.run.smithi148.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-21T01:01:18.315 INFO:teuthology.orchestra.run.smithi148.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-21T01:01:18.373 INFO:teuthology.orchestra.run.smithi148.stdout:(65/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.7 MB/s | 3.0 MB 00:00 2024-09-21T01:01:18.399 INFO:teuthology.orchestra.run.smithi148.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-21T01:01:18.424 INFO:teuthology.orchestra.run.smithi148.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-21T01:01:18.508 INFO:teuthology.orchestra.run.smithi148.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T01:01:18.574 INFO:teuthology.orchestra.run.smithi148.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-21T01:01:18.608 INFO:teuthology.orchestra.run.smithi148.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-21T01:01:18.633 INFO:teuthology.orchestra.run.smithi148.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T01:01:18.700 INFO:teuthology.orchestra.run.smithi148.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-21T01:01:18.742 INFO:teuthology.orchestra.run.smithi148.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-21T01:01:18.767 INFO:teuthology.orchestra.run.smithi148.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T01:01:18.851 INFO:teuthology.orchestra.run.smithi148.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-21T01:01:18.868 INFO:teuthology.orchestra.run.smithi148.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 610 kB/s | 61 kB 00:00 2024-09-21T01:01:18.892 INFO:teuthology.orchestra.run.smithi181.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 9.5 MB/s | 10 MB 00:01 2024-09-21T01:01:18.893 INFO:teuthology.orchestra.run.smithi148.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 5.7 MB/s | 245 kB 00:00 2024-09-21T01:01:18.918 INFO:teuthology.orchestra.run.smithi148.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T01:01:18.944 INFO:teuthology.orchestra.run.smithi148.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-21T01:01:18.951 INFO:teuthology.orchestra.run.smithi181.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T01:01:18.977 INFO:teuthology.orchestra.run.smithi148.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-21T01:01:19.011 INFO:teuthology.orchestra.run.smithi148.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-21T01:01:19.036 INFO:teuthology.orchestra.run.smithi148.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-21T01:01:19.051 INFO:teuthology.orchestra.run.smithi181.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 270 kB/s | 27 kB 00:00 2024-09-21T01:01:19.120 INFO:teuthology.orchestra.run.smithi148.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-21T01:01:19.145 INFO:teuthology.orchestra.run.smithi148.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-21T01:01:19.170 INFO:teuthology.orchestra.run.smithi148.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T01:01:19.196 INFO:teuthology.orchestra.run.smithi148.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T01:01:19.221 INFO:teuthology.orchestra.run.smithi148.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-21T01:01:19.246 INFO:teuthology.orchestra.run.smithi148.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-21T01:01:19.271 INFO:teuthology.orchestra.run.smithi148.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T01:01:19.285 INFO:teuthology.orchestra.run.smithi181.stdout:(13/157): ceph-common-19.3.0-5120.g18432218.el9 7.6 MB/s | 20 MB 00:02 2024-09-21T01:01:19.297 INFO:teuthology.orchestra.run.smithi148.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T01:01:19.310 INFO:teuthology.orchestra.run.smithi181.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 123 kB/s | 32 kB 00:00 2024-09-21T01:01:19.322 INFO:teuthology.orchestra.run.smithi148.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T01:01:19.344 INFO:teuthology.orchestra.run.smithi181.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 13 MB/s | 766 kB 00:00 2024-09-21T01:01:19.347 INFO:teuthology.orchestra.run.smithi148.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T01:01:19.369 INFO:teuthology.orchestra.run.smithi181.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.6 MB/s | 158 kB 00:00 2024-09-21T01:01:19.394 INFO:teuthology.orchestra.run.smithi181.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T01:01:19.438 INFO:teuthology.orchestra.run.smithi148.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T01:01:19.445 INFO:teuthology.orchestra.run.smithi181.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T01:01:19.464 INFO:teuthology.orchestra.run.smithi148.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-21T01:01:19.489 INFO:teuthology.orchestra.run.smithi148.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 857 kB/s | 44 kB 00:00 2024-09-21T01:01:19.515 INFO:teuthology.orchestra.run.smithi148.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T01:01:19.540 INFO:teuthology.orchestra.run.smithi148.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-21T01:01:19.566 INFO:teuthology.orchestra.run.smithi148.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-21T01:01:19.567 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:03 2024-09-21T01:01:19.590 INFO:teuthology.orchestra.run.smithi148.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T01:01:19.616 INFO:teuthology.orchestra.run.smithi148.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T01:01:19.641 INFO:teuthology.orchestra.run.smithi148.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T01:01:19.667 INFO:teuthology.orchestra.run.smithi148.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T01:01:19.692 INFO:teuthology.orchestra.run.smithi148.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-21T01:01:19.803 INFO:teuthology.orchestra.run.smithi181.stdout:(19/157): ceph-test-19.3.0-5120.g18432218.el9.x 25 MB/s | 40 MB 00:01 2024-09-21T01:01:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-21T01:01:19.828 INFO:teuthology.orchestra.run.smithi181.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 118 kB/s | 45 kB 00:00 2024-09-21T01:01:19.854 INFO:teuthology.orchestra.run.smithi181.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T01:01:19.867 INFO:teuthology.orchestra.run.smithi148.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T01:01:19.879 INFO:teuthology.orchestra.run.smithi181.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 3.1 MB/s | 161 kB 00:00 2024-09-21T01:01:19.904 INFO:teuthology.orchestra.run.smithi181.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T01:01:19.930 INFO:teuthology.orchestra.run.smithi181.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T01:01:19.955 INFO:teuthology.orchestra.run.smithi181.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T01:01:19.980 INFO:teuthology.orchestra.run.smithi181.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T01:01:20.018 INFO:teuthology.orchestra.run.smithi148.stdout:(106/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-21T01:01:20.051 INFO:teuthology.orchestra.run.smithi148.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 1.6 MB/s | 308 kB 00:00 2024-09-21T01:01:20.072 INFO:teuthology.orchestra.run.smithi181.stdout:(27/157): librgw2-19.3.0-5120.g18432218.el9.x86 7.8 MB/s | 5.3 MB 00:00 2024-09-21T01:01:20.076 INFO:teuthology.orchestra.run.smithi148.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-21T01:01:20.097 INFO:teuthology.orchestra.run.smithi181.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.4 MB/s | 170 kB 00:00 2024-09-21T01:01:20.102 INFO:teuthology.orchestra.run.smithi148.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-21T01:01:20.114 INFO:teuthology.orchestra.run.smithi181.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 822 kB/s | 34 kB 00:00 2024-09-21T01:01:20.127 INFO:teuthology.orchestra.run.smithi148.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-09-21T01:01:20.148 INFO:teuthology.orchestra.run.smithi181.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T01:01:20.161 INFO:teuthology.orchestra.run.smithi148.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-21T01:01:20.202 INFO:teuthology.orchestra.run.smithi148.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 483 kB/s | 49 kB 00:00 2024-09-21T01:01:20.206 INFO:teuthology.orchestra.run.smithi181.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 12 MB/s | 3.1 MB 00:00 2024-09-21T01:01:20.228 INFO:teuthology.orchestra.run.smithi148.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.3 MB/s | 151 kB 00:00 2024-09-21T01:01:20.278 INFO:teuthology.orchestra.run.smithi148.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-21T01:01:20.298 INFO:teuthology.orchestra.run.smithi181.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.1 MB/s | 292 kB 00:00 2024-09-21T01:01:20.303 INFO:teuthology.orchestra.run.smithi148.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T01:01:20.329 INFO:teuthology.orchestra.run.smithi148.stdout:(116/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-21T01:01:20.354 INFO:teuthology.orchestra.run.smithi148.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 639 kB/s | 32 kB 00:00 2024-09-21T01:01:20.365 INFO:teuthology.orchestra.run.smithi181.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 741 kB/s | 49 kB 00:00 2024-09-21T01:01:20.379 INFO:teuthology.orchestra.run.smithi148.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-21T01:01:20.405 INFO:teuthology.orchestra.run.smithi148.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T01:01:20.430 INFO:teuthology.orchestra.run.smithi148.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T01:01:20.433 INFO:teuthology.orchestra.run.smithi181.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 243 kB/s | 16 kB 00:00 2024-09-21T01:01:20.464 INFO:teuthology.orchestra.run.smithi148.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T01:01:20.489 INFO:teuthology.orchestra.run.smithi148.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T01:01:20.534 INFO:teuthology.orchestra.run.smithi181.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 2.8 MB/s | 285 kB 00:00 2024-09-21T01:01:20.555 INFO:teuthology.orchestra.run.smithi148.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-09-21T01:01:20.581 INFO:teuthology.orchestra.run.smithi148.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-21T01:01:20.606 INFO:teuthology.orchestra.run.smithi148.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-21T01:01:20.631 INFO:teuthology.orchestra.run.smithi148.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-21T01:01:20.657 INFO:teuthology.orchestra.run.smithi148.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-21T01:01:20.682 INFO:teuthology.orchestra.run.smithi148.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-21T01:01:20.684 INFO:teuthology.orchestra.run.smithi181.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 25 MB/s | 14 MB 00:00 2024-09-21T01:01:20.707 INFO:teuthology.orchestra.run.smithi148.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T01:01:20.726 INFO:teuthology.orchestra.run.smithi181.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 4.0 MB/s | 784 kB 00:00 2024-09-21T01:01:20.732 INFO:teuthology.orchestra.run.smithi148.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T01:01:20.752 INFO:teuthology.orchestra.run.smithi181.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 277 kB/s | 18 kB 00:00 2024-09-21T01:01:20.758 INFO:teuthology.orchestra.run.smithi148.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T01:01:20.783 INFO:teuthology.orchestra.run.smithi148.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T01:01:20.825 INFO:teuthology.orchestra.run.smithi148.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-21T01:01:20.844 INFO:teuthology.orchestra.run.smithi181.stdout:(39/157): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-09-21T01:01:20.850 INFO:teuthology.orchestra.run.smithi148.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-21T01:01:20.875 INFO:teuthology.orchestra.run.smithi148.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-21T01:01:20.901 INFO:teuthology.orchestra.run.smithi148.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T01:01:20.926 INFO:teuthology.orchestra.run.smithi148.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T01:01:20.951 INFO:teuthology.orchestra.run.smithi148.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-21T01:01:20.952 INFO:teuthology.orchestra.run.smithi181.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 354 kB/s | 80 kB 00:00 2024-09-21T01:01:21.002 INFO:teuthology.orchestra.run.smithi148.stdout:(139/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-21T01:01:21.002 INFO:teuthology.orchestra.run.smithi181.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T01:01:21.053 INFO:teuthology.orchestra.run.smithi181.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-21T01:01:21.059 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-21T01:01:21.065 INFO:teuthology.orchestra.run.smithi148.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 522 kB/s | 59 kB 00:00 2024-09-21T01:01:21.078 INFO:teuthology.orchestra.run.smithi181.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-21T01:01:21.094 INFO:teuthology.orchestra.run.smithi148.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-09-21T01:01:21.103 INFO:teuthology.orchestra.run.smithi181.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T01:01:21.119 INFO:teuthology.orchestra.run.smithi148.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 976 kB/s | 188 kB 00:00 2024-09-21T01:01:21.136 INFO:teuthology.orchestra.run.smithi148.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.0 MB/s | 74 kB 00:00 2024-09-21T01:01:21.137 INFO:teuthology.orchestra.run.smithi181.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 9.1 MB/s | 1.2 MB 00:00 2024-09-21T01:01:21.162 INFO:teuthology.orchestra.run.smithi181.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-21T01:01:21.170 INFO:teuthology.orchestra.run.smithi148.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-21T01:01:21.187 INFO:teuthology.orchestra.run.smithi181.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-21T01:01:21.195 INFO:teuthology.orchestra.run.smithi148.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T01:01:21.213 INFO:teuthology.orchestra.run.smithi181.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-21T01:01:21.220 INFO:teuthology.orchestra.run.smithi148.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-21T01:01:21.245 INFO:teuthology.orchestra.run.smithi148.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T01:01:21.279 INFO:teuthology.orchestra.run.smithi148.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-21T01:01:21.313 INFO:teuthology.orchestra.run.smithi181.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-21T01:01:21.329 INFO:teuthology.orchestra.run.smithi148.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T01:01:21.372 INFO:teuthology.orchestra.run.smithi181.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 373 kB/s | 22 kB 00:00 2024-09-21T01:01:21.397 INFO:teuthology.orchestra.run.smithi181.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-09-21T01:01:21.422 INFO:teuthology.orchestra.run.smithi181.stdout:(52/157): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-21T01:01:21.463 INFO:teuthology.orchestra.run.smithi148.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 17 MB/s | 2.3 MB 00:00 2024-09-21T01:01:21.464 INFO:teuthology.orchestra.run.smithi181.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-21T01:01:21.481 INFO:teuthology.orchestra.run.smithi181.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-21T01:01:21.522 INFO:teuthology.orchestra.run.smithi148.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 12 MB/s | 3.4 MB 00:00 2024-09-21T01:01:21.548 INFO:teuthology.orchestra.run.smithi181.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-09-21T01:01:21.563 INFO:teuthology.orchestra.run.smithi148.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 18 MB/s | 1.8 MB 00:00 2024-09-21T01:01:21.565 INFO:teuthology.orchestra.run.smithi181.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-21T01:01:21.605 INFO:teuthology.orchestra.run.smithi148.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 5.9 MB/s | 249 kB 00:00 2024-09-21T01:01:21.623 INFO:teuthology.orchestra.run.smithi181.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-21T01:01:21.631 INFO:teuthology.orchestra.run.smithi148.stdout:(154/157): NetworkManager-team-1.51.0-1.el9.x86 377 kB/s | 41 kB 00:00 2024-09-21T01:01:21.649 INFO:teuthology.orchestra.run.smithi181.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-21T01:01:21.689 INFO:teuthology.orchestra.run.smithi148.stdout:(155/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.7 MB/s | 3.2 MB 00:00 2024-09-21T01:01:21.699 INFO:teuthology.orchestra.run.smithi181.stdout:(59/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-21T01:01:21.716 INFO:teuthology.orchestra.run.smithi181.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 490 kB/s | 45 kB 00:00 2024-09-21T01:01:21.731 INFO:teuthology.orchestra.run.smithi148.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-21T01:01:21.750 INFO:teuthology.orchestra.run.smithi181.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-21T01:01:21.775 INFO:teuthology.orchestra.run.smithi181.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-21T01:01:21.809 INFO:teuthology.orchestra.run.smithi181.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-21T01:01:21.901 INFO:teuthology.orchestra.run.smithi148.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-21T01:01:21.901 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:01:21.901 INFO:teuthology.orchestra.run.smithi148.stdout:Total 26 MB/s | 228 MB 00:08 2024-09-21T01:01:21.902 INFO:teuthology.orchestra.run.smithi181.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-21T01:01:21.902 INFO:teuthology.orchestra.run.smithi181.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-21T01:01:21.902 INFO:teuthology.orchestra.run.smithi181.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 652 kB/s | 38 kB 00:00 2024-09-21T01:01:21.910 INFO:teuthology.orchestra.run.smithi181.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-21T01:01:22.019 INFO:teuthology.orchestra.run.smithi181.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-21T01:01:22.086 INFO:teuthology.orchestra.run.smithi181.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-21T01:01:22.128 INFO:teuthology.orchestra.run.smithi181.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-09-21T01:01:22.153 INFO:teuthology.orchestra.run.smithi181.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-21T01:01:22.178 INFO:teuthology.orchestra.run.smithi181.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-21T01:01:22.220 INFO:teuthology.orchestra.run.smithi181.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-21T01:01:22.222 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-21T01:01:22.287 INFO:teuthology.orchestra.run.smithi181.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 805 kB/s | 87 kB 00:00 2024-09-21T01:01:22.354 INFO:teuthology.orchestra.run.smithi181.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 918 kB/s | 61 kB 00:00 2024-09-21T01:01:22.429 INFO:teuthology.orchestra.run.smithi181.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-21T01:01:22.454 INFO:teuthology.orchestra.run.smithi181.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T01:01:22.530 INFO:teuthology.orchestra.run.smithi181.stdout:(78/157): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-21T01:01:22.555 INFO:teuthology.orchestra.run.smithi181.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 255 kB/s | 26 kB 00:00 2024-09-21T01:01:22.580 INFO:teuthology.orchestra.run.smithi181.stdout:(80/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-21T01:01:22.605 INFO:teuthology.orchestra.run.smithi181.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-09-21T01:01:22.631 INFO:teuthology.orchestra.run.smithi181.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-21T01:01:22.664 INFO:teuthology.orchestra.run.smithi181.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 413 kB/s | 35 kB 00:00 2024-09-21T01:01:22.698 INFO:teuthology.orchestra.run.smithi181.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-21T01:01:22.723 INFO:teuthology.orchestra.run.smithi181.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T01:01:22.790 INFO:teuthology.orchestra.run.smithi181.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-21T01:01:22.807 INFO:teuthology.orchestra.run.smithi181.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 506 kB/s | 42 kB 00:00 2024-09-21T01:01:22.832 INFO:teuthology.orchestra.run.smithi181.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 575 kB/s | 77 kB 00:00 2024-09-21T01:01:22.883 INFO:teuthology.orchestra.run.smithi181.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-21T01:01:22.908 INFO:teuthology.orchestra.run.smithi181.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-21T01:01:22.942 INFO:teuthology.orchestra.run.smithi181.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-21T01:01:22.967 INFO:teuthology.orchestra.run.smithi181.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-21T01:01:22.984 INFO:teuthology.orchestra.run.smithi181.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-09-21T01:01:23.059 INFO:teuthology.orchestra.run.smithi181.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-21T01:01:23.076 INFO:teuthology.orchestra.run.smithi181.stdout:(95/157): python3-toml-0.10.2-6.el9.noarch.rpm 382 kB/s | 42 kB 00:00 2024-09-21T01:01:23.118 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T01:01:23.143 INFO:teuthology.orchestra.run.smithi181.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 539 kB/s | 36 kB 00:00 2024-09-21T01:01:23.168 INFO:teuthology.orchestra.run.smithi181.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-21T01:01:23.273 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T01:01:23.274 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T01:01:23.327 INFO:teuthology.orchestra.run.smithi181.stdout:(98/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-09-21T01:01:23.344 INFO:teuthology.orchestra.run.smithi181.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 236 kB/s | 47 kB 00:00 2024-09-21T01:01:23.377 INFO:teuthology.orchestra.run.smithi181.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-21T01:01:23.394 INFO:teuthology.orchestra.run.smithi181.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 864 kB/s | 58 kB 00:00 2024-09-21T01:01:23.420 INFO:teuthology.orchestra.run.smithi181.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-21T01:01:23.445 INFO:teuthology.orchestra.run.smithi181.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 947 kB/s | 64 kB 00:00 2024-09-21T01:01:23.462 INFO:teuthology.orchestra.run.smithi181.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 668 kB/s | 45 kB 00:00 2024-09-21T01:01:23.487 INFO:teuthology.orchestra.run.smithi181.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 332 kB/s | 22 kB 00:00 2024-09-21T01:01:23.537 INFO:teuthology.orchestra.run.smithi181.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-21T01:01:23.563 INFO:teuthology.orchestra.run.smithi181.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 792 kB/s | 19 kB 00:00 2024-09-21T01:01:23.596 INFO:teuthology.orchestra.run.smithi181.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-21T01:01:23.622 INFO:teuthology.orchestra.run.smithi181.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T01:01:23.664 INFO:teuthology.orchestra.run.smithi181.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-21T01:01:23.689 INFO:teuthology.orchestra.run.smithi181.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-09-21T01:01:23.739 INFO:teuthology.orchestra.run.smithi181.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-21T01:01:23.773 INFO:teuthology.orchestra.run.smithi181.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 621 kB/s | 67 kB 00:00 2024-09-21T01:01:23.807 INFO:teuthology.orchestra.run.smithi181.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 13 MB/s | 839 kB 00:00 2024-09-21T01:01:23.832 INFO:teuthology.orchestra.run.smithi181.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T01:01:23.857 INFO:teuthology.orchestra.run.smithi181.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T01:01:23.882 INFO:teuthology.orchestra.run.smithi181.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-21T01:01:23.916 INFO:teuthology.orchestra.run.smithi181.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.7 MB/s | 548 kB 00:00 2024-09-21T01:01:23.941 INFO:teuthology.orchestra.run.smithi181.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T01:01:23.975 INFO:teuthology.orchestra.run.smithi181.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-21T01:01:24.008 INFO:teuthology.orchestra.run.smithi181.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-21T01:01:24.034 INFO:teuthology.orchestra.run.smithi181.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T01:01:24.168 INFO:teuthology.orchestra.run.smithi181.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-21T01:01:24.193 INFO:teuthology.orchestra.run.smithi181.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 909 kB/s | 144 kB 00:00 2024-09-21T01:01:24.218 INFO:teuthology.orchestra.run.smithi181.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-21T01:01:24.235 INFO:teuthology.orchestra.run.smithi181.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 423 kB/s | 18 kB 00:00 2024-09-21T01:01:24.260 INFO:teuthology.orchestra.run.smithi181.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 554 kB/s | 23 kB 00:00 2024-09-21T01:01:24.286 INFO:teuthology.orchestra.run.smithi181.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-21T01:01:24.311 INFO:teuthology.orchestra.run.smithi181.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T01:01:24.336 INFO:teuthology.orchestra.run.smithi181.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T01:01:24.362 INFO:teuthology.orchestra.run.smithi181.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T01:01:24.387 INFO:teuthology.orchestra.run.smithi181.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T01:01:24.421 INFO:teuthology.orchestra.run.smithi181.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T01:01:24.446 INFO:teuthology.orchestra.run.smithi181.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-21T01:01:24.479 INFO:teuthology.orchestra.run.smithi181.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-09-21T01:01:24.505 INFO:teuthology.orchestra.run.smithi181.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T01:01:24.538 INFO:teuthology.orchestra.run.smithi181.stdout:(137/157): python3-kubernetes-26.1.0-2.el9.noar 4.0 MB/s | 1.0 MB 00:00 2024-09-21T01:01:24.564 INFO:teuthology.orchestra.run.smithi181.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-09-21T01:01:24.589 INFO:teuthology.orchestra.run.smithi181.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T01:01:24.614 INFO:teuthology.orchestra.run.smithi181.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T01:01:24.640 INFO:teuthology.orchestra.run.smithi181.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-21T01:01:24.665 INFO:teuthology.orchestra.run.smithi181.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T01:01:24.699 INFO:teuthology.orchestra.run.smithi181.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-21T01:01:24.724 INFO:teuthology.orchestra.run.smithi181.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T01:01:24.774 INFO:teuthology.orchestra.run.smithi181.stdout:(145/157): python3-grpcio-1.46.7-10.el9.x86_64. 2.7 MB/s | 2.0 MB 00:00 2024-09-21T01:01:24.799 INFO:teuthology.orchestra.run.smithi181.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-09-21T01:01:24.825 INFO:teuthology.orchestra.run.smithi181.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T01:01:24.850 INFO:teuthology.orchestra.run.smithi181.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-21T01:01:24.900 INFO:teuthology.orchestra.run.smithi181.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T01:01:25.017 INFO:teuthology.orchestra.run.smithi181.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 21 MB/s | 2.3 MB 00:00 2024-09-21T01:01:25.101 INFO:teuthology.orchestra.run.smithi181.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 22 MB/s | 1.8 MB 00:00 2024-09-21T01:01:25.168 INFO:teuthology.orchestra.run.smithi181.stdout:(152/157): librados2-19.3.0-5120.g18432218.el9. 9.9 MB/s | 3.4 MB 00:00 2024-09-21T01:01:25.193 INFO:teuthology.orchestra.run.smithi181.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 445 kB/s | 41 kB 00:00 2024-09-21T01:01:25.218 INFO:teuthology.orchestra.run.smithi181.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-21T01:01:25.269 INFO:teuthology.orchestra.run.smithi181.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-21T01:01:25.327 INFO:teuthology.orchestra.run.smithi181.stdout:(156/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.6 MB/s | 3.2 MB 00:00 2024-09-21T01:01:25.369 INFO:teuthology.orchestra.run.smithi181.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-21T01:01:25.375 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:01:25.376 INFO:teuthology.orchestra.run.smithi181.stdout:Total 25 MB/s | 228 MB 00:09 2024-09-21T01:01:25.482 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T01:01:25.482 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T01:01:26.584 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-21T01:01:26.736 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-21T01:01:26.736 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-21T01:01:27.570 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T01:01:28.554 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-21T01:01:28.555 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-21T01:01:29.707 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:01:29.708 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:01:29.722 INFO:teuthology.orchestra.run.smithi157.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:01:29.723 INFO:teuthology.orchestra.run.smithi157.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:01:29.724 INFO:teuthology.orchestra.run.smithi157.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:01:29.725 INFO:teuthology.orchestra.run.smithi157.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:01:29.727 INFO:teuthology.orchestra.run.smithi157.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:01:29.729 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:01:29.730 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:01:29.793 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-09-21T01:01:29.809 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-09-21T01:01:29.809 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-09-21T01:01:29.809 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-09-21T01:01:29.809 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-09-21T01:01:29.809 INFO:teuthology.orchestra.run.smithi157.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:01:29.809 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:01:29.809 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:01:29.809 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:01:29.810 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:01:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:01:29.812 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:01:29.813 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:01:29.814 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:01:29.815 INFO:teuthology.orchestra.run.smithi157.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:01:29.816 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:01:29.817 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:01:29.818 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:01:29.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:01:29.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:01:29.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:01:29.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:01:29.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:01:29.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:01:29.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:01:29.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:01:29.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:01:29.819 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:01:29.820 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:01:29.821 INFO:teuthology.orchestra.run.smithi157.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout:Install 149 Packages 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 8 Packages 2024-09-21T01:01:29.822 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:01:29.823 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 228 M 2024-09-21T01:01:29.823 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-09-21T01:01:31.876 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T01:01:32.011 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:01:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:01:32.366 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:01:32.413 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:01:32.437 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:01:32.489 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:01:32.832 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:01:32.846 INFO:teuthology.orchestra.run.smithi157.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 35 kB/s | 6.6 kB 00:00 2024-09-21T01:01:32.946 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:01:33.030 INFO:teuthology.orchestra.run.smithi157.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T01:01:33.089 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:01:33.122 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:01:33.138 INFO:teuthology.orchestra.run.smithi157.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.3 MB/s | 148 kB 00:00 2024-09-21T01:01:33.213 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:01:33.243 INFO:teuthology.orchestra.run.smithi157.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 9.4 MB/s | 5.5 MB 00:00 2024-09-21T01:01:33.243 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:01:33.273 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:01:33.322 INFO:teuthology.orchestra.run.smithi157.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 12 MB/s | 2.3 MB 00:00 2024-09-21T01:01:33.372 INFO:teuthology.orchestra.run.smithi157.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-21T01:01:33.444 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:01:33.498 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:01:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:01:33.633 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:01:33.661 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:01:33.724 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:01:33.754 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:01:33.775 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:01:33.831 INFO:teuthology.orchestra.run.smithi157.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T01:01:33.898 INFO:teuthology.orchestra.run.smithi157.stdout:(8/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 8.6 MB/s | 5.0 MB 00:00 2024-09-21T01:01:33.947 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:01:33.956 INFO:teuthology.orchestra.run.smithi157.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 432 kB/s | 25 kB 00:00 2024-09-21T01:01:34.116 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:01:34.235 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:01:34.349 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:01:34.365 INFO:teuthology.orchestra.run.smithi157.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 20 MB/s | 10 MB 00:00 2024-09-21T01:01:34.428 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:01:34.549 INFO:teuthology.orchestra.run.smithi157.stdout:(11/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 15 MB/s | 18 MB 00:01 2024-09-21T01:01:34.574 INFO:teuthology.orchestra.run.smithi157.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.1 MB/s | 226 kB 00:00 2024-09-21T01:01:34.599 INFO:teuthology.orchestra.run.smithi157.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 540 kB/s | 27 kB 00:00 2024-09-21T01:01:34.624 INFO:teuthology.orchestra.run.smithi157.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 634 kB/s | 32 kB 00:00 2024-09-21T01:01:34.648 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:01:34.675 INFO:teuthology.orchestra.run.smithi157.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 10 MB/s | 766 kB 00:00 2024-09-21T01:01:34.700 INFO:teuthology.orchestra.run.smithi157.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T01:01:34.734 INFO:teuthology.orchestra.run.smithi157.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T01:01:34.761 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:01:34.767 INFO:teuthology.orchestra.run.smithi157.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T01:01:34.800 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:01:34.834 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:01:34.842 INFO:teuthology.orchestra.run.smithi157.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 602 kB/s | 45 kB 00:00 2024-09-21T01:01:34.909 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-21T01:01:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:01:34.926 INFO:teuthology.orchestra.run.smithi157.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T01:01:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:01:35.009 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:01:35.010 INFO:teuthology.orchestra.run.smithi157.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.3 MB 00:00 2024-09-21T01:01:35.035 INFO:teuthology.orchestra.run.smithi157.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.5 MB/s | 161 kB 00:00 2024-09-21T01:01:35.039 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:01:35.052 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:01:35.060 INFO:teuthology.orchestra.run.smithi157.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T01:01:35.085 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:01:35.085 INFO:teuthology.orchestra.run.smithi157.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T01:01:35.111 INFO:teuthology.orchestra.run.smithi157.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T01:01:35.112 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:01:35.136 INFO:teuthology.orchestra.run.smithi157.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T01:01:35.153 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:01:35.182 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:01:35.195 INFO:teuthology.orchestra.run.smithi157.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-21T01:01:35.235 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:01:35.253 INFO:teuthology.orchestra.run.smithi157.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 22 MB/s | 3.1 MB 00:00 2024-09-21T01:01:35.274 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:01:35.279 INFO:teuthology.orchestra.run.smithi157.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 408 kB/s | 34 kB 00:00 2024-09-21T01:01:35.316 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:01:35.318 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:01:35.329 INFO:teuthology.orchestra.run.smithi157.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.0 MB/s | 154 kB 00:00 2024-09-21T01:01:35.357 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:01:35.382 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:01:35.399 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:01:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:01:35.436 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:01:35.480 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:01:35.508 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:01:35.579 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:01:35.623 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:01:35.698 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:01:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:01:35.822 INFO:teuthology.orchestra.run.smithi157.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-21T01:01:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:01:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:01:35.897 INFO:teuthology.orchestra.run.smithi157.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.8 MB/s | 292 kB 00:00 2024-09-21T01:01:35.913 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:01:36.042 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:01:36.068 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:01:36.159 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:01:36.188 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:01:36.218 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:01:36.264 INFO:teuthology.orchestra.run.smithi157.stdout:(33/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T01:01:36.289 INFO:teuthology.orchestra.run.smithi157.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 126 kB/s | 49 kB 00:00 2024-09-21T01:01:36.314 INFO:teuthology.orchestra.run.smithi157.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 327 kB/s | 16 kB 00:00 2024-09-21T01:01:36.340 INFO:teuthology.orchestra.run.smithi157.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.5 MB/s | 285 kB 00:00 2024-09-21T01:01:36.372 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:01:36.408 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:01:36.486 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:01:36.490 INFO:teuthology.orchestra.run.smithi157.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T01:01:36.497 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:01:36.514 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:01:36.515 INFO:teuthology.orchestra.run.smithi157.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 105 kB/s | 18 kB 00:00 2024-09-21T01:01:36.533 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:01:36.549 INFO:teuthology.orchestra.run.smithi157.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.3 MB/s | 784 kB 00:00 2024-09-21T01:01:36.576 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:01:36.614 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:01:36.619 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:01:36.648 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:01:36.657 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:01:36.707 INFO:teuthology.orchestra.run.smithi157.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 368 kB/s | 80 kB 00:00 2024-09-21T01:01:36.710 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:01:36.733 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:01:36.754 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:01:36.810 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:01:36.816 INFO:teuthology.orchestra.run.smithi157.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 716 kB/s | 191 kB 00:00 2024-09-21T01:01:36.850 INFO:teuthology.orchestra.run.smithi157.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-21T01:01:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:01:36.891 INFO:teuthology.orchestra.run.smithi157.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.1 MB/s | 801 kB 00:00 2024-09-21T01:01:36.917 INFO:teuthology.orchestra.run.smithi157.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T01:01:36.917 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:01:36.950 INFO:teuthology.orchestra.run.smithi157.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T01:01:36.966 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:01:37.001 INFO:teuthology.orchestra.run.smithi157.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-21T01:01:37.039 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:01:37.042 INFO:teuthology.orchestra.run.smithi157.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T01:01:37.063 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:01:37.076 INFO:teuthology.orchestra.run.smithi157.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-09-21T01:01:37.112 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:01:37.144 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:01:37.180 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:01:37.189 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:01:37.227 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:01:37.263 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:01:37.306 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:01:37.309 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:01:37.348 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:01:37.382 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:01:37.484 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:01:37.525 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:01:37.535 INFO:teuthology.orchestra.run.smithi157.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-21T01:01:37.566 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:01:37.611 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:01:37.652 INFO:teuthology.orchestra.run.smithi157.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 186 kB/s | 22 kB 00:00 2024-09-21T01:01:37.670 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:01:37.709 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:01:37.730 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:01:37.735 INFO:teuthology.orchestra.run.smithi157.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 938 kB/s | 689 kB 00:00 2024-09-21T01:01:37.749 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:01:37.762 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:01:37.782 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:01:37.796 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:01:37.807 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:01:37.852 INFO:teuthology.orchestra.run.smithi157.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-21T01:01:37.878 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:01:37.893 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:01:37.925 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:01:37.966 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:01:38.009 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:01:38.033 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:01:38.036 INFO:teuthology.orchestra.run.smithi157.stdout:(53/157): bison-3.7.4-5.el9.x86_64.rpm 949 kB/s | 943 kB 00:00 2024-09-21T01:01:38.041 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:01:38.061 INFO:teuthology.orchestra.run.smithi157.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 766 kB/s | 313 kB 00:00 2024-09-21T01:01:38.078 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:01:38.080 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:01:38.108 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:01:38.138 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:01:38.148 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:01:38.153 INFO:teuthology.orchestra.run.smithi157.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-21T01:01:38.177 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:01:38.178 INFO:teuthology.orchestra.run.smithi157.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-09-21T01:01:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:01:38.209 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:01:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:01:38.238 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:01:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:01:38.273 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:01:38.295 INFO:teuthology.orchestra.run.smithi157.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.8 MB/s | 3.0 MB 00:00 2024-09-21T01:01:38.306 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:01:38.348 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:01:38.348 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:01:38.378 INFO:teuthology.orchestra.run.smithi157.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 762 kB/s | 171 kB 00:00 2024-09-21T01:01:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:01:38.385 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:01:38.429 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:01:38.429 INFO:teuthology.orchestra.run.smithi157.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 639 kB/s | 160 kB 00:00 2024-09-21T01:01:38.454 INFO:teuthology.orchestra.run.smithi157.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 285 kB/s | 45 kB 00:00 2024-09-21T01:01:38.457 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:01:38.469 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:01:38.513 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:01:38.520 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:01:38.552 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:01:38.571 INFO:teuthology.orchestra.run.smithi157.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 210 kB/s | 24 kB 00:00 2024-09-21T01:01:38.572 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:01:38.630 INFO:teuthology.orchestra.run.smithi157.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-21T01:01:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:01:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:01:38.680 INFO:teuthology.orchestra.run.smithi157.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-21T01:01:38.703 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:01:38.714 INFO:teuthology.orchestra.run.smithi157.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 2.0 MB/s | 581 kB 00:00 2024-09-21T01:01:38.756 INFO:teuthology.orchestra.run.smithi157.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-21T01:01:38.777 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:01:38.798 INFO:teuthology.orchestra.run.smithi157.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T01:01:38.823 INFO:teuthology.orchestra.run.smithi157.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 352 kB/s | 38 kB 00:00 2024-09-21T01:01:38.832 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:01:39.140 INFO:teuthology.orchestra.run.smithi157.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-21T01:01:39.207 INFO:teuthology.orchestra.run.smithi157.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-21T01:01:39.266 INFO:teuthology.orchestra.run.smithi157.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-21T01:01:39.324 INFO:teuthology.orchestra.run.smithi157.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-21T01:01:39.352 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:01:39.422 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:01:39.437 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:01:39.458 INFO:teuthology.orchestra.run.smithi157.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-21T01:01:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:01:39.475 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:01:39.508 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:01:39.509 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:01:39.525 INFO:teuthology.orchestra.run.smithi157.stdout:(73/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-09-21T01:01:39.554 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:01:39.567 INFO:teuthology.orchestra.run.smithi157.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 807 kB/s | 87 kB 00:00 2024-09-21T01:01:39.596 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:01:39.608 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:01:39.664 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:01:39.684 INFO:teuthology.orchestra.run.smithi157.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 525 kB/s | 61 kB 00:00 2024-09-21T01:01:39.709 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:01:39.771 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:01:39.796 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:01:39.800 INFO:teuthology.orchestra.run.smithi157.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-21T01:01:39.824 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:01:39.837 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:01:39.916 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:01:39.926 INFO:teuthology.orchestra.run.smithi157.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-21T01:01:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:01:40.022 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:01:40.034 INFO:teuthology.orchestra.run.smithi157.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-21T01:01:40.051 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:01:40.053 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:01:40.085 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:01:40.121 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:01:40.130 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:01:40.143 INFO:teuthology.orchestra.run.smithi157.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-21T01:01:40.167 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:01:40.212 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:01:40.255 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:01:40.260 INFO:teuthology.orchestra.run.smithi157.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T01:01:40.297 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:01:40.427 INFO:teuthology.orchestra.run.smithi157.stdout:(81/157): python3-babel-2.9.1-2.el9.noarch.rpm 6.6 MB/s | 6.0 MB 00:00 2024-09-21T01:01:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:01:40.452 INFO:teuthology.orchestra.run.smithi157.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 181 kB/s | 35 kB 00:00 2024-09-21T01:01:40.474 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:01:40.569 INFO:teuthology.orchestra.run.smithi157.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T01:01:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:01:40.686 INFO:teuthology.orchestra.run.smithi157.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T01:01:40.718 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:01:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:01:40.789 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:01:40.795 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:01:40.803 INFO:teuthology.orchestra.run.smithi157.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 662 kB/s | 77 kB 00:00 2024-09-21T01:01:40.815 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:01:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:01:40.910 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:01:40.922 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:01:40.928 INFO:teuthology.orchestra.run.smithi157.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 338 kB/s | 42 kB 00:00 2024-09-21T01:01:41.050 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:01:41.054 INFO:teuthology.orchestra.run.smithi157.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-21T01:01:41.079 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:01:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:01:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:01:41.171 INFO:teuthology.orchestra.run.smithi157.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T01:01:41.181 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:01:41.213 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:01:41.243 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:01:41.263 INFO:teuthology.orchestra.run.smithi157.stdout:(89/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.1 MB/s | 5.1 MB 00:00 2024-09-21T01:01:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:01:41.288 INFO:teuthology.orchestra.run.smithi157.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-21T01:01:41.310 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:01:41.352 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:01:41.380 INFO:teuthology.orchestra.run.smithi157.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-09-21T01:01:41.386 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:01:41.405 INFO:teuthology.orchestra.run.smithi157.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 458 kB/s | 54 kB 00:00 2024-09-21T01:01:41.473 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:01:41.514 INFO:teuthology.orchestra.run.smithi157.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-21T01:01:41.516 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:01:41.557 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:01:41.623 INFO:teuthology.orchestra.run.smithi157.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-21T01:01:41.659 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:01:41.707 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:01:41.740 INFO:teuthology.orchestra.run.smithi157.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.9 MB/s | 221 kB 00:00 2024-09-21T01:01:41.857 INFO:teuthology.orchestra.run.smithi157.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 307 kB/s | 36 kB 00:00 2024-09-21T01:01:41.966 INFO:teuthology.orchestra.run.smithi157.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-21T01:01:42.082 INFO:teuthology.orchestra.run.smithi157.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-21T01:01:42.175 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:01:42.199 INFO:teuthology.orchestra.run.smithi157.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 496 kB/s | 58 kB 00:00 2024-09-21T01:01:42.263 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:01:42.291 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:01:42.316 INFO:teuthology.orchestra.run.smithi157.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 822 kB/s | 96 kB 00:00 2024-09-21T01:01:42.324 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:01:42.427 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:01:42.450 INFO:teuthology.orchestra.run.smithi157.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 478 kB/s | 64 kB 00:00 2024-09-21T01:01:42.473 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:01:42.506 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:01:42.558 INFO:teuthology.orchestra.run.smithi157.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-21T01:01:42.614 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:01:42.642 INFO:teuthology.orchestra.run.smithi157.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 269 kB/s | 22 kB 00:00 2024-09-21T01:01:42.659 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:01:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:01:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:01:42.770 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:01:42.784 INFO:teuthology.orchestra.run.smithi157.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.9 MB/s | 863 kB 00:00 2024-09-21T01:01:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:01:42.834 INFO:teuthology.orchestra.run.smithi157.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T01:01:42.842 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:01:42.854 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:01:42.868 INFO:teuthology.orchestra.run.smithi157.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T01:01:42.883 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:01:42.901 INFO:teuthology.orchestra.run.smithi157.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 585 kB/s | 19 kB 00:00 2024-09-21T01:01:42.920 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:01:43.018 INFO:teuthology.orchestra.run.smithi157.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T01:01:43.026 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:01:43.044 INFO:teuthology.orchestra.run.smithi157.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T01:01:43.056 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:01:43.069 INFO:teuthology.orchestra.run.smithi157.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T01:01:43.094 INFO:teuthology.orchestra.run.smithi157.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T01:01:43.119 INFO:teuthology.orchestra.run.smithi157.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-21T01:01:43.134 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:01:43.153 INFO:teuthology.orchestra.run.smithi157.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T01:01:43.189 INFO:teuthology.orchestra.run.smithi157.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T01:01:43.212 INFO:teuthology.orchestra.run.smithi157.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T01:01:43.237 INFO:teuthology.orchestra.run.smithi157.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T01:01:43.262 INFO:teuthology.orchestra.run.smithi157.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-21T01:01:43.287 INFO:teuthology.orchestra.run.smithi157.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T01:01:43.330 INFO:teuthology.orchestra.run.smithi157.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-21T01:01:43.363 INFO:teuthology.orchestra.run.smithi157.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.8 MB/s | 303 kB 00:00 2024-09-21T01:01:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:01:43.456 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:01:43.528 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:01:43.550 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:01:43.572 INFO:teuthology.orchestra.run.smithi157.stdout:(121/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-09-21T01:01:43.606 INFO:teuthology.orchestra.run.smithi157.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 909 kB/s | 220 kB 00:00 2024-09-21T01:01:43.639 INFO:teuthology.orchestra.run.smithi157.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.5 MB/s | 144 kB 00:00 2024-09-21T01:01:43.665 INFO:teuthology.orchestra.run.smithi157.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-21T01:01:43.682 INFO:teuthology.orchestra.run.smithi157.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-21T01:01:43.698 INFO:teuthology.orchestra.run.smithi157.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T01:01:43.715 INFO:teuthology.orchestra.run.smithi157.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-21T01:01:43.732 INFO:teuthology.orchestra.run.smithi157.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-21T01:01:43.778 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:01:43.799 INFO:teuthology.orchestra.run.smithi157.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-21T01:01:43.816 INFO:teuthology.orchestra.run.smithi157.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T01:01:43.850 INFO:teuthology.orchestra.run.smithi157.stdout:(131/157): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-21T01:01:43.875 INFO:teuthology.orchestra.run.smithi157.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-21T01:01:43.888 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:01:43.900 INFO:teuthology.orchestra.run.smithi157.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-21T01:01:43.926 INFO:teuthology.orchestra.run.smithi157.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-21T01:01:44.002 INFO:teuthology.orchestra.run.smithi157.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-21T01:01:44.026 INFO:teuthology.orchestra.run.smithi157.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 898 kB/s | 90 kB 00:00 2024-09-21T01:01:44.052 INFO:teuthology.orchestra.run.smithi157.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 576 kB/s | 28 kB 00:00 2024-09-21T01:01:44.077 INFO:teuthology.orchestra.run.smithi157.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-21T01:01:44.102 INFO:teuthology.orchestra.run.smithi157.stdout:(139/157): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-21T01:01:44.127 INFO:teuthology.orchestra.run.smithi157.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T01:01:44.152 INFO:teuthology.orchestra.run.smithi157.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T01:01:44.178 INFO:teuthology.orchestra.run.smithi157.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T01:01:44.203 INFO:teuthology.orchestra.run.smithi157.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T01:01:44.228 INFO:teuthology.orchestra.run.smithi157.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T01:01:44.245 INFO:teuthology.orchestra.run.smithi157.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-21T01:01:44.270 INFO:teuthology.orchestra.run.smithi157.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-09-21T01:01:44.296 INFO:teuthology.orchestra.run.smithi157.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T01:01:44.346 INFO:teuthology.orchestra.run.smithi157.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T01:01:44.538 INFO:teuthology.orchestra.run.smithi157.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T01:01:44.647 INFO:teuthology.orchestra.run.smithi157.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-21T01:01:44.814 INFO:teuthology.orchestra.run.smithi157.stdout:(151/157): postgresql-server-13.16-1.el9.x86_64 1.0 MB/s | 5.8 MB 00:05 2024-09-21T01:01:44.923 INFO:teuthology.orchestra.run.smithi157.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 378 kB/s | 41 kB 00:00 2024-09-21T01:01:45.039 INFO:teuthology.orchestra.run.smithi157.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-21T01:01:45.081 INFO:teuthology.orchestra.run.smithi157.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.2 MB/s | 1.8 MB 00:00 2024-09-21T01:01:45.121 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:01:45.182 INFO:teuthology.orchestra.run.smithi157.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.6 MB/s | 2.3 MB 00:00 2024-09-21T01:01:45.218 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:01:45.246 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:01:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:01:45.324 INFO:teuthology.orchestra.run.smithi157.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 1.4 MB 00:00 2024-09-21T01:01:45.432 INFO:teuthology.orchestra.run.smithi157.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.8 MB/s | 2.4 MB 00:00 2024-09-21T01:01:45.438 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:01:45.438 INFO:teuthology.orchestra.run.smithi157.stdout:Total 15 MB/s | 228 MB 00:15 2024-09-21T01:01:45.605 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:01:45.839 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:01:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:01:45.871 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:01:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:01:46.449 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:01:46.483 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:01:46.516 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:01:46.553 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:01:46.575 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:01:46.575 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:01:46.575 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:01:46.575 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:01:46.617 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:01:46.623 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-09-21T01:01:46.624 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:01:46.654 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:01:46.778 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-09-21T01:01:46.778 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-09-21T01:01:48.593 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-09-21T01:01:48.593 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-09-21T01:01:49.002 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:01:49.034 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:01:49.602 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:01:49.646 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:01:49.729 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:01:49.764 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:01:55.166 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-09-21T01:01:55.269 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:01:55.307 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:01:55.361 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:01:55.394 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:01:55.420 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:01:55.462 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:01:55.795 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:01:55.921 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:01:56.047 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:01:56.081 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:01:56.172 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:01:56.210 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:01:56.239 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:01:56.391 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:01:56.449 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:01:56.477 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:01:56.574 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:01:56.603 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:01:56.648 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:01:56.670 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:01:56.691 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:01:56.881 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:01:57.006 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:01:57.119 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:01:57.222 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:01:57.320 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:01:57.540 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:01:57.652 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:01:57.686 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:01:57.720 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:01:57.784 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:01:57.829 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:01:57.869 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:01:57.922 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:01:57.954 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:01:57.991 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:01:58.068 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:01:58.123 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:01:58.152 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:01:58.187 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:01:58.267 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:01:58.306 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:01:58.350 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:01:58.378 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:01:58.447 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:01:58.493 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:01:58.537 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:01:58.538 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-09-21T01:01:58.538 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-09-21T01:01:58.538 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-09-21T01:01:58.538 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-09-21T01:01:58.538 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-09-21T01:01:58.538 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-09-21T01:01:58.538 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-09-21T01:01:58.538 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:01:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:01:58.700 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:01:58.722 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:01:58.739 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:01:58.739 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:01:58.739 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:01:58.739 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:01:58.761 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:01:59.314 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:01:59.390 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:01:59.420 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:01:59.471 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:01:59.517 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:01:59.558 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:01:59.719 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:01:59.779 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:01:59.870 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:01:59.943 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:02:00.015 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:02:00.056 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:02:00.091 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:02:00.138 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:02:00.174 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:02:00.217 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:02:00.259 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:02:00.346 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:02:00.374 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:02:00.374 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:00.374 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:02:00.374 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:02:00.374 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:02:00.374 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:02:00.393 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:02:00.436 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:02:00.486 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:02:00.596 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:02:00.600 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:02:00.624 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:02:00.624 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:00.624 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:02:00.624 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:02:00.625 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:02:00.625 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:02:00.636 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:02:00.676 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:02:00.702 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:02:00.726 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:02:00.800 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:02:00.928 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:02:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:02:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:02:01.116 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:01.116 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:02:01.117 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:02:01.117 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:02:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:02:01.142 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:02:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:02:01.213 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:02:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:02:01.255 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:02:01.288 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:02:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:02:01.324 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:02:01.343 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:02:01.367 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:02:01.400 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:02:01.442 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:02:01.476 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:02:01.526 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:02:01.526 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-09-21T01:02:01.526 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-09-21T01:02:01.526 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-09-21T01:02:01.526 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-09-21T01:02:01.526 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-09-21T01:02:01.526 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-09-21T01:02:01.527 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-09-21T01:02:01.527 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:01.529 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:02:01.564 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:02:01.576 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:02:01.606 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:02:01.637 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:02:01.654 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:02:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:02:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:02:01.717 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:01.717 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:02:01.718 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:01.749 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:02:01.751 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:02:01.805 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:02:01.891 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:02:01.935 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:02:01.967 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:02:01.994 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:02:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:02:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:02:02.519 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:02:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:02:02.569 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:02:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:02:02.602 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:02:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:02:02.704 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:02:02.757 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:02:02.802 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:02:02.889 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:02:02.930 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:02:03.133 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:02:03.161 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:02:03.239 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:02:03.313 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:02:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:02:03.340 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:03.340 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:02:03.340 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:02:03.340 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:02:03.340 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:03.564 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:02:03.587 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:02:03.587 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:03.587 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:02:03.587 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:02:03.587 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:02:03.587 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:03.879 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:02:04.022 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:02:04.056 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:02:04.079 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:02:04.079 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:04.079 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:02:04.079 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:02:04.079 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:02:04.079 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:04.186 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:02:04.242 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:02:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:02:04.491 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:02:04.539 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:02:04.616 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:02:04.706 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:02:04.869 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:02:04.906 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:02:04.947 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:02:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:02:05.223 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:02:05.307 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:02:05.334 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:02:05.367 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:02:05.445 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:02:05.473 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:02:05.505 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:02:05.571 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:02:05.596 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:02:05.715 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:02:05.763 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:02:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:02:05.855 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:02:05.886 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:02:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:02:05.920 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:02:06.417 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:02:06.450 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:02:06.528 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:02:06.552 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:02:06.853 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:02:06.880 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:02:06.999 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:02:07.174 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:02:07.199 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:02:07.224 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:02:07.224 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:07.224 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:02:07.224 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:02:07.224 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:02:07.224 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:02:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:02:07.295 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:02:07.394 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:02:07.445 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:02:08.422 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:02:08.452 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:02:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:02:08.477 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:08.477 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:02:08.477 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:02:08.477 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:02:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:02:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:02:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:02:08.543 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:08.543 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:02:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:02:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:02:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:02:08.619 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:08.619 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:02:08.619 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:02:08.619 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:02:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:02:08.780 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:02:08.813 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:02:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:02:08.848 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:02:08.937 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:02:08.961 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:02:08.961 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:08.961 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:02:08.961 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:02:08.962 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:02:08.962 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:02:09.409 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:02:09.443 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:02:09.523 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:02:09.523 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:02:09.524 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:02:09.524 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:09.552 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:02:09.793 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:02:09.827 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:02:09.940 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:02:10.135 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:02:10.162 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:02:10.186 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:02:10.187 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:10.187 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:02:10.187 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:02:10.187 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:02:10.187 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:02:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:02:10.350 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:02:10.394 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:02:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:02:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:02:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:02:11.414 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:11.414 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:02:11.414 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:02:11.414 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:02:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:11.497 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:02:11.520 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:02:11.520 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:11.520 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:02:11.520 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:11.575 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:02:11.598 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:02:11.598 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:11.598 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:02:11.598 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:02:11.599 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:02:11.599 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:11.926 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:02:11.949 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:02:11.949 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:11.949 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:02:11.950 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:02:11.950 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:02:11.950 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:12.984 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:02:13.024 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:02:13.065 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:02:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:02:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:02:13.335 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:02:13.388 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:02:13.418 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:02:13.447 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:02:13.494 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:02:14.100 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:02:14.141 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:02:14.162 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:02:15.010 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:02:15.087 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:02:15.132 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:02:15.230 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:02:15.265 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:02:15.291 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:02:15.317 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:02:15.317 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:02:15.409 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:02:15.409 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:02:15.485 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:02:15.509 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:02:15.515 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:02:15.515 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:02:15.695 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:02:15.695 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:02:15.787 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:02:15.852 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:02:15.914 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:02:15.954 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:02:15.995 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:02:16.027 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:02:16.054 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:02:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:02:16.276 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:02:16.298 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:02:16.328 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:02:16.374 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:02:16.943 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:02:16.980 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:02:17.001 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:02:17.836 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:02:17.927 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:02:17.967 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:02:18.048 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:02:18.088 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:02:18.114 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:02:18.139 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:02:18.140 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:02:18.224 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:02:18.224 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:02:18.317 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:02:18.387 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:02:18.387 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:02:18.387 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:02:18.518 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:02:18.518 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:02:18.603 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:02:18.665 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:02:21.278 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:02:21.278 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2024-09-21T01:02:21.279 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2024-09-21T01:02:21.279 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2024-09-21T01:02:21.279 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2024-09-21T01:02:21.279 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2024-09-21T01:02:21.279 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /root 2024-09-21T01:02:21.279 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2024-09-21T01:02:21.279 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:21.454 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:02:21.470 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:02:21.470 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:21.470 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:02:21.470 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:22.263 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:02:22.263 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:02:22.263 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:02:22.263 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:02:22.263 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:02:22.263 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:02:22.263 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:02:22.264 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:02:22.265 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:02:22.265 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:02:22.265 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:02:22.265 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:02:22.265 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:02:22.265 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:02:22.265 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:02:22.265 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:02:22.265 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:02:22.265 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:02:22.276 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:02:22.276 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:02:22.276 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:02:22.277 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:02:22.278 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:02:22.279 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:02:22.280 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:02:22.281 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:02:22.282 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:02:22.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:02:22.284 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:02:22.285 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:02:22.286 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:02:23.025 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:02:23.051 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:02:23.051 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:23.051 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:02:23.051 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:02:23.051 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:02:23.051 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:23.276 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:02:23.298 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:02:23.298 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:23.298 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:02:23.298 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:02:23.298 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:02:23.299 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:23.766 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:02:23.782 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:02:23.783 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:23.783 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:02:23.783 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:02:23.783 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:02:23.783 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:23.888 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:02:23.946 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:02:24.002 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:02:24.186 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:02:24.243 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:02:24.329 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:02:24.426 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:02:24.572 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:02:24.618 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:02:24.650 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:02:24.677 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:02:25.029 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:02:25.059 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:02:25.080 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:02:25.080 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:02:25.080 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-09-21T01:02:25.080 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:25.080 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:25.080 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:25.080 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.081 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.082 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:02:25.083 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:02:25.084 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:02:25.085 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:02:25.086 INFO:teuthology.orchestra.run.smithi148.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:02:25.087 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:02:25.088 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:02:25.089 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:02:25.090 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:02:25.091 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:02:25.091 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:02:25.091 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:02:25.091 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:02:25.091 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:02:25.091 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:02:25.091 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:02:25.091 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:02:25.091 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:02:25.092 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:02:25.092 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:02:25.092 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:02:25.092 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:02:25.092 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.092 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.092 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:25.092 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:02:25.093 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:02:25.093 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:02:25.093 INFO:teuthology.orchestra.run.smithi148.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:02:25.093 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:02:25.093 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:02:25.094 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:02:25.094 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:02:25.094 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:02:25.094 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T01:02:25.157 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:02:25.191 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:02:25.216 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:02:25.216 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:02:25.216 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:02:25.216 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:02:25.216 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:02:25.216 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:02:25.216 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:02:25.216 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:02:25.216 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:02:25.216 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:02:25.217 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:02:25.218 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:02:25.219 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:02:25.220 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:02:25.221 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:02:25.222 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:02:25.223 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:02:25.224 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:02:25.225 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:02:25.226 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:02:25.227 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:02:25.228 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:02:25.228 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:02:25.228 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:02:25.228 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:02:25.228 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:02:25.228 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:02:25.228 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:02:25.489 DEBUG:teuthology.parallel:result is None 2024-09-21T01:02:28.056 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:02:28.056 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:28.056 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-09-21T01:02:28.056 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:28.056 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.057 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.058 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:02:28.059 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:02:28.060 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:02:28.061 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:02:28.062 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:02:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:02:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:02:28.065 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:02:28.066 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.067 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:28.068 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:02:28.068 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:02:28.068 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:02:28.068 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:02:28.068 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:02:28.068 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:02:28.068 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:02:28.068 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:02:28.068 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-21T01:02:28.351 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:02:28.422 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:02:28.500 DEBUG:teuthology.parallel:result is None 2024-09-21T01:02:29.384 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:02:29.405 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:02:29.517 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:02:29.697 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:02:29.733 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:02:29.756 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:02:29.756 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:29.756 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:02:29.756 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:02:29.756 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:02:29.756 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:29.800 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:02:29.811 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:02:29.910 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:02:29.956 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:02:30.917 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:02:30.952 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:02:30.975 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:02:30.975 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:30.975 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:02:30.975 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:02:30.975 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:02:30.976 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:31.019 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:02:31.042 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:02:31.042 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:31.042 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:02:31.042 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:31.087 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:02:31.110 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:02:31.110 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:31.110 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:02:31.110 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:02:31.110 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:02:31.110 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:31.429 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:02:31.452 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:02:31.452 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:02:31.452 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:02:31.452 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:02:31.452 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:02:31.453 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:35.433 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:02:35.474 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:02:35.514 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:02:35.547 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:02:35.574 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:02:35.755 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:02:35.805 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:02:35.835 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:02:35.864 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:02:35.911 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:02:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:02:36.517 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:02:36.537 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:02:37.368 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:02:37.454 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:02:37.495 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:02:37.577 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:02:37.607 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:02:37.632 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:02:37.667 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:02:37.667 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:02:37.751 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:02:37.751 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:02:37.835 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:02:37.860 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:02:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:02:37.865 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:02:38.037 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:02:38.037 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:02:38.129 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:02:38.192 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:02:44.412 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:02:44.412 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:02:44.412 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:02:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:02:44.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:02:44.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:02:44.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:02:44.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:02:44.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:02:44.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:02:44.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:02:44.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:02:44.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:02:44.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:02:44.415 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:02:44.415 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:02:44.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:02:44.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:02:44.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:02:44.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:02:44.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:02:44.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:02:44.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:02:44.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:02:44.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:02:44.426 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:02:44.427 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:02:44.428 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:02:44.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:02:44.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:02:44.431 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:02:44.432 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:02:44.433 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:02:44.434 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:02:44.435 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:02:44.436 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:02:44.436 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:02:44.436 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:02:47.124 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:02:47.124 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:47.124 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-09-21T01:02:47.124 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:47.124 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:47.125 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:47.125 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:02:47.125 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.125 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.125 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:02:47.125 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:02:47.125 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-09-21T01:02:47.126 INFO:teuthology.orchestra.run.smithi157.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:02:47.126 INFO:teuthology.orchestra.run.smithi157.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:02:47.126 INFO:teuthology.orchestra.run.smithi157.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:02:47.126 INFO:teuthology.orchestra.run.smithi157.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:02:47.126 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.126 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.127 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.127 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.127 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:47.127 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.127 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.127 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.127 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:47.128 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:47.128 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:47.128 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:47.128 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:47.128 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.128 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.128 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:47.129 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.129 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.129 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.129 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:47.129 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:47.129 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.129 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.130 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:02:47.130 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:02:47.130 INFO:teuthology.orchestra.run.smithi157.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:02:47.130 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:02:47.131 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:02:47.131 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:02:47.131 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:02:47.131 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:02:47.131 INFO:teuthology.orchestra.run.smithi157.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:02:47.131 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:02:47.132 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:02:47.132 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:02:47.132 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.132 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.132 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.132 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:02:47.132 INFO:teuthology.orchestra.run.smithi157.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:02:47.133 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:02:47.133 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:02:47.133 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:02:47.133 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:02:47.133 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.133 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.133 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:02:47.133 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.134 INFO:teuthology.orchestra.run.smithi157.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:02:47.134 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:02:47.134 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:02:47.134 INFO:teuthology.orchestra.run.smithi157.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:02:47.134 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:02:47.134 INFO:teuthology.orchestra.run.smithi157.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:02:47.134 INFO:teuthology.orchestra.run.smithi157.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:02:47.135 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:02:47.135 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:02:47.135 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:02:47.135 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:02:47.135 INFO:teuthology.orchestra.run.smithi157.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:02:47.135 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:02:47.135 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:02:47.136 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:02:47.136 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:02:47.136 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:02:47.136 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:02:47.136 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:02:47.136 INFO:teuthology.orchestra.run.smithi157.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:02:47.136 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:02:47.136 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:02:47.137 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:02:47.137 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.137 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.137 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.137 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:02:47.137 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:02:47.137 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:02:47.138 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:02:47.138 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:02:47.138 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:02:47.138 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:02:47.138 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:02:47.138 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:02:47.138 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:02:47.139 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:02:47.139 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:02:47.139 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:02:47.139 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:02:47.139 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:02:47.140 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:02:47.140 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:02:47.140 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:02:47.140 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:02:47.140 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:02:47.141 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:02:47.141 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:02:47.141 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:02:47.141 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:02:47.141 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:02:47.141 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:02:47.142 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:02:47.142 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:02:47.142 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:02:47.142 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:02:47.142 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:02:47.142 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:02:47.143 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:02:47.143 INFO:teuthology.orchestra.run.smithi157.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:02:47.143 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:02:47.143 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:02:47.143 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:02:47.143 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:02:47.144 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:02:47.144 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:02:47.144 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.144 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.144 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:02:47.144 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:02:47.145 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:02:47.145 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.145 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:02:47.145 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:02:47.145 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:02:47.145 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:02:47.146 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:02:47.146 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:02:47.146 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:02:47.146 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:02:47.147 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:02:47.147 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:02:47.147 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:02:47.147 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:02:47.147 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:02:47.147 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:02:47.148 INFO:teuthology.orchestra.run.smithi157.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:02:47.148 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.148 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.148 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:02:47.148 INFO:teuthology.orchestra.run.smithi157.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:02:47.148 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:02:47.149 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:02:47.149 INFO:teuthology.orchestra.run.smithi157.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:02:47.149 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:02:47.149 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:02:47.150 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:02:47.150 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:02:47.151 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-09-21T01:02:47.584 DEBUG:teuthology.parallel:result is None 2024-09-21T01:02:47.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:02:47.734 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:02:47.761 INFO:teuthology.orchestra.run.smithi148.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:02:47.761 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:02:47.762 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:02:47.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:02:47.906 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:02:47.929 INFO:teuthology.orchestra.run.smithi157.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:02:47.929 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:02:47.929 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:02:47.931 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:02:48.073 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:02:48.099 INFO:teuthology.orchestra.run.smithi181.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:02:48.099 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:02:48.099 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:02:48.101 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T01:02:48.101 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:02:48.102 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:02:48.134 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T01:02:48.134 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:02:48.162 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T01:02:48.162 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:02:48.193 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T01:02:48.194 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:02:48.194 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:02:48.223 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:02:48.292 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T01:02:48.292 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:02:48.319 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:02:48.385 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T01:02:48.385 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:02:48.415 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:02:48.483 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T01:02:48.483 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:02:48.484 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:02:48.511 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:02:48.575 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T01:02:48.608 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:02:48.634 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:02:48.700 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T01:02:48.700 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:02:48.725 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:02:48.791 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T01:02:48.791 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:02:48.791 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:02:48.816 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:02:48.882 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T01:02:48.882 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:02:48.907 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:02:48.973 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T01:02:48.973 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:02:48.998 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:02:49.064 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T01:02:49.161 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-21T01:02:49.161 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:02:49.162 INFO:tasks.cephadm:Cluster fsid is 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:02:49.162 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T01:02:49.162 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.148', 'mon.b': '172.21.15.157', 'mon.c': '172.21.15.181'} 2024-09-21T01:02:49.162 INFO:tasks.cephadm:First mon is mon.a on smithi148 2024-09-21T01:02:49.162 INFO:tasks.cephadm:First mgr is x 2024-09-21T01:02:49.162 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T01:02:49.162 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname $(hostname -s) 2024-09-21T01:02:49.188 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname $(hostname -s) 2024-09-21T01:02:49.214 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname $(hostname -s) 2024-09-21T01:02:49.239 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T01:02:49.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:02:49.398 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T01:02:49.550 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:02:49.551 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T01:02:49.552 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T01:02:49.552 DEBUG:teuthology.orchestra.run.smithi148:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T01:02:50.082 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 01:02 /home/ubuntu/cephtest/cephadm 2024-09-21T01:02:50.083 DEBUG:teuthology.orchestra.run.smithi157:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T01:02:50.653 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 01:02 /home/ubuntu/cephtest/cephadm 2024-09-21T01:02:50.654 DEBUG:teuthology.orchestra.run.smithi181:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T01:02:51.375 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 01:02 /home/ubuntu/cephtest/cephadm 2024-09-21T01:02:51.376 DEBUG:teuthology.orchestra.run.smithi148:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T01:02:51.395 DEBUG:teuthology.orchestra.run.smithi157:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T01:02:51.415 DEBUG:teuthology.orchestra.run.smithi181:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T01:02:51.449 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T01:02:51.449 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T01:02:51.452 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T01:02:51.458 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T01:02:52.967 INFO:teuthology.orchestra.run.smithi181.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:02:53.006 INFO:teuthology.orchestra.run.smithi157.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:02:53.082 INFO:teuthology.orchestra.run.smithi148.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:03:26.222 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:03:26.223 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:03:26.223 INFO:teuthology.orchestra.run.smithi148.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T01:03:26.223 INFO:teuthology.orchestra.run.smithi148.stdout: "repo_digests": [ 2024-09-21T01:03:26.223 INFO:teuthology.orchestra.run.smithi148.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T01:03:26.223 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T01:03:26.223 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:03:45.260 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-21T01:03:45.260 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:03:45.260 INFO:teuthology.orchestra.run.smithi157.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T01:03:45.260 INFO:teuthology.orchestra.run.smithi157.stdout: "repo_digests": [ 2024-09-21T01:03:45.260 INFO:teuthology.orchestra.run.smithi157.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T01:03:45.260 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-09-21T01:03:45.261 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-21T01:03:45.568 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T01:03:45.568 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:03:45.568 INFO:teuthology.orchestra.run.smithi181.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T01:03:45.568 INFO:teuthology.orchestra.run.smithi181.stdout: "repo_digests": [ 2024-09-21T01:03:45.568 INFO:teuthology.orchestra.run.smithi181.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T01:03:45.568 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-21T01:03:45.568 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T01:03:45.594 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph 2024-09-21T01:03:45.628 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph 2024-09-21T01:03:45.656 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph 2024-09-21T01:03:45.683 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /etc/ceph 2024-09-21T01:03:45.712 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /etc/ceph 2024-09-21T01:03:45.737 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /etc/ceph 2024-09-21T01:03:45.762 INFO:tasks.cephadm:Writing seed config... 2024-09-21T01:03:45.763 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T01:03:45.763 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T01:03:45.763 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T01:03:45.764 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T01:03:45.764 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T01:03:45.764 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T01:03:45.764 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T01:03:45.764 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T01:03:45.764 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T01:03:45.764 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T01:03:45.764 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T01:03:45.764 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T01:03:45.765 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T01:03:45.765 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T01:03:45.765 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T01:03:45.765 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T01:03:45.765 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T01:03:45.765 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T01:03:45.765 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T01:03:45.765 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T01:03:45.765 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T01:03:45.766 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T01:03:45.766 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T01:03:45.766 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T01:03:45.766 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T01:03:45.766 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T01:03:45.767 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:03:45.767 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T01:03:45.784 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3872f802-77b5-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T01:03:45.785 DEBUG:teuthology.orchestra.run.smithi148:mon.a> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T01:03:45.827 DEBUG:teuthology.orchestra.run.smithi148:mgr.x> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T01:03:45.870 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T01:03:45.871 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 3872f802-77b5-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.148 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:03:46.076 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:03:46.076 INFO:teuthology.orchestra.run.smithi148.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.148', '--skip-admin-label'] 2024-09-21T01:03:46.076 INFO:teuthology.orchestra.run.smithi148.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T01:03:46.076 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying podman|docker is present... 2024-09-21T01:03:46.100 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stdout 5.2.2 2024-09-21T01:03:46.100 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying lvm2 is present... 2024-09-21T01:03:46.100 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying time synchronization is in place... 2024-09-21T01:03:46.108 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T01:03:46.108 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T01:03:46.114 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T01:03:46.114 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-21T01:03:46.121 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout enabled 2024-09-21T01:03:46.127 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout active 2024-09-21T01:03:46.128 INFO:teuthology.orchestra.run.smithi148.stdout:Unit chronyd.service is enabled and running 2024-09-21T01:03:46.128 INFO:teuthology.orchestra.run.smithi148.stdout:Repeating the final host check... 2024-09-21T01:03:46.150 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stdout 5.2.2 2024-09-21T01:03:46.150 INFO:teuthology.orchestra.run.smithi148.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T01:03:46.150 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl is present 2024-09-21T01:03:46.150 INFO:teuthology.orchestra.run.smithi148.stdout:lvcreate is present 2024-09-21T01:03:46.156 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T01:03:46.156 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T01:03:46.163 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T01:03:46.163 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-21T01:03:46.169 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout enabled 2024-09-21T01:03:46.176 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout active 2024-09-21T01:03:46.177 INFO:teuthology.orchestra.run.smithi148.stdout:Unit chronyd.service is enabled and running 2024-09-21T01:03:46.177 INFO:teuthology.orchestra.run.smithi148.stdout:Host looks OK 2024-09-21T01:03:46.177 INFO:teuthology.orchestra.run.smithi148.stdout:Cluster fsid: 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:03:46.177 INFO:teuthology.orchestra.run.smithi148.stdout:Acquiring lock 140310926006640 on /run/cephadm/3872f802-77b5-11ef-baf5-efdc52797490.lock 2024-09-21T01:03:46.177 INFO:teuthology.orchestra.run.smithi148.stdout:Lock 140310926006640 acquired on /run/cephadm/3872f802-77b5-11ef-baf5-efdc52797490.lock 2024-09-21T01:03:46.177 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying IP 172.21.15.148 port 3300 ... 2024-09-21T01:03:46.178 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying IP 172.21.15.148 port 6789 ... 2024-09-21T01:03:46.178 INFO:teuthology.orchestra.run.smithi148.stdout:Base mon IP(s) is [172.21.15.148:3300, 172.21.15.148:6789], mon addrv is [v2:172.21.15.148:3300,v1:172.21.15.148:6789] 2024-09-21T01:03:46.180 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.148 metric 100 2024-09-21T01:03:46.180 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.148 metric 100 2024-09-21T01:03:46.183 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T01:03:46.183 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T01:03:46.183 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T01:03:46.185 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T01:03:46.185 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T01:03:46.185 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T01:03:46.185 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T01:03:46.185 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7257/64 scope link noprefixroute 2024-09-21T01:03:46.186 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T01:03:46.186 INFO:teuthology.orchestra.run.smithi148.stdout:Mon IP `172.21.15.148` is in CIDR network `172.21.0.0/20` 2024-09-21T01:03:46.186 INFO:teuthology.orchestra.run.smithi148.stdout:Mon IP `172.21.15.148` is in CIDR network `172.21.0.0/20` 2024-09-21T01:03:46.186 INFO:teuthology.orchestra.run.smithi148.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T01:03:46.187 INFO:teuthology.orchestra.run.smithi148.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T01:03:46.187 INFO:teuthology.orchestra.run.smithi148.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:03:46.664 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T01:03:46.664 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:03:46.664 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T01:03:46.664 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T01:03:46.664 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T01:03:46.664 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T01:03:46.664 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T01:03:47.568 INFO:teuthology.orchestra.run.smithi148.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T01:03:47.568 INFO:teuthology.orchestra.run.smithi148.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T01:03:47.568 INFO:teuthology.orchestra.run.smithi148.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T01:03:48.441 INFO:teuthology.orchestra.run.smithi148.stdout:stat: stdout 167 167 2024-09-21T01:03:48.441 INFO:teuthology.orchestra.run.smithi148.stdout:Creating initial keys... 2024-09-21T01:03:49.421 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph-authtool: stdout AQB0G+5mgxozLBAAhhQneoLc7Dk/WPbEjpWgWA== 2024-09-21T01:03:58.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph-authtool: stdout AQB3G+5mDlqJNRAA8ps+uCHnyp2fVEfIs2emgQ== 2024-09-21T01:04:02.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph-authtool: stdout AQCAG+5mbYQwNxAA9Nsd5LNTOlfn2rVmGQDzVA== 2024-09-21T01:04:02.699 INFO:teuthology.orchestra.run.smithi148.stdout:Creating initial monmap... 2024-09-21T01:04:03.746 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T01:04:03.746 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T01:04:03.746 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:03.746 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T01:04:03.746 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool for a [v2:172.21.15.148:3300,v1:172.21.15.148:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T01:04:03.746 INFO:teuthology.orchestra.run.smithi148.stdout:setting min_mon_release = quincy 2024-09-21T01:04:03.747 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: set fsid to 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:03.747 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T01:04:03.747 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:04:03.747 INFO:teuthology.orchestra.run.smithi148.stdout:Creating mon... 2024-09-21T01:04:04.585 INFO:teuthology.orchestra.run.smithi148.stdout:create mon.a on 2024-09-21T01:04:04.784 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T01:04:04.927 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T01:04:05.130 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3872f802-77b5-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-3872f802-77b5-11ef-baf5-efdc52797490.target. 2024-09-21T01:04:05.130 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3872f802-77b5-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-3872f802-77b5-11ef-baf5-efdc52797490.target. 2024-09-21T01:04:05.361 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.a 2024-09-21T01:04:05.361 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T01:04:05.593 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3872f802-77b5-11ef-baf5-efdc52797490.target.wants/ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-3872f802-77b5-11ef-baf5-efdc52797490@.service. 2024-09-21T01:04:05.646 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:05 smithi148 systemd[1]: Starting Ceph mon.a for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:04:05.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:05 smithi148 podman[30610]: 2024-09-21 01:04:05.809573696 +0000 UTC m=+0.099377820 container create 352247ef9781c4642d37e969535371610294b8d40fdbf06a152bb51fa979ccbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T01:04:05.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:05 smithi148 podman[30610]: 2024-09-21 01:04:05.725997376 +0000 UTC m=+0.015801513 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:04:06.109 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:04:06.109 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-09-21T01:04:06.116 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:04:06.116 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-21T01:04:06.116 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-09-21T01:04:06.116 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T01:04:06.117 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mon to start... 2024-09-21T01:04:06.117 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mon... 2024-09-21T01:04:06.355 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:06 smithi148 podman[30610]: 2024-09-21 01:04:06.012271932 +0000 UTC m=+0.302076073 container init 352247ef9781c4642d37e969535371610294b8d40fdbf06a152bb51fa979ccbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T01:04:06.355 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:06 smithi148 podman[30610]: 2024-09-21 01:04:06.015309272 +0000 UTC m=+0.305113398 container start 352247ef9781c4642d37e969535371610294b8d40fdbf06a152bb51fa979ccbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T01:04:06.355 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:06 smithi148 ceph-mon[30629]: mkfs 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:06.356 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:06 smithi148 ceph-mon[30629]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T01:04:06.356 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:06 smithi148 bash[30610]: 352247ef9781c4642d37e969535371610294b8d40fdbf06a152bb51fa979ccbe 2024-09-21T01:04:06.356 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:06 smithi148 systemd[1]: Started Ceph mon.a for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:04:07.097 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T01:04:07.098 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout id: 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:07.098 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T01:04:07.098 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:07.098 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout services: 2024-09-21T01:04:07.098 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.534724s) 2024-09-21T01:04:07.098 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T01:04:07.098 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T01:04:07.098 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:07.098 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout data: 2024-09-21T01:04:07.099 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T01:04:07.099 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T01:04:07.099 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T01:04:07.099 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T01:04:07.099 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:07.099 INFO:teuthology.orchestra.run.smithi148.stdout:mon is available 2024-09-21T01:04:07.099 INFO:teuthology.orchestra.run.smithi148.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T01:04:07.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T01:04:07.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: monmap epoch 1 2024-09-21T01:04:07.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:07.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: last_changed 2024-09-21T01:04:03.032888+0000 2024-09-21T01:04:07.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: created 2024-09-21T01:04:03.032888+0000 2024-09-21T01:04:07.219 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: min_mon_release 19 (squid) 2024-09-21T01:04:07.219 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: election_strategy: 1 2024-09-21T01:04:07.219 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-21T01:04:07.219 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: fsmap 2024-09-21T01:04:07.219 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T01:04:07.219 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: mgrmap e1: no daemons active 2024-09-21T01:04:07.219 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:07 smithi148 ceph-mon[30629]: from='client.? 172.21.15.148:0/1361460827' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T01:04:08.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:08 smithi148 ceph-mon[30629]: from='client.? 172.21.15.148:0/1041374760' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T01:04:08.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:08 smithi148 ceph-mon[30629]: from='client.? 172.21.15.148:0/1041374760' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout fsid = 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.148:3300,v1:172.21.15.148:6789] 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi148.stdout:Generating new minimal ceph.conf... 2024-09-21T01:04:09.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:09 smithi148 ceph-mon[30629]: from='client.? 172.21.15.148:0/2883893981' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:09.476 INFO:teuthology.orchestra.run.smithi148.stdout:Restarting the monitor... 2024-09-21T01:04:09.760 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:09 smithi148 systemd[1]: Stopping Ceph mon.a for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:04:10.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:09 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a[30625]: 2024-09-21T01:04:09.759+0000 7fcb18d81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:04:10.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:09 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a[30625]: 2024-09-21T01:04:09.759+0000 7fcb18d81640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T01:04:10.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:09 smithi148 podman[30873]: 2024-09-21 01:04:09.943785194 +0000 UTC m=+0.299677493 container died 352247ef9781c4642d37e969535371610294b8d40fdbf06a152bb51fa979ccbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T01:04:10.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:10 smithi148 podman[30873]: 2024-09-21 01:04:10.293132134 +0000 UTC m=+0.649024429 container cleanup 352247ef9781c4642d37e969535371610294b8d40fdbf06a152bb51fa979ccbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T01:04:10.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:10 smithi148 bash[30873]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a 2024-09-21T01:04:10.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:10 smithi148 podman[30885]: 2024-09-21 01:04:10.443921305 +0000 UTC m=+0.491291582 container remove 352247ef9781c4642d37e969535371610294b8d40fdbf06a152bb51fa979ccbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:04:10.976 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:10 smithi148 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T01:04:10.976 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:10 smithi148 systemd[1]: Stopped Ceph mon.a for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:04:10.976 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:10 smithi148 systemd[1]: Starting Ceph mon.a for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:04:10.976 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:10 smithi148 podman[30981]: 2024-09-21 01:04:10.869694735 +0000 UTC m=+0.106364565 container create b56d7e839ccb10f4124276441e3dce7a5a40d01a6f210c82ad0a68f7a54c24a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:04:10.977 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:10 smithi148 podman[30981]: 2024-09-21 01:04:10.779054154 +0000 UTC m=+0.015723945 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:04:11.209 INFO:teuthology.orchestra.run.smithi148.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T01:04:11.413 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 podman[30981]: 2024-09-21 01:04:11.122022463 +0000 UTC m=+0.358692252 container init b56d7e839ccb10f4124276441e3dce7a5a40d01a6f210c82ad0a68f7a54c24a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:04:11.413 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 podman[30981]: 2024-09-21 01:04:11.125273659 +0000 UTC m=+0.361943433 container start b56d7e839ccb10f4124276441e3dce7a5a40d01a6f210c82ad0a68f7a54c24a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:04:11.413 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T01:04:11.413 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T01:04:11.413 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: pidfile_write: ignore empty --pid-file 2024-09-21T01:04:11.413 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: load: jerasure load: lrc 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: RocksDB version: 7.9.2 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Git sha 0 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: DB SUMMARY 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: DB Session ID: K6LZ3U0QL3YL7WJR2DZO 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: CURRENT file: CURRENT 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95220 ; 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.error_if_exists: 0 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.create_if_missing: 0 2024-09-21T01:04:11.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.paranoid_checks: 1 2024-09-21T01:04:11.415 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T01:04:11.415 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T01:04:11.415 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T01:04:11.415 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.env: 0x5585b6568d60 2024-09-21T01:04:11.415 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T01:04:11.415 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.info_log: 0x5585bbb85360 2024-09-21T01:04:11.415 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T01:04:11.416 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.statistics: (nil) 2024-09-21T01:04:11.416 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.use_fsync: 0 2024-09-21T01:04:11.416 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_log_file_size: 0 2024-09-21T01:04:11.416 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T01:04:11.416 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T01:04:11.416 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T01:04:11.416 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T01:04:11.416 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.allow_fallocate: 1 2024-09-21T01:04:11.416 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.use_direct_reads: 0 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.db_log_dir: 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.wal_dir: 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T01:04:11.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.write_buffer_manager: 0x5585bbb89d60 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.unordered_write: 0 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T01:04:11.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.row_cache: None 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.wal_filter: None 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.two_write_queues: 0 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.wal_compression: 0 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.atomic_flush: 0 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.log_readahead_size: 0 2024-09-21T01:04:11.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_background_jobs: 2 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_background_compactions: -1 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_subcompactions: 1 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T01:04:11.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_open_files: -1 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_background_flushes: -1 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Compression algorithms supported: 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: kZSTD supported: 0 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: kXpressCompression supported: 0 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: kBZip2Compression supported: 0 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: kLZ4Compression supported: 1 2024-09-21T01:04:11.421 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: kZlibCompression supported: 1 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: kSnappyCompression supported: 1 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.merge_operator: 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_filter: None 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T01:04:11.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5585bbb84fa0) 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: cache_index_and_filter_blocks: 1 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: pin_top_level_index_and_filter: 1 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: index_type: 0 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: data_block_index_type: 0 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: index_shortening: 1 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: checksum: 4 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: no_block_cache: 0 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_cache: 0x5585b7b49610 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_cache_name: BinnedLRUCache 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_cache_options: 2024-09-21T01:04:11.423 INFO:journalctl@ceph.mon.a.smithi148.stdout: capacity : 536870912 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: num_shard_bits : 4 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: strict_capacity_limit : 0 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: high_pri_pool_ratio: 0.000 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_cache_compressed: (nil) 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: persistent_cache: (nil) 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_size: 4096 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_size_deviation: 10 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_restart_interval: 16 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: index_block_restart_interval: 1 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: metadata_block_size: 4096 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: partition_filters: 0 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: use_delta_encoding: 1 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: filter_policy: bloomfilter 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: whole_key_filtering: 1 2024-09-21T01:04:11.424 INFO:journalctl@ceph.mon.a.smithi148.stdout: verify_compression: 0 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout: read_amp_bytes_per_bit: 0 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout: format_version: 5 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout: enable_index_compression: 1 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_align: 0 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout: max_auto_readahead_size: 262144 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout: prepopulate_block_cache: 0 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout: initial_auto_readahead_size: 8192 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compression: NoCompression 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T01:04:11.425 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.num_levels: 7 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:04:11.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T01:04:11.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T01:04:11.428 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.inplace_update_support: 0 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T01:04:11.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.bloom_locality: 0 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.max_successive_merges: 0 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.ttl: 2592000 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T01:04:11.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T01:04:11.431 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T01:04:11.431 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.enable_blob_files: false 2024-09-21T01:04:11.431 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.min_blob_size: 0 2024-09-21T01:04:11.431 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T01:04:11.431 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T01:04:11.431 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T01:04:11.431 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dc34dc08-09b0-4103-8a03-0b4547708820 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880651160942, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880651162027, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91363, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 89411, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11708, "raw_average_key_size": 47, "raw_value_size": 82819, "raw_average_value_size": 339, "num_data_blocks": 12, "num_entries": 244, "num_filter_entries": 244, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726880651, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dc34dc08-09b0-4103-8a03-0b4547708820", "db_session_id": "K6LZ3U0QL3YL7WJR2DZO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880651162122, "job": 1, "event": "recovery_finished"} 2024-09-21T01:04:11.432 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5585bbba8a80 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: DB pointer 0x5585bc94e000 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout: ** DB Stats ** 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:04:11.433 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: ** Compaction Stats [default] ** 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: L0 2/0 91.08 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: Sum 2/0 91.08 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: ** Compaction Stats [default] ** 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 140.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-21T01:04:11.434 INFO:journalctl@ceph.mon.a.smithi148.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: Cumulative compaction: 0.00 GB write, 25.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: Interval compaction: 0.00 GB write, 25.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: Block cache BinnedLRUCache@0x5585b7b49610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T01:04:11.435 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: starting mon.a rank 0 at public addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] at bind addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: mon.a@-1(???) e1 preinit fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: mon.a@-1(???).mds e1 new map 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: mon.a@-1(???).mds e1 print_map 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout: e1 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout: btime 2024-09-21T01:04:06:062011+0000 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout: legacy client fscid: -1 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout: No filesystems configured 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T01:04:11.436 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 bash[30981]: b56d7e839ccb10f4124276441e3dce7a5a40d01a6f210c82ad0a68f7a54c24a1 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 systemd[1]: Started Ceph mon.a for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: monmap epoch 1 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: last_changed 2024-09-21T01:04:03.032888+0000 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: created 2024-09-21T01:04:03.032888+0000 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: min_mon_release 19 (squid) 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: election_strategy: 1 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-21T01:04:11.437 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: fsmap 2024-09-21T01:04:11.438 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T01:04:11.438 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:11 smithi148 ceph-mon[31000]: mgrmap e1: no daemons active 2024-09-21T01:04:12.131 INFO:teuthology.orchestra.run.smithi148.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T01:04:12.153 INFO:teuthology.orchestra.run.smithi148.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:04:12.153 INFO:teuthology.orchestra.run.smithi148.stdout:Creating mgr... 2024-09-21T01:04:12.153 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T01:04:12.153 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T01:04:12.400 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.x 2024-09-21T01:04:12.400 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T01:04:12.544 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3872f802-77b5-11ef-baf5-efdc52797490.target.wants/ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-3872f802-77b5-11ef-baf5-efdc52797490@.service. 2024-09-21T01:04:12.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:12 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3389618396' entity='client.admin' 2024-09-21T01:04:12.864 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:12 smithi148 podman[31213]: 2024-09-21 01:04:12.780365004 +0000 UTC m=+0.122503122 container create 64a898c42ae5f2a2010d410b6600f6c09eabb551c3746403659e9f361ed38413 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:04:13.080 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:04:13.080 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-09-21T01:04:13.087 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:04:13.087 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-21T01:04:13.087 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-09-21T01:04:13.087 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T01:04:13.096 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:04:13.096 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-09-21T01:04:13.103 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:04:13.104 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-21T01:04:13.104 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-09-21T01:04:13.104 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T01:04:13.104 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr to start... 2024-09-21T01:04:13.104 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr... 2024-09-21T01:04:13.225 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:12 smithi148 podman[31213]: 2024-09-21 01:04:12.982442676 +0000 UTC m=+0.324580762 container init 64a898c42ae5f2a2010d410b6600f6c09eabb551c3746403659e9f361ed38413 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T01:04:13.225 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:12 smithi148 podman[31213]: 2024-09-21 01:04:12.985432042 +0000 UTC m=+0.327570119 container start 64a898c42ae5f2a2010d410b6600f6c09eabb551c3746403659e9f361ed38413 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:04:13.225 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:13 smithi148 bash[31213]: 64a898c42ae5f2a2010d410b6600f6c09eabb551c3746403659e9f361ed38413 2024-09-21T01:04:13.226 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:13 smithi148 systemd[1]: Started Ceph mgr.x for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:04:13.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:13 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4288220261' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T01:04:14.227 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:14.227 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:04:14.227 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsid": "3872f802-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 0 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T01:04:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:14.229 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T01:04:14.229 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T01:04:14.229 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:14.229 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T01:04:14.229 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:14.229 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T01:04:14.229 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T01:04:14.229 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T01:04:14.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T01:04:14.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T01:04:14.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T01:04:14.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:14.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T01:04:14.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T01:04:14.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T01:04:14.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T01:04:14.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T01:04:14.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T01:04:14.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T01:04:14.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T01:04:14.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T01:04:14.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:14.235 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T01:04:14.235 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:14.235 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T01:04:06:062011+0000", 2024-09-21T01:04:14.235 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T01:04:14.235 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T01:04:14.235 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:14.235 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T01:04:14.236 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T01:04:14.236 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T01:04:14.236 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T01:04:14.236 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T01:04:14.236 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T01:04:14.236 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T01:04:14.236 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:04:14.236 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:04:14.237 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:14.237 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T01:04:14.237 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:14.237 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T01:04:06.062798+0000", 2024-09-21T01:04:14.237 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:04:14.237 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:14.237 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T01:04:14.238 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:04:14.238 INFO:teuthology.orchestra.run.smithi148.stdout:mgr not available, waiting (1/15)... 2024-09-21T01:04:16.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:16 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3602204080' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T01:04:17.400 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:17.400 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsid": "3872f802-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 0 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T01:04:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T01:04:17.402 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T01:04:17.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:17.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T01:04:06:062011+0000", 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:04:17.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:04:17.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:17.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T01:04:17.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:17.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T01:04:06.062798+0000", 2024-09-21T01:04:17.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:04:17.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:17.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T01:04:17.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:04:17.408 INFO:teuthology.orchestra.run.smithi148.stdout:mgr not available, waiting (2/15)... 2024-09-21T01:04:18.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: Activating manager daemon x 2024-09-21T01:04:18.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: mgrmap e2: x(active, starting, since 0.00373648s) 2024-09-21T01:04:18.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: from='mgr.14100 172.21.15.148:0/1305729721' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:04:18.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: from='mgr.14100 172.21.15.148:0/1305729721' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:04:18.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: from='mgr.14100 172.21.15.148:0/1305729721' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:04:18.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: from='mgr.14100 172.21.15.148:0/1305729721' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:04:18.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: from='mgr.14100 172.21.15.148:0/1305729721' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:04:18.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: Manager daemon x is now available 2024-09-21T01:04:18.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: from='mgr.14100 172.21.15.148:0/1305729721' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:04:18.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: from='mgr.14100 172.21.15.148:0/1305729721' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:04:18.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: from='mgr.14100 172.21.15.148:0/1305729721' entity='mgr.x' 2024-09-21T01:04:18.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: from='mgr.14100 172.21.15.148:0/1305729721' entity='mgr.x' 2024-09-21T01:04:18.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:18 smithi148 ceph-mon[31000]: from='mgr.14100 172.21.15.148:0/1305729721' entity='mgr.x' 2024-09-21T01:04:20.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:20 smithi148 ceph-mon[31000]: mgrmap e3: x(active, since 1.00763s) 2024-09-21T01:04:20.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:20.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:04:20.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsid": "3872f802-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:04:20.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T01:04:20.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T01:04:20.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T01:04:20.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T01:04:20.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:20.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T01:04:20.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 0 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:20.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T01:04:20.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T01:04:20.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T01:04:20.695 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T01:04:20.695 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T01:04:20.696 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T01:04:20.696 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:20.696 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T01:04:20.696 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T01:04:20.696 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T01:04:20.696 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T01:04:20.696 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T01:04:20.696 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T01:04:06:062011+0000", 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T01:04:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T01:04:06.062798+0000", 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:04:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:mgr is available 2024-09-21T01:04:21.104 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:21 smithi148 ceph-mon[31000]: mgrmap e4: x(active, since 2s) 2024-09-21T01:04:21.104 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:21 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/693666903' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T01:04:22.047 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:22.047 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T01:04:22.047 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout fsid = 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:22.047 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T01:04:22.047 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.148:3300,v1:172.21.15.148:6789] 2024-09-21T01:04:22.047 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T01:04:22.048 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T01:04:22.048 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T01:04:22.048 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T01:04:22.048 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:22.048 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T01:04:22.048 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T01:04:22.048 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-21T01:04:22.048 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T01:04:22.048 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T01:04:22.048 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T01:04:22.049 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T01:04:22.049 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T01:04:22.049 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T01:04:22.049 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T01:04:22.049 INFO:teuthology.orchestra.run.smithi148.stdout:Enabling cephadm module... 2024-09-21T01:04:22.344 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:22 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/829118808' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T01:04:23.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:23 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3482617340' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T01:04:23.364 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:23 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: ignoring --setuser ceph since I am not root 2024-09-21T01:04:23.364 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:23 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: ignoring --setgroup ceph since I am not root 2024-09-21T01:04:24.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:24 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3482617340' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T01:04:24.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:24 smithi148 ceph-mon[31000]: mgrmap e5: x(active, since 5s) 2024-09-21T01:04:24.974 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:04:24.975 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T01:04:24.975 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T01:04:24.975 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T01:04:24.975 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T01:04:24.975 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:04:24.975 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for the mgr to restart... 2024-09-21T01:04:24.975 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr epoch 5... 2024-09-21T01:04:25.094 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:25 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3170208608' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T01:04:28.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:28 smithi148 ceph-mon[31000]: Active manager daemon x restarted 2024-09-21T01:04:28.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:28 smithi148 ceph-mon[31000]: Activating manager daemon x 2024-09-21T01:04:28.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:28 smithi148 ceph-mon[31000]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T01:04:28.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:28 smithi148 ceph-mon[31000]: mgrmap e6: x(active, starting, since 0.00372231s) 2024-09-21T01:04:28.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:28 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:04:28.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:28 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:04:28.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:28 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:04:28.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:28 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:04:28.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:28 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:04:28.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:28 smithi148 ceph-mon[31000]: Manager daemon x is now available 2024-09-21T01:04:29.712 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:04:29.713 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T01:04:29.713 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T01:04:29.713 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:04:29.713 INFO:teuthology.orchestra.run.smithi148.stdout:mgr epoch 5 is available 2024-09-21T01:04:29.714 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying orchestrator module is enabled... 2024-09-21T01:04:30.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-mon[31000]: mgrmap e7: x(active, since 1.00595s) 2024-09-21T01:04:30.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:30.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:30.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-mon[31000]: Found migration_current of "None". Setting to last migration. 2024-09-21T01:04:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:04:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:04:31.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:31 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1276200212' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T01:04:31.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:31 smithi148 ceph-mon[31000]: [21/Sep/2024:01:04:30] ENGINE Bus STARTING 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:31 smithi148 ceph-mon[31000]: [21/Sep/2024:01:04:30] ENGINE Serving on http://172.21.15.148:8765 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:31 smithi148 ceph-mon[31000]: [21/Sep/2024:01:04:30] ENGINE Serving on https://172.21.15.148:7150 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:31 smithi148 ceph-mon[31000]: [21/Sep/2024:01:04:30] ENGINE Bus STARTED 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:31 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:31 smithi148 ceph-mon[31000]: [21/Sep/2024:01:04:30] ENGINE Error in HTTPServer.serve 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout: Traceback (most recent call last): 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._connections.run(self.expiration_interval) 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._run(expiration_interval) 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:04:31.334 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout: s = self.context.wrap_socket( 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout: return self.sslsocket_class._create( 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout: self.do_handshake() 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._sslobj.do_handshake() 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:31 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1276200212' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:31 smithi148 ceph-mon[31000]: mgrmap e8: x(active, since 2s) 2024-09-21T01:04:31.335 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:04:30.920+0000 7f2c4b437640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:01:04:30] ENGINE Error in HTTPServer.serve 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: Traceback (most recent call last): 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: self._connections.run(self.expiration_interval) 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: self._run(expiration_interval) 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: s = self.context.wrap_socket( 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: return self.sslsocket_class._create( 2024-09-21T01:04:31.336 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:04:31.337 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: self.do_handshake() 2024-09-21T01:04:31.337 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:04:31.337 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: self._sslobj.do_handshake() 2024-09-21T01:04:31.337 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:04:31.337 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:04:31.622 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T01:04:31.622 INFO:teuthology.orchestra.run.smithi148.stdout:Setting orchestrator backend to cephadm... 2024-09-21T01:04:33.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:33 smithi148 ceph-mon[31000]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:33.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:33 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:33.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:33 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:34.051 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T01:04:34.052 INFO:teuthology.orchestra.run.smithi148.stdout:Generating ssh key... 2024-09-21T01:04:34.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-mon[31000]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:35.020 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: Generating public/private rsa key pair. 2024-09-21T01:04:35.020 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: Your identification has been saved in /tmp/tmpkg4wupvd/key 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: Your public key has been saved in /tmp/tmpkg4wupvd/key.pub 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: The key fingerprint is: 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: SHA256:1fXMJ1NGhwuA1bWyge73ZILp1GsEYHR4AdJXNdFjDHE ceph-3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: The key's randomart image is: 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: +---[RSA 3072]----+ 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: | .oo===.=XE=| 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: | .*.ooo.o%o| 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: | . +o +.=.*| 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: | o. +.o.| 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: | S ... | 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: | . +. | 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: | =.+ o | 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: | o ..* | 2024-09-21T01:04:35.021 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: | ... . | 2024-09-21T01:04:35.022 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: +----[SHA256]-----+ 2024-09-21T01:04:35.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:35 smithi148 ceph-mon[31000]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:35.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:35 smithi148 ceph-mon[31000]: Generating ssh key... 2024-09-21T01:04:35.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:35 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:35.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:35 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:36.463 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYON8TWY5WnutA2Bd1gbpSTrwIwLQ0v3z0AhXfKXS02Oq7AajUtTLrbR/c8bSQIaDMmUvoJtyVOjG/C/2moVNRkvKPubzcke9GWbJfp88sUgc6PZL77nxidGgZqthZ9xhYblSrxBMA0XA7olyHxvQMcPdpKmKGZkVwd9mvpddIpsLEIiTTbe+nD/QiFXBVRGHJs/eOzxYKWS1GAt5iWJPOf4UTb1lufhZcbvz8KVbGSNQvUDmxRHGY04evfttvlQblURogekfqx39swl6Gd5lJoEsyspWyZS0qrDhxJ+wXWCn7HQo9no7guo7vUJZEJ7nhqejNGvVLpw7tYyDf/yeDYcffwWefd8LQsmaTdwnvNsS1k8KDA1JPJNgpTY2x/lvzKE+7/eQV3kEtbOQsump533I9nI3ldPT5ngo6fL8WM1KsDmz25Pu1KUT2a7uUkiq9cqiacAoLRXD3BpOKjokeUnB/SA/92eizHmT6UkKNjbVun5C3A+C5WI3Y/6DWr/M= ceph-3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:36.463 INFO:teuthology.orchestra.run.smithi148.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:04:36.464 INFO:teuthology.orchestra.run.smithi148.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T01:04:36.466 INFO:teuthology.orchestra.run.smithi148.stdout:Adding host smithi148... 2024-09-21T01:04:36.965 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:36 smithi148 ceph-mon[31000]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:37.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:37 smithi148 ceph-mon[31000]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi148", "addr": "172.21.15.148", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:38.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:38 smithi148 ceph-mon[31000]: Deploying cephadm binary to smithi148 2024-09-21T01:04:41.064 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Added host 'smithi148' with addr '172.21.15.148' 2024-09-21T01:04:41.065 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying unmanaged mon service... 2024-09-21T01:04:41.355 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:41 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:41.355 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:41 smithi148 ceph-mon[31000]: Added host smithi148 2024-09-21T01:04:41.355 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:41 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:42.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:42 smithi148 ceph-mon[31000]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:42.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:42 smithi148 ceph-mon[31000]: Saving service mon spec with placement count:5 2024-09-21T01:04:42.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:42 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:43.252 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T01:04:43.252 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying unmanaged mgr service... 2024-09-21T01:04:44.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:43 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:44.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:43 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:44.626 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T01:04:45.193 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:44 smithi148 ceph-mon[31000]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:45.193 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:44 smithi148 ceph-mon[31000]: Saving service mgr spec with placement count:2 2024-09-21T01:04:45.193 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:44 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:46.232 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:45 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:46.232 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:45 smithi148 ceph-mon[31000]: from='mgr.14118 172.21.15.148:0/3615686211' entity='mgr.x' 2024-09-21T01:04:46.232 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:45 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/570135536' entity='client.admin' 2024-09-21T01:04:47.534 INFO:teuthology.orchestra.run.smithi148.stdout:Enabling the dashboard module... 2024-09-21T01:04:48.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:47 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3895820149' entity='client.admin' 2024-09-21T01:04:49.483 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:49 smithi148 ceph-mon[31000]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:04:49.484 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:49 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2666021333' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T01:04:49.484 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:49 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: ignoring --setuser ceph since I am not root 2024-09-21T01:04:49.484 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:49 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: ignoring --setgroup ceph since I am not root 2024-09-21T01:04:50.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:50 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2666021333' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T01:04:50.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:50 smithi148 ceph-mon[31000]: mgrmap e9: x(active, since 21s) 2024-09-21T01:04:51.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:04:51.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T01:04:51.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T01:04:51.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T01:04:51.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T01:04:51.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:04:51.185 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for the mgr to restart... 2024-09-21T01:04:51.185 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr epoch 9... 2024-09-21T01:04:51.305 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:51 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1528113654' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T01:04:54.597 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:54 smithi148 ceph-mon[31000]: Active manager daemon x restarted 2024-09-21T01:04:54.597 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:54 smithi148 ceph-mon[31000]: Activating manager daemon x 2024-09-21T01:04:54.597 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:54 smithi148 ceph-mon[31000]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T01:04:54.597 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:54 smithi148 ceph-mon[31000]: mgrmap e10: x(active, starting, since 0.00466012s) 2024-09-21T01:04:54.598 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:04:54.598 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:04:54.598 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:04:54.598 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:04:54.598 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:04:54.598 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:54 smithi148 ceph-mon[31000]: Manager daemon x is now available 2024-09-21T01:04:55.549 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:55.549 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:04:55.549 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:04:55.549 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-mon[31000]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T01:04:55.549 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-mon[31000]: mgrmap e11: x(active, since 1.00662s) 2024-09-21T01:04:55.549 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-mon[31000]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T01:04:55.864 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:04:55.547+0000 7fb850849640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:01:04:55] ENGINE Error in HTTPServer.serve 2024-09-21T01:04:55.864 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: Traceback (most recent call last): 2024-09-21T01:04:55.864 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:04:55.864 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: self._connections.run(self.expiration_interval) 2024-09-21T01:04:55.864 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:04:55.864 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: self._run(expiration_interval) 2024-09-21T01:04:55.864 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: s = self.context.wrap_socket( 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: return self.sslsocket_class._create( 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: self.do_handshake() 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: self._sslobj.do_handshake() 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:04:55.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:04:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:04:55.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:04:55.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T01:04:55.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T01:04:55.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:04:55.901 INFO:teuthology.orchestra.run.smithi148.stdout:mgr epoch 9 is available 2024-09-21T01:04:55.902 INFO:teuthology.orchestra.run.smithi148.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T01:04:56.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:56 smithi148 ceph-mon[31000]: [21/Sep/2024:01:04:55] ENGINE Bus STARTING 2024-09-21T01:04:56.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:56 smithi148 ceph-mon[31000]: [21/Sep/2024:01:04:55] ENGINE Serving on http://172.21.15.148:8765 2024-09-21T01:04:56.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:56 smithi148 ceph-mon[31000]: [21/Sep/2024:01:04:55] ENGINE Serving on https://172.21.15.148:7150 2024-09-21T01:04:56.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:56 smithi148 ceph-mon[31000]: [21/Sep/2024:01:04:55] ENGINE Bus STARTED 2024-09-21T01:04:56.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:56 smithi148 ceph-mon[31000]: [21/Sep/2024:01:04:55] ENGINE Error in HTTPServer.serve 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: Traceback (most recent call last): 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._connections.run(self.expiration_interval) 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._run(expiration_interval) 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: s = self.context.wrap_socket( 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: return self.sslsocket_class._create( 2024-09-21T01:04:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:04:56.615 INFO:journalctl@ceph.mon.a.smithi148.stdout: self.do_handshake() 2024-09-21T01:04:56.615 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:04:56.615 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._sslobj.do_handshake() 2024-09-21T01:04:56.615 INFO:journalctl@ceph.mon.a.smithi148.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:04:57.527 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:57 smithi148 ceph-mon[31000]: mgrmap e12: x(active, since 2s) 2024-09-21T01:04:57.527 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:57 smithi148 ceph-mon[31000]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:57.527 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:04:57.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE/DCCAuSgAwIBAgIUGWA0HszawqwOXNHm9+2+hvUdYV4wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAxMDQ1N1oXDTM0\nMDkyMjAxMDQ1N1owGDEWMBQGA1UEAwwNMTcyLjIxLjE1LjE0ODCCAiIwDQYJKoZI\nhvcNAQEBBQADggIPADCCAgoCggIBAL2ZQofl1toh3l1sraoM27wDQCmhpVcBDMq/\n4M0SJmZx+FlVzNikzcLGHTshKMe72JuVhnvoG5Zt+A0JJhLtCzydaUJKA4IsVRyK\nZgb21M+WVH5KrUgtrhgCPt6ZRQcJKaLSE8gitvNUnWAugmI/56LXbShjaGRaNFgs\nnSEDsZtiugWzn7qIFLw4PKAK6cHBjA9St20IKq+kRuks+U66PJfTJA0pttqoNbSS\nhVEj8FUkSkw0sMj9Yrp8rZH8AQgYPJvfgyB6nBST+gULnDEUk7lSVxgCm7Nph12v\nQbzadXJyRZBU5GbJeM4SeqPzQnsRGqBM9+qNEvVh/+tFMq/FZN551Qdw6KA2ZhMl\nL7kRmwHciAoBwXyPJa2fzi6nXNGY9s74D3RzoLWgm81wfu1q+yV3TirAMPGxKa13\n6weQ89idH3o4jaN282KHUm6s6c2yydfAtkPfgW1bJanL83258XsZCQG5kpcjaOcB\ni28TH/HlJU0/OKSPkQfZ3BIZ41AHY9yDhP04qmeGd4FafpF1BDwwu88zDgCEtn+A\nLxIBAfqWNBbVx0e9fkcZODG4W1NPfCmFGNsPT7qsGwwgQzv30fEJmBuMF1YAubyT\nmjPfKnWnHRDRefMx/g4nRxSY0g4WDjoSwdBW8BZXEt6UCujjxhg8lSi8oH8gOn70\nINC2g+FRAgMBAAGjPzA9MC0GA1UdEQQmMCSCCXNtaXRoaTE0OIIRZGFzaGJvYXJk\nX3NlcnZlcnOHBKwVD5QwDAYDVR0TAQH/BAIwADANBgkqhkiG9w0BAQsFAAOCAgEA\nRWgtPSsUHSW7rNkvvDeTtJnCEkMKtNGeRW8fW0TcD+LVSMiF3h8sNH2lH/Vf8wEk\nSs/zFQ5RXieGUIuDttMfXVxgr87mWWKSO3iKUJ3SM2ll/ZuD6dj38lKE08JmpM/B\nAD1bxwukdG7F6vrdVfh9LeVLUMgoMot2XUelIG2mDO/KSTHKWzit+at0yM+zJJrT\nU0b7UFQEjhIkx7RUDmnNBhymva0/WGvzXVUiczoHptlAXetPwrE3s+qROQyvxNYN\niuNrfwMgGk8d3Qr7nESrl1PegTkUb9RgPjFHE1E+yxoc7OaYXPAiw6755jTRT0w9\nOAI31ysSpmzFHi5hXuN7pv2xkY8nYaHusUYMrDJ56LplLuf0ElzT9EzwWw+gIyjs\nYOIk/J66AsR9/zBJLJo+kxb8rFdQ76/XC06OMfTzfl5B0KoNC3gCCDA94bwTcm6V\nhiFqyNl7cwd4OvU9T9ZbNrS0EBW7flQC0kYypeLKGE/r22SkfGx6sigBiieWKdcH\nlbhCWt84EEjAplk1w7uCz1nUL2qD24QvvWf1eFJscaf9boelFkgjn33ZDSVNPNc4\nJdNyISMUM5cvvyVbXZcndaNr4E0SydkZ3LC6L4JpjHm054hyiflnW9cb/w47MDOu\ntczfH520fY4wlcNB9OrwFE7BllnTqz6iPW0X7XNrQWY=\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAvZlCh+XW2iHeXWytqgzbvANAKaGlVwEMyr/gzRImZnH4WVXM\n2KTNwsYdOyEox7vYm5WGe+gblm34DQkmEu0LPJ1pQkoDgixVHIpmBvbUz5ZUfkqt\nSC2uGAI+3plFBwkpotITyCK281SdYC6CYj/notdtKGNoZFo0WCydIQOxm2K6BbOf\nuogUvDg8oArpwcGMD1K3bQgqr6RG6Sz5Tro8l9MkDSm22qg1tJKFUSPwVSRKTDSw\nyP1iunytkfwBCBg8m9+DIHqcFJP6BQucMRSTuVJXGAKbs2mHXa9BvNp1cnJFkFTk\nZsl4zhJ6o/NCexEaoEz36o0S9WH/60Uyr8Vk3nnVB3DooDZmEyUvuRGbAdyICgHB\nfI8lrZ/OLqdc0Zj2zvgPdHOgtaCbzXB+7Wr7JXdOKsAw8bEprXfrB5Dz2J0fejiN\no3bzYodSbqzpzbLJ18C2Q9+BbVslqcvzfbnxexkJAbmSlyNo5wGLbxMf8eUlTT84\npI+RB9ncEhnjUAdj3IOE/TiqZ4Z3gVp+kXUEPDC7zzMOAIS2f4AvEgEB+pY0FtXH\nR71+Rxk4MbhbU098KYUY2w9PuqwbDCBDO/fR8QmYG4wXVgC5vJOaM98qdacdENF5\n8zH+DidHFJjSDhYOOhLB0FbwFlcS3pQK6OPGGDyVKLygfyA6fvQg0LaD4VECAwEA\nAQKCAgACex460CINZwitayfzWAFa0qXQ+aSTyK+rukKpOkvidqqx1BCm89KdsikV\nIk4h3XJUWFq69bbBM1mN5Z0P/bYyPgrP308wEY+QTNsQi6OtnvVmdOiTL4ZV+fcL\nw4CKytbWsqYnvfUMBnMb/GXQPm7z83rSHslhmUjSr8xDT6SgAHTn0NG175SKYTfB\nXh0wj+1a0Lm12XfSBi23nMMbIa6b67tOuQlTj4SK4ykvjm9lVNEMUdrvmVm0sB+X\nD7+tdQA7h6tkBhizX/uTO/N4dLEJaXN6bOPPz2FiI2JCQ+9KHubMQIEf23JrS2R7\nj1oDCV5yYylyEjQhnf163RQghs4m4Y7j2GPlt2iyJBkEQbctIz5/KXyHV9uyMG7k\nz566wBtI/GXM8UWX1kFoDc2Wy5mWfejbPMUTEi2mE0aiIUNxVskc2UGruL5MafsR\nGGK/zlAvdXh7mQ0/y9RGqCaqr0XSpomlXs/6iJYvveBKEWN8wYln70V5lVYeE88n\njhrwGsTa89GYsDG1MHHSlbQgbtfrQdw5GJ22Lx19dVAbLCsRYGd0wodoIDHdseWV\nV9rzHH93LXGFjdqk8oCZ32BIgGKCc1vBm4W6A6iA0QRbLGcWFbU3kFJ0Dr2+S1GB\nyx4J2Fsof8PnvbWgDY7O/tAUkB8pCzKtojYuipz8YN/mHev44QKCAQEA9lIa+u84\n79DL8azIJyNdXx1+eFBajp2wnN0DR3sNaOIfEsXbwspKoEGeqInwxq3J5gUBd0nN\npmT4FLj7p/Fq2LttlOG/GJYoIgPhwX4L4XNuLl83s4r2ucS4e3JpoRHuF/AnNP7G\nqBN8kjta9xnEuz4t/J9gJ+cGZ7BwICvsbaorR6Lx8sgEIDEc/IShFTH2cTdDoRCz\n7hV9J++lBo3tz4Gs2/9fV7Fmcke0lMczY3U/JbSlvEgj/ViYI8BETgCmsHMTQtQr\naVoEEJnWni0cDhC5A0qZ+z5NmOFgr9fzc8MwfBMgH/rBUKY/FpUXDBdMWoi2nsrt\nHwO+Roje8iMhoQKCAQEAxQyNQtYNiOsM8HvgQpHOkVbyAlK3Rwa7w8yCVUp+ENZm\nN+3xQU+Vt2J3tPCJIfCHGKd38c9JurySoeDlTR9t53s86HmBLGl1Mg9yWMgl4Mng\nlCrPChICjp/9mCCOYMbyHSAewsoUQ4Tuh7Uk+o3/VWaxM8/Fm9OZsdXZPHTZgqOq\nk8OXxU8aa/ZEkRwF1uHIu+Kqs6YnTm2kRrpO/Qfqh39y165gHIQXEoKi4gDVXQzQ\nnXYoVqVcKomyZxMAt9N3bUn8BQZ7K5WJYHO9113QLARLjexd1r2m5wFZDE79BMQ+\nIeVotBQOsAGzEBrAhiOBgBrcwjAFaCOrIguywhgBsQKCAQBXjeG3NlcXrzD+63qN\npt1mlLZCj9VQgi6n40tqGgwvLsj6xEeUGpGiGxEJOVbTWCy+zSKzQxGNRrCDtSkG\njiJ7fUu7Mu7ZD26egKC7RVF1xrDwXLoQ4KFIcOtePdHcBeKKsbtN9A2q6ppJ5D02\nPfuWzshL1l64cD7vlmCUnuhAJs+RfBLiSERnKO3zuDUFsqe1oH4yfxxl0U+WZXFU\nPhi8vIwz+rbqFc2ja2d9xry2apOSlH6gyUe5oscZVhsxWrvlVlIPXBk+LlfpirUl\nrkUdnsYUrGzFSGUOpXXXqzwG9ueCAs5Vb61NPHqKTV5O1u019QhssxbMAmmc6sPM\nb75hAoIBAGMB0IRxivFtsN2wUFkCa/ko54Z1SzN71aImwqHaQQdywn99pce8FizD\nZARdC3orIaYolyK/lXsnPsHpfy1GCnHRwSPJ0TagcktJ6ZlkT2vn41hvPgIAVJqX\nFtN2IDPOIl6yAeK7qHzYcQVs5fyillWxuH2g+tg19LafDXzL9XInjBCcqUhxW4Q9\ng+wpWWHDppmI5V5IsN0+R9llyURn0tZsGib2rcIGOJWLYA4QfyQ2ySck9FW81ldl\nQmd569VxgkM+dkuMGx0mEJWO8ichMvS637+asPex6QeO7NA7a/QWKmXbn8VDgrG6\n2N7RokSD2JCmbp9/g2f07Aq6OAJAD7ECggEAI2sx2XCm5gDtfxbUjTyrQix8QnLm\nGxgwW8N0f1L0hxwVt+guVMYHebhV2rzPrd81OcBLO/XiS9mkxZJcmK+kILtPE2VY\nc0qo9aEn/NFHaeFdqDE/VccUtHp/7upNv3c3oWI6xr7O46iIeaLKnqre6v9GUxmv\nbM/iMEeun+Zy8943xo+Twqz5GtHpGPf8GAVct4yhnY1HfUdKP5hWGnj7/NwiB9d6\npBGnykd61XcjhqK1LJxY/99tJdeh+qmQU+5xZZYn9zahdDHhIUCeybAVzjMEwrun\nCvj7vl1UJt1iFH91bUcEG3rROqvEjbEt7HBb7iyKcK56UgojnQZeQZHmFg==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T01:04:59.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:04:59.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:04:59.428 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T01:04:59.828 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:04:59 smithi148 ceph-mon[31000]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:00.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T01:05:00.812 INFO:teuthology.orchestra.run.smithi148.stdout:Creating initial admin user... 2024-09-21T01:05:01.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:01 smithi148 ceph-mon[31000]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:01.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:01 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:02.243 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$N1wwH6ycVqig5x8dIJC3K.NA.bhCxF8dK3nprCZNj/ulFFRZxUV1O", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726880701, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T01:05:02.243 INFO:teuthology.orchestra.run.smithi148.stdout:Fetching dashboard port number... 2024-09-21T01:05:02.816 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:02 smithi148 ceph-mon[31000]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:02.816 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:03.374 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T01:05:03.384 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:05:03.384 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-09-21T01:05:03.392 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:05:03.392 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-21T01:05:03.392 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-09-21T01:05:03.392 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T01:05:03.394 INFO:teuthology.orchestra.run.smithi148.stdout:Ceph Dashboard is now available at: 2024-09-21T01:05:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: URL: https://smithi148.front.sepia.ceph.com:8443/ 2024-09-21T01:05:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: User: admin 2024-09-21T01:05:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: Password: q7nk441whd 2024-09-21T01:05:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:03.395 INFO:teuthology.orchestra.run.smithi148.stdout:Saving cluster configuration to /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config directory 2024-09-21T01:05:04.080 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:03 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4205674870' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T01:05:04.672 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T01:05:04.672 INFO:teuthology.orchestra.run.smithi148.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T01:05:04.672 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: ceph telemetry on 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout:For more information see: 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:04.673 INFO:teuthology.orchestra.run.smithi148.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T01:05:04.674 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:04.674 INFO:teuthology.orchestra.run.smithi148.stdout:Bootstrap complete. 2024-09-21T01:05:04.712 INFO:tasks.cephadm:Fetching config... 2024-09-21T01:05:04.713 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:05:04.713 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T01:05:04.731 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T01:05:04.731 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:05:04.731 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T01:05:04.786 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T01:05:04.786 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:05:04.787 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T01:05:04.852 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T01:05:04.852 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:05:04.852 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T01:05:04.907 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T01:05:04.907 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYON8TWY5WnutA2Bd1gbpSTrwIwLQ0v3z0AhXfKXS02Oq7AajUtTLrbR/c8bSQIaDMmUvoJtyVOjG/C/2moVNRkvKPubzcke9GWbJfp88sUgc6PZL77nxidGgZqthZ9xhYblSrxBMA0XA7olyHxvQMcPdpKmKGZkVwd9mvpddIpsLEIiTTbe+nD/QiFXBVRGHJs/eOzxYKWS1GAt5iWJPOf4UTb1lufhZcbvz8KVbGSNQvUDmxRHGY04evfttvlQblURogekfqx39swl6Gd5lJoEsyspWyZS0qrDhxJ+wXWCn7HQo9no7guo7vUJZEJ7nhqejNGvVLpw7tYyDf/yeDYcffwWefd8LQsmaTdwnvNsS1k8KDA1JPJNgpTY2x/lvzKE+7/eQV3kEtbOQsump533I9nI3ldPT5ngo6fL8WM1KsDmz25Pu1KUT2a7uUkiq9cqiacAoLRXD3BpOKjokeUnB/SA/92eizHmT6UkKNjbVun5C3A+C5WI3Y/6DWr/M= ceph-3872f802-77b5-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T01:05:04.999 INFO:teuthology.orchestra.run.smithi148.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYON8TWY5WnutA2Bd1gbpSTrwIwLQ0v3z0AhXfKXS02Oq7AajUtTLrbR/c8bSQIaDMmUvoJtyVOjG/C/2moVNRkvKPubzcke9GWbJfp88sUgc6PZL77nxidGgZqthZ9xhYblSrxBMA0XA7olyHxvQMcPdpKmKGZkVwd9mvpddIpsLEIiTTbe+nD/QiFXBVRGHJs/eOzxYKWS1GAt5iWJPOf4UTb1lufhZcbvz8KVbGSNQvUDmxRHGY04evfttvlQblURogekfqx39swl6Gd5lJoEsyspWyZS0qrDhxJ+wXWCn7HQo9no7guo7vUJZEJ7nhqejNGvVLpw7tYyDf/yeDYcffwWefd8LQsmaTdwnvNsS1k8KDA1JPJNgpTY2x/lvzKE+7/eQV3kEtbOQsump533I9nI3ldPT5ngo6fL8WM1KsDmz25Pu1KUT2a7uUkiq9cqiacAoLRXD3BpOKjokeUnB/SA/92eizHmT6UkKNjbVun5C3A+C5WI3Y/6DWr/M= ceph-3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:05.013 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYON8TWY5WnutA2Bd1gbpSTrwIwLQ0v3z0AhXfKXS02Oq7AajUtTLrbR/c8bSQIaDMmUvoJtyVOjG/C/2moVNRkvKPubzcke9GWbJfp88sUgc6PZL77nxidGgZqthZ9xhYblSrxBMA0XA7olyHxvQMcPdpKmKGZkVwd9mvpddIpsLEIiTTbe+nD/QiFXBVRGHJs/eOzxYKWS1GAt5iWJPOf4UTb1lufhZcbvz8KVbGSNQvUDmxRHGY04evfttvlQblURogekfqx39swl6Gd5lJoEsyspWyZS0qrDhxJ+wXWCn7HQo9no7guo7vUJZEJ7nhqejNGvVLpw7tYyDf/yeDYcffwWefd8LQsmaTdwnvNsS1k8KDA1JPJNgpTY2x/lvzKE+7/eQV3kEtbOQsump533I9nI3ldPT5ngo6fL8WM1KsDmz25Pu1KUT2a7uUkiq9cqiacAoLRXD3BpOKjokeUnB/SA/92eizHmT6UkKNjbVun5C3A+C5WI3Y/6DWr/M= ceph-3872f802-77b5-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T01:05:05.055 INFO:teuthology.orchestra.run.smithi157.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYON8TWY5WnutA2Bd1gbpSTrwIwLQ0v3z0AhXfKXS02Oq7AajUtTLrbR/c8bSQIaDMmUvoJtyVOjG/C/2moVNRkvKPubzcke9GWbJfp88sUgc6PZL77nxidGgZqthZ9xhYblSrxBMA0XA7olyHxvQMcPdpKmKGZkVwd9mvpddIpsLEIiTTbe+nD/QiFXBVRGHJs/eOzxYKWS1GAt5iWJPOf4UTb1lufhZcbvz8KVbGSNQvUDmxRHGY04evfttvlQblURogekfqx39swl6Gd5lJoEsyspWyZS0qrDhxJ+wXWCn7HQo9no7guo7vUJZEJ7nhqejNGvVLpw7tYyDf/yeDYcffwWefd8LQsmaTdwnvNsS1k8KDA1JPJNgpTY2x/lvzKE+7/eQV3kEtbOQsump533I9nI3ldPT5ngo6fL8WM1KsDmz25Pu1KUT2a7uUkiq9cqiacAoLRXD3BpOKjokeUnB/SA/92eizHmT6UkKNjbVun5C3A+C5WI3Y/6DWr/M= ceph-3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:05.067 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYON8TWY5WnutA2Bd1gbpSTrwIwLQ0v3z0AhXfKXS02Oq7AajUtTLrbR/c8bSQIaDMmUvoJtyVOjG/C/2moVNRkvKPubzcke9GWbJfp88sUgc6PZL77nxidGgZqthZ9xhYblSrxBMA0XA7olyHxvQMcPdpKmKGZkVwd9mvpddIpsLEIiTTbe+nD/QiFXBVRGHJs/eOzxYKWS1GAt5iWJPOf4UTb1lufhZcbvz8KVbGSNQvUDmxRHGY04evfttvlQblURogekfqx39swl6Gd5lJoEsyspWyZS0qrDhxJ+wXWCn7HQo9no7guo7vUJZEJ7nhqejNGvVLpw7tYyDf/yeDYcffwWefd8LQsmaTdwnvNsS1k8KDA1JPJNgpTY2x/lvzKE+7/eQV3kEtbOQsump533I9nI3ldPT5ngo6fL8WM1KsDmz25Pu1KUT2a7uUkiq9cqiacAoLRXD3BpOKjokeUnB/SA/92eizHmT6UkKNjbVun5C3A+C5WI3Y/6DWr/M= ceph-3872f802-77b5-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T01:05:05.108 INFO:teuthology.orchestra.run.smithi181.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYON8TWY5WnutA2Bd1gbpSTrwIwLQ0v3z0AhXfKXS02Oq7AajUtTLrbR/c8bSQIaDMmUvoJtyVOjG/C/2moVNRkvKPubzcke9GWbJfp88sUgc6PZL77nxidGgZqthZ9xhYblSrxBMA0XA7olyHxvQMcPdpKmKGZkVwd9mvpddIpsLEIiTTbe+nD/QiFXBVRGHJs/eOzxYKWS1GAt5iWJPOf4UTb1lufhZcbvz8KVbGSNQvUDmxRHGY04evfttvlQblURogekfqx39swl6Gd5lJoEsyspWyZS0qrDhxJ+wXWCn7HQo9no7guo7vUJZEJ7nhqejNGvVLpw7tYyDf/yeDYcffwWefd8LQsmaTdwnvNsS1k8KDA1JPJNgpTY2x/lvzKE+7/eQV3kEtbOQsump533I9nI3ldPT5ngo6fL8WM1KsDmz25Pu1KUT2a7uUkiq9cqiacAoLRXD3BpOKjokeUnB/SA/92eizHmT6UkKNjbVun5C3A+C5WI3Y/6DWr/M= ceph-3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:05.121 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T01:05:05.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:05 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3596779118' entity='client.admin' 2024-09-21T01:05:05.370 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:07.344 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:07 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3106218508' entity='client.admin' 2024-09-21T01:05:07.372 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T01:05:07.372 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T01:05:07.623 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:08.328 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:08 smithi148 ceph-mon[31000]: mgrmap e13: x(active, since 12s) 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"} : dispatch 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: Updating smithi148:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: Updating smithi148:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:05:09.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:09.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:09.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:09.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:09.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:09.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:09.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:09.443 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi157 2024-09-21T01:05:09.443 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T01:05:09.444 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.conf 2024-09-21T01:05:09.463 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T01:05:09.463 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:09.521 INFO:tasks.cephadm:Adding host smithi157 to orchestrator... 2024-09-21T01:05:09.522 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch host add smithi157 2024-09-21T01:05:09.760 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:11.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:11 smithi148 ceph-mon[31000]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:11.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:11 smithi148 ceph-mon[31000]: Deploying cephadm binary to smithi157 2024-09-21T01:05:13.430 INFO:teuthology.orchestra.run.smithi148.stdout:Added host 'smithi157' with addr '172.21.15.157' 2024-09-21T01:05:14.025 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T01:05:14.264 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:14.634 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:14.634 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:14 smithi148 ceph-mon[31000]: Added host smithi157 2024-09-21T01:05:14.634 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:14.634 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:14.634 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:14.634 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:14 smithi148 ceph-mon[31000]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:14.918 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:14.918 INFO:teuthology.orchestra.run.smithi148.stdout:[{"addr": "172.21.15.148", "hostname": "smithi148", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}] 2024-09-21T01:05:15.482 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi181 2024-09-21T01:05:15.483 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T01:05:15.483 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.conf 2024-09-21T01:05:15.503 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T01:05:15.503 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:15.561 INFO:tasks.cephadm:Adding host smithi181 to orchestrator... 2024-09-21T01:05:15.561 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch host add smithi181 2024-09-21T01:05:15.801 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:16.023 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:16.023 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:15 smithi148 ceph-mon[31000]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:05:17.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:16 smithi148 ceph-mon[31000]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:18.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:17 smithi148 ceph-mon[31000]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:18.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:17 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:18.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:17 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: Deploying cephadm binary to smithi181 2024-09-21T01:05:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"} : dispatch 2024-09-21T01:05:19.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:19.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:19.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: Updating smithi157:/etc/ceph/ceph.conf 2024-09-21T01:05:19.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: Updating smithi157:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:19.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:19.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: Updating smithi157:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:05:19.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:18 smithi148 ceph-mon[31000]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:19.550 INFO:teuthology.orchestra.run.smithi148.stdout:Added host 'smithi181' with addr '172.21.15.181' 2024-09-21T01:05:20.091 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T01:05:20.331 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:20.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:20.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:20.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:20.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:20.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:20.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:21.028 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:05:21.028 INFO:teuthology.orchestra.run.smithi148.stdout:[{"addr": "172.21.15.148", "hostname": "smithi148", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}, {"addr": "172.21.15.181", "hostname": "smithi181", "labels": [], "status": ""}] 2024-09-21T01:05:21.358 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:21 smithi148 ceph-mon[31000]: Added host smithi181 2024-09-21T01:05:21.358 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:21 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:21.358 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:21 smithi148 ceph-mon[31000]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:21.358 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:21 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:21.619 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T01:05:21.619 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T01:05:21.856 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:22.320 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:22 smithi148 ceph-mon[31000]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:05:23.079 INFO:teuthology.orchestra.run.smithi148.stderr:adjusted tunables profile to default 2024-09-21T01:05:23.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:23 smithi148 ceph-mon[31000]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:23.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:23 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3472802360' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T01:05:23.780 INFO:tasks.cephadm:Adding mon.a on smithi148 2024-09-21T01:05:23.780 INFO:tasks.cephadm:Adding mon.b on smithi157 2024-09-21T01:05:23.781 INFO:tasks.cephadm:Adding mon.c on smithi181 2024-09-21T01:05:23.781 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi148:172.21.15.148=a;smithi157:172.21.15.157=b;smithi181:172.21.15.181=c' 2024-09-21T01:05:24.027 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3472802360' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"} : dispatch 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:24.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:24.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:24.657 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mon update... 2024-09-21T01:05:25.212 DEBUG:teuthology.orchestra.run.smithi157:mon.b> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T01:05:25.215 DEBUG:teuthology.orchestra.run.smithi181:mon.c> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T01:05:25.217 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:05:25.217 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:05:25.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T01:05:25.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: Updating smithi181:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:25.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:25.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: Updating smithi181:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:05:25.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:25.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:25.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:25.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:25.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:25.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:25.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:25.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:26.205 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:26.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:26 smithi148 ceph-mon[31000]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi148:172.21.15.148=a;smithi157:172.21.15.157=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:26.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:26 smithi148 ceph-mon[31000]: Saving service mon spec with placement smithi148:172.21.15.148=a;smithi157:172.21.15.157=b;smithi181:172.21.15.181=c;count:3 2024-09-21T01:05:26.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:26 smithi148 ceph-mon[31000]: Deploying daemon mon.c on smithi181 2024-09-21T01:05:27.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:27 smithi148 ceph-mon[31000]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:05:27.866 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","modified":"2024-09-21T01:04:03.032888Z","created":"2024-09-21T01:04:03.032888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T01:05:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-09-21T01:05:28.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:28 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/1319311499' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:05:29.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: load: jerasure load: lrc 2024-09-21T01:05:29.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:29 smithi148 ceph-mon[31000]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:29.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: RocksDB version: 7.9.2 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Git sha 0 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: DB SUMMARY 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: DB Session ID: XVLFX1LD7VYTCT66VZRB 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: CURRENT file: CURRENT 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.error_if_exists: 0 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.create_if_missing: 0 2024-09-21T01:05:29.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.paranoid_checks: 1 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.env: 0x5601ce727d60 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.info_log: 0x5601d335f360 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.statistics: (nil) 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.use_fsync: 0 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_log_file_size: 0 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T01:05:29.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.allow_fallocate: 1 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.use_direct_reads: 0 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.db_log_dir: 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.wal_dir: 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T01:05:29.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T01:05:29.485 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T01:05:29.485 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T01:05:29.485 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T01:05:29.485 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T01:05:29.485 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.write_buffer_manager: 0x5601d3363d60 2024-09-21T01:05:29.485 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T01:05:29.485 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T01:05:29.485 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T01:05:29.485 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T01:05:29.485 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.unordered_write: 0 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.row_cache: None 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.wal_filter: None 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.two_write_queues: 0 2024-09-21T01:05:29.486 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.wal_compression: 0 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.atomic_flush: 0 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.log_readahead_size: 0 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T01:05:29.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_background_jobs: 2 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_background_compactions: -1 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_subcompactions: 1 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_open_files: -1 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T01:05:29.488 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_background_flushes: -1 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Compression algorithms supported: 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: kZSTD supported: 0 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: kXpressCompression supported: 0 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: kBZip2Compression supported: 0 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: kLZ4Compression supported: 1 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: kZlibCompression supported: 1 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: kSnappyCompression supported: 1 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T01:05:29.489 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.merge_operator: 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_filter: None 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5601d335efa0) 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout: cache_index_and_filter_blocks: 1 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout: pin_top_level_index_and_filter: 1 2024-09-21T01:05:29.490 INFO:journalctl@ceph.mon.c.smithi181.stdout: index_type: 0 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: data_block_index_type: 0 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: index_shortening: 1 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: checksum: 4 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: no_block_cache: 0 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache: 0x5601cf323610 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache_name: BinnedLRUCache 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache_options: 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: capacity : 536870912 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: num_shard_bits : 4 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: strict_capacity_limit : 0 2024-09-21T01:05:29.491 INFO:journalctl@ceph.mon.c.smithi181.stdout: high_pri_pool_ratio: 0.000 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache_compressed: (nil) 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: persistent_cache: (nil) 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_size: 4096 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_size_deviation: 10 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_restart_interval: 16 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: index_block_restart_interval: 1 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: metadata_block_size: 4096 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: partition_filters: 0 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: use_delta_encoding: 1 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: filter_policy: bloomfilter 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: whole_key_filtering: 1 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: verify_compression: 0 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: read_amp_bytes_per_bit: 0 2024-09-21T01:05:29.492 INFO:journalctl@ceph.mon.c.smithi181.stdout: format_version: 5 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout: enable_index_compression: 1 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_align: 0 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout: max_auto_readahead_size: 262144 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout: prepopulate_block_cache: 0 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout: initial_auto_readahead_size: 8192 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compression: NoCompression 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.num_levels: 7 2024-09-21T01:05:29.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T01:05:29.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T01:05:29.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T01:05:29.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.inplace_update_support: 0 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T01:05:29.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.bloom_locality: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.max_successive_merges: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.ttl: 2592000 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.enable_blob_files: false 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.min_blob_size: 0 2024-09-21T01:05:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 85c63a66-826b-4961-a46c-87ea70462236 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880729140437, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880729140851, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726880729, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "85c63a66-826b-4961-a46c-87ea70462236", "db_session_id": "XVLFX1LD7VYTCT66VZRB", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T01:05:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880729140944, "job": 1, "event": "recovery_finished"} 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5601d3382a80 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: DB pointer 0x5601d4128000 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** DB Stats ** 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:05:29.500 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** Compaction Stats [default] ** 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** Compaction Stats [default] ** 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T01:05:29.501 INFO:journalctl@ceph.mon.c.smithi181.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: Block cache BinnedLRUCache@0x5601cf323610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T01:05:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: using public_addr v2:172.21.15.181:0/0 -> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: starting mon.c rank -1 at public addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] at bind addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(???) e0 preinit fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout: e1 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout: btime 2024-09-21T01:04:06:062011+0000 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout: legacy client fscid: -1 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout: No filesystems configured 2024-09-21T01:05:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Deploying cephadm binary to smithi181 2024-09-21T01:05:29.504 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"} : dispatch 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Updating smithi157:/etc/ceph/ceph.conf 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Updating smithi157:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Updating smithi157:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:29.505 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Added host smithi181 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3472802360' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3472802360' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.506 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"} : dispatch 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Updating smithi181:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Updating smithi181:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:29.507 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi148:172.21.15.148=a;smithi157:172.21.15.157=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Saving service mon spec with placement smithi148:172.21.15.148=a;smithi157:172.21.15.157=b;smithi181:172.21.15.181=c;count:3 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: Deploying daemon mon.c on smithi181 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/1319311499' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 ceph-mon[34811]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 bash[34793]: b2348bede97b3a509455014b5235a2f0683d1254a02e74885224d1477987b312 2024-09-21T01:05:29.508 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:29 smithi181 systemd[1]: Started Ceph mon.c for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:05:29.701 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:05:29.702 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:05:29.970 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:05:34.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:05:34.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: mon.a calling monitor election 2024-09-21T01:05:34.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:34.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: mon.c calling monitor election 2024-09-21T01:05:34.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: monmap epoch 2 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: last_changed 2024-09-21T01:05:29.169506+0000 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: created 2024-09-21T01:04:03.032888+0000 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: min_mon_release 19 (squid) 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: election_strategy: 1 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T01:05:34.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: fsmap 2024-09-21T01:05:34.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:05:34.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: mgrmap e13: x(active, since 39s) 2024-09-21T01:05:34.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: overall HEALTH_OK 2024-09-21T01:05:34.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:34.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:34.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:34.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:34.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:34.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:05:34.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: mon.a calling monitor election 2024-09-21T01:05:34.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:34.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: mon.c calling monitor election 2024-09-21T01:05:34.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: monmap epoch 2 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: last_changed 2024-09-21T01:05:29.169506+0000 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: created 2024-09-21T01:04:03.032888+0000 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: min_mon_release 19 (squid) 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: election_strategy: 1 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: fsmap 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:05:34.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: mgrmap e13: x(active, since 39s) 2024-09-21T01:05:34.733 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: overall HEALTH_OK 2024-09-21T01:05:34.733 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:34.733 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:34.733 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:34.733 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:34.733 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:35.061 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:05:35.061 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","modified":"2024-09-21T01:05:29.169506Z","created":"2024-09-21T01:04:03.032888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T01:05:35.061 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-09-21T01:05:35.407 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:35 smithi181 ceph-mon[34811]: Deploying daemon mon.b on smithi157 2024-09-21T01:05:35.407 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:35 smithi181 ceph-mon[34811]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:35.407 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:35 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/616597584' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:05:35.407 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:35 smithi148 ceph-mon[31000]: Deploying daemon mon.b on smithi157 2024-09-21T01:05:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:35 smithi148 ceph-mon[31000]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:35 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/616597584' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:05:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:36.703 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:05:36.704 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:05:36.947 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:05:37.336 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:37 smithi181 ceph-mon[34811]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:37.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:37 smithi148 ceph-mon[31000]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:37.694 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:05:37.694 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","modified":"2024-09-21T01:05:29.169506Z","created":"2024-09-21T01:04:03.032888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T01:05:37.694 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-09-21T01:05:38.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:38 smithi157 systemd[1]: Started Ceph mon.b for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:05:39.248 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:05:39.248 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:05:39.498 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:05:43.409 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:05:43.409 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":3,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","modified":"2024-09-21T01:05:38.113135Z","created":"2024-09-21T01:04:03.032888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T01:05:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 3 2024-09-21T01:05:43.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: mon.a calling monitor election 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: mon.c calling monitor election 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: mon.b calling monitor election 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: monmap epoch 3 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: last_changed 2024-09-21T01:05:38.113135+0000 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: created 2024-09-21T01:04:03.032888+0000 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: min_mon_release 19 (squid) 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: election_strategy: 1 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: 2: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: fsmap 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: mgrmap e13: x(active, since 48s) 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: overall HEALTH_OK 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:43 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: mon.a calling monitor election 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: mon.c calling monitor election 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: mon.b calling monitor election 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: monmap epoch 3 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: last_changed 2024-09-21T01:05:38.113135+0000 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: created 2024-09-21T01:04:03.032888+0000 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: min_mon_release 19 (squid) 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: election_strategy: 1 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: 2: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: fsmap 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: mgrmap e13: x(active, since 48s) 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: overall HEALTH_OK 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.493 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.493 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:43 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:05:43.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: mon.a calling monitor election 2024-09-21T01:05:43.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:05:43.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: mon.c calling monitor election 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: mon.b calling monitor election 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: monmap epoch 3 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: last_changed 2024-09-21T01:05:38.113135+0000 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: created 2024-09-21T01:04:03.032888+0000 2024-09-21T01:05:43.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: min_mon_release 19 (squid) 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: election_strategy: 1 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: 2: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: fsmap 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: mgrmap e13: x(active, since 48s) 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: overall HEALTH_OK 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:43.616 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:43 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:44.052 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T01:05:44.053 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T01:05:44.315 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:44.339 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:44.339 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:44 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/4218509588' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:05:44.339 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:44.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:44.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:44 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/4218509588' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:05:44.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:44 smithi157 ceph-mon[34140]: from='client.? 172.21.15.181:0/4218509588' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:05:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:05:44.964 INFO:teuthology.orchestra.run.smithi148.stdout:# minimal ceph.conf for 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:44.964 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-09-21T01:05:44.964 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:44.965 INFO:teuthology.orchestra.run.smithi148.stdout: mon_host = [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-21T01:05:45.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4139310367' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:45.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:05:45.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/4139310367' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:45.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:05:45.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:45.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:45.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/4139310367' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:05:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:45.633 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T01:05:45.633 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:05:45.633 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T01:05:45.659 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:05:45.659 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:45.725 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T01:05:45.725 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T01:05:45.754 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T01:05:45.754 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:45.819 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T01:05:45.819 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T01:05:45.847 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T01:05:45.847 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:45.913 INFO:tasks.cephadm:Adding mgr.x on smithi148 2024-09-21T01:05:45.914 INFO:tasks.cephadm:Adding mgr.y on smithi157 2024-09-21T01:05:45.914 INFO:tasks.cephadm:Adding mgr.z on smithi181 2024-09-21T01:05:45.914 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi148=x;smithi157=y;smithi181=z' 2024-09-21T01:05:46.192 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:05:46.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:46 smithi148 ceph-mon[31000]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T01:05:46.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:46 smithi148 ceph-mon[31000]: Updating smithi157:/etc/ceph/ceph.conf 2024-09-21T01:05:46.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:46 smithi148 ceph-mon[31000]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T01:05:46.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:46 smithi148 ceph-mon[31000]: Updating smithi181:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:46.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:46 smithi148 ceph-mon[31000]: Updating smithi157:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:46.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:46 smithi148 ceph-mon[31000]: Updating smithi148:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:46.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:46 smithi148 ceph-mon[31000]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T01:05:46.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:46 smithi148 ceph-mon[31000]: Reconfiguring daemon mon.a on smithi148 2024-09-21T01:05:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:46 smithi181 ceph-mon[34811]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T01:05:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:46 smithi181 ceph-mon[34811]: Updating smithi157:/etc/ceph/ceph.conf 2024-09-21T01:05:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:46 smithi181 ceph-mon[34811]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T01:05:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:46 smithi181 ceph-mon[34811]: Updating smithi181:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:46 smithi181 ceph-mon[34811]: Updating smithi157:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:46 smithi181 ceph-mon[34811]: Updating smithi148:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:46 smithi181 ceph-mon[34811]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T01:05:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:46 smithi181 ceph-mon[34811]: Reconfiguring daemon mon.a on smithi148 2024-09-21T01:05:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:46 smithi157 ceph-mon[34140]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T01:05:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:46 smithi157 ceph-mon[34140]: Updating smithi157:/etc/ceph/ceph.conf 2024-09-21T01:05:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:46 smithi157 ceph-mon[34140]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T01:05:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:46 smithi157 ceph-mon[34140]: Updating smithi181:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:46 smithi157 ceph-mon[34140]: Updating smithi157:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:46 smithi157 ceph-mon[34140]: Updating smithi148:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:05:46.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:46 smithi157 ceph-mon[34140]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T01:05:46.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:46 smithi157 ceph-mon[34140]: Reconfiguring daemon mon.a on smithi148 2024-09-21T01:05:46.865 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mgr update... 2024-09-21T01:05:47.428 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:47 smithi157 ceph-mon[34140]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:47.428 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:47.429 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:47.429 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:47.429 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:05:47.429 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:47.429 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:47.451 DEBUG:teuthology.orchestra.run.smithi157:mgr.y> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T01:05:47.454 DEBUG:teuthology.orchestra.run.smithi181:mgr.z> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T01:05:47.456 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T01:05:47.456 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T01:05:47.459 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T01:05:47.459 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T01:05:47.483 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:47 smithi148 ceph-mon[31000]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:47.483 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:47.483 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:47.483 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:47.483 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:05:47.483 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:47.483 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:47.484 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T01:05:47.484 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T01:05:47.528 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T01:05:47.529 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T01:05:47.572 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T01:05:47.572 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T01:05:47.615 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T01:05:47.615 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T01:05:47.658 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T01:05:47.658 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T01:05:47.702 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T01:05:47.702 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T01:05:47.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:47 smithi181 ceph-mon[34811]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:47.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:47.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:47.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:47.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:05:47.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:47.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:47.745 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T01:05:47.745 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T01:05:47.756 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:47.758 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T01:05:47.758 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T01:05:47.802 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T01:05:47.803 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T01:05:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:47.826 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T01:05:47.827 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T01:05:47.870 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T01:05:47.870 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T01:05:47.916 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T01:05:47.916 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T01:05:47.961 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T01:05:47.961 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T01:05:48.006 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T01:05:48.006 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T01:05:48.058 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T01:05:48.059 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T01:05:48.157 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T01:05:48.157 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T01:05:48.200 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T01:05:48.200 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T01:05:48.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:48 smithi157 ceph-mon[34140]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:05:48.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:48 smithi157 ceph-mon[34140]: Reconfiguring daemon mon.b on smithi157 2024-09-21T01:05:48.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:48 smithi157 ceph-mon[34140]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi148=x;smithi157=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:48.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:48 smithi157 ceph-mon[34140]: Saving service mgr spec with placement smithi148=x;smithi157=y;smithi181=z;count:3 2024-09-21T01:05:48.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:48.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:48.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:48.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:05:48.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:48.243 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T01:05:48.243 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T01:05:48.287 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T01:05:48.287 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T01:05:48.330 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T01:05:48.330 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T01:05:48.360 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:48 smithi148 ceph-mon[31000]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:05:48.360 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:48 smithi148 ceph-mon[31000]: Reconfiguring daemon mon.b on smithi157 2024-09-21T01:05:48.360 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:48 smithi148 ceph-mon[31000]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi148=x;smithi157=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:48.360 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:48 smithi148 ceph-mon[31000]: Saving service mgr spec with placement smithi148=x;smithi157=y;smithi181=z;count:3 2024-09-21T01:05:48.360 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:48.360 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:48.360 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:48.360 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:05:48.360 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:48.361 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T01:05:48.361 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T01:05:48.413 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T01:05:48.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T01:05:48.470 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T01:05:48.470 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T01:05:48.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:48 smithi181 ceph-mon[34811]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:05:48.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:48 smithi181 ceph-mon[34811]: Reconfiguring daemon mon.b on smithi157 2024-09-21T01:05:48.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:48 smithi181 ceph-mon[34811]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi148=x;smithi157=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:48.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:48 smithi181 ceph-mon[34811]: Saving service mgr spec with placement smithi148=x;smithi157=y;smithi181=z;count:3 2024-09-21T01:05:48.493 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:48.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:48.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:05:48.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:05:48.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:48.519 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T01:05:48.519 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T01:05:48.577 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T01:05:48.577 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi148') 2024-09-21T01:05:49.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:49 smithi181 ceph-mon[34811]: Reconfiguring mon.c (monmap changed)... 2024-09-21T01:05:49.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:49 smithi181 ceph-mon[34811]: Reconfiguring daemon mon.c on smithi181 2024-09-21T01:05:49.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:49 smithi181 ceph-mon[34811]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:49.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:49 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2707444767' entity='client.admin' 2024-09-21T01:05:49.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:49 smithi157 ceph-mon[34140]: Reconfiguring mon.c (monmap changed)... 2024-09-21T01:05:49.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:49 smithi157 ceph-mon[34140]: Reconfiguring daemon mon.c on smithi181 2024-09-21T01:05:49.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:49 smithi157 ceph-mon[34140]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:49.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:49 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2707444767' entity='client.admin' 2024-09-21T01:05:49.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:49 smithi148 ceph-mon[31000]: Reconfiguring mon.c (monmap changed)... 2024-09-21T01:05:49.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:49 smithi148 ceph-mon[31000]: Reconfiguring daemon mon.c on smithi181 2024-09-21T01:05:49.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:49 smithi148 ceph-mon[31000]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:49.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:49 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2707444767' entity='client.admin' 2024-09-21T01:05:49.641 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi148') 2024-09-21T01:05:50.510 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2228123474' entity='client.admin' 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: Deploying daemon mgr.z on smithi181 2024-09-21T01:05:50.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:50 smithi148 ceph-mon[31000]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:50.536 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi148') 2024-09-21T01:05:50.558 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:50.634 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2228123474' entity='client.admin' 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:50.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: Deploying daemon mgr.z on smithi181 2024-09-21T01:05:50.637 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:50 smithi181 ceph-mon[34811]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:50.658 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:50.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2228123474' entity='client.admin' 2024-09-21T01:05:50.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:50.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:50.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:50.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:50.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:50.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:50.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:05:50.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:05:50.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:05:50.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:50.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: Deploying daemon mgr.z on smithi181 2024-09-21T01:05:50.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:50 smithi157 ceph-mon[34140]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:50.768 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.230 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:05:51 smithi181 systemd[1]: Starting Ceph mgr.z for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:05:51.582 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:05:51 smithi181 podman[36068]: 2024-09-21 01:05:51.201901023 +0000 UTC m=+0.015607472 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:05:51.582 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:05:51 smithi181 podman[36068]: 2024-09-21 01:05:51.312644824 +0000 UTC m=+0.126351257 container create afd1a6783ed9619db061c16b13286bd6f50829d4d4dde143da3c731d802efca4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-z, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T01:05:51.582 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:05:51 smithi181 podman[36068]: 2024-09-21 01:05:51.50664291 +0000 UTC m=+0.320349343 container init afd1a6783ed9619db061c16b13286bd6f50829d4d4dde143da3c731d802efca4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-z, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T01:05:51.582 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:05:51 smithi181 podman[36068]: 2024-09-21 01:05:51.510076266 +0000 UTC m=+0.323782702 container start afd1a6783ed9619db061c16b13286bd6f50829d4d4dde143da3c731d802efca4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:05:51.582 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:05:51 smithi181 ceph-mgr[36087]: -- 172.21.15.181:0/1320430472 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55558544b0e0 con 0x55558a1ee000 2024-09-21T01:05:51.582 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:05:51 smithi181 bash[36068]: afd1a6783ed9619db061c16b13286bd6f50829d4d4dde143da3c731d802efca4 2024-09-21T01:05:51.713 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.713 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.715 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.715 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.729 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.733 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.733 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.734 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.736 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.736 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.973 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.973 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:51.980 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:05:51 smithi181 systemd[1]: Started Ceph mgr.z for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:05:52.750 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:52.750 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:52.750 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:52.750 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:05:52.751 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:05:52.751 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:05:52.751 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:52.751 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: Deploying daemon mgr.y on smithi157 2024-09-21T01:05:52.751 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3557073345' entity='client.admin' 2024-09-21T01:05:52.751 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3283910121' entity='client.admin' 2024-09-21T01:05:52.751 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:52 smithi148 ceph-mon[31000]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: Deploying daemon mgr.y on smithi157 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3557073345' entity='client.admin' 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3283910121' entity='client.admin' 2024-09-21T01:05:52.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:52 smithi157 ceph-mon[34140]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.964+0000 7fa9df394640 1 -- 172.21.15.148:0/1933281593 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa9c403fb20 msgr2=0x7fa9c4042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.964+0000 7fa9df394640 1 --2- 172.21.15.148:0/1933281593 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa9c403fb20 0x7fa9c4042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80095f0 tx=0x7fa9c8005f90 comp rx=0 tx=0).stop 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.964+0000 7fa9df394640 1 -- 172.21.15.148:0/1933281593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d8103780 msgr2=0x7fa9d8199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.964+0000 7fa9df394640 1 --2- 172.21.15.148:0/1933281593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d8103780 0x7fa9d8199da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400d950 tx=0x7fa9d400de10 comp rx=0 tx=0).stop 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.964+0000 7fa9df394640 1 -- 172.21.15.148:0/1933281593 shutdown_connections 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.964+0000 7fa9df394640 1 --2- 172.21.15.148:0/1933281593 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa9c403fb20 0x7fa9c4042030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.964+0000 7fa9df394640 1 --2- 172.21.15.148:0/1933281593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d81051b0 0x7fa9d819afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.964+0000 7fa9df394640 1 --2- 172.21.15.148:0/1933281593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9d8104810 0x7fa9d819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.964+0000 7fa9df394640 1 --2- 172.21.15.148:0/1933281593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9d8103780 0x7fa9d8199da0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.964+0000 7fa9df394640 1 -- 172.21.15.148:0/1933281593 >> 172.21.15.148:0/1933281593 conn(0x7fa9d80ff0f0 msgr2=0x7fa9d8107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.965+0000 7fa9df394640 1 -- 172.21.15.148:0/1933281593 shutdown_connections 2024-09-21T01:05:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:52.965+0000 7fa9df394640 1 -- 172.21.15.148:0/1933281593 wait complete. 2024-09-21T01:05:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:05:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:05:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:05:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: Deploying daemon mgr.y on smithi157 2024-09-21T01:05:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3557073345' entity='client.admin' 2024-09-21T01:05:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3283910121' entity='client.admin' 2024-09-21T01:05:52.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:52 smithi181 ceph-mon[34811]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:53.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.051+0000 7f0b35ec3640 1 -- 172.21.15.148:0/1828476865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f0b300ffad0 con 0x7f0b3006b750 2024-09-21T01:05:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.055+0000 7f0b2cff9640 1 -- 172.21.15.148:0/1828476865 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f0b240055c0 con 0x7f0b3006b750 2024-09-21T01:05:53.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.057+0000 7f0b35ec3640 1 -- 172.21.15.148:0/1828476865 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0b1803fb20 msgr2=0x7f0b18042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.057+0000 7f0b35ec3640 1 --2- 172.21.15.148:0/1828476865 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0b1803fb20 0x7f0b18042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b2002a930 tx=0x7f0b20005fd0 comp rx=0 tx=0).stop 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.057+0000 7f0b35ec3640 1 -- 172.21.15.148:0/1828476865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3006b750 msgr2=0x7f0b3019c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.057+0000 7f0b35ec3640 1 --2- 172.21.15.148:0/1828476865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3006b750 0x7f0b3019c030 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400e9f0 tx=0x7f0b2400edf0 comp rx=0 tx=0).stop 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.057+0000 7f0b35ec3640 1 -- 172.21.15.148:0/1828476865 shutdown_connections 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.057+0000 7f0b35ec3640 1 --2- 172.21.15.148:0/1828476865 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0b1803fb20 0x7f0b18042030 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.057+0000 7f0b35ec3640 1 --2- 172.21.15.148:0/1828476865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b3010b690 0x7f0b3019d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.057+0000 7f0b35ec3640 1 --2- 172.21.15.148:0/1828476865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b30108d30 0x7f0b3019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.057+0000 7f0b35ec3640 1 --2- 172.21.15.148:0/1828476865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3006b750 0x7f0b3019c030 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.058+0000 7f0b35ec3640 1 -- 172.21.15.148:0/1828476865 >> 172.21.15.148:0/1828476865 conn(0x7f0b300fdfb0 msgr2=0x7f0b30109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.058+0000 7f0b35ec3640 1 -- 172.21.15.148:0/1828476865 shutdown_connections 2024-09-21T01:05:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:53.058+0000 7f0b35ec3640 1 -- 172.21.15.148:0/1828476865 wait complete. 2024-09-21T01:05:53.490 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:05:53 smithi157 systemd[1]: Starting Ceph mgr.y for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:05:53.732 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:53.733 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:53.733 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:53.733 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:53.733 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:53.907 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:05:53 smithi157 podman[34936]: 2024-09-21 01:05:53.612955935 +0000 UTC m=+0.101779122 container create 6f70a2281cf5ab3d9e624e9b3c85ba5bfe6944f568ce3da8c7b546a45987d1e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:05:53.907 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:05:53 smithi157 podman[34936]: 2024-09-21 01:05:53.526883948 +0000 UTC m=+0.015707104 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:05:53.907 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:05:53 smithi157 podman[34936]: 2024-09-21 01:05:53.823687892 +0000 UTC m=+0.312511037 container init 6f70a2281cf5ab3d9e624e9b3c85ba5bfe6944f568ce3da8c7b546a45987d1e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T01:05:53.907 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:05:53 smithi157 podman[34936]: 2024-09-21 01:05:53.826558845 +0000 UTC m=+0.315381992 container start 6f70a2281cf5ab3d9e624e9b3c85ba5bfe6944f568ce3da8c7b546a45987d1e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-y, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:05:53.907 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:05:53 smithi157 ceph-mgr[34956]: -- 172.21.15.157:0/714161235 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d6cba210e0 con 0x55d6d07c4480 2024-09-21T01:05:53.907 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:05:53 smithi157 bash[34936]: 6f70a2281cf5ab3d9e624e9b3c85ba5bfe6944f568ce3da8c7b546a45987d1e6 2024-09-21T01:05:54.011 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:53 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1933281593' entity='client.admin' 2024-09-21T01:05:54.011 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:53 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1828476865' entity='client.admin' 2024-09-21T01:05:54.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:53 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1933281593' entity='client.admin' 2024-09-21T01:05:54.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:53 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1828476865' entity='client.admin' 2024-09-21T01:05:54.241 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:05:53 smithi157 systemd[1]: Started Ceph mgr.y for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:05:54.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:53 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1933281593' entity='client.admin' 2024-09-21T01:05:54.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:53 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1828476865' entity='client.admin' 2024-09-21T01:05:54.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 -- 172.21.15.148:0/2725362296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a8104070 msgr2=0x7f97a810aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 --2- 172.21.15.148:0/2725362296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a8104070 0x7f97a810aa10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009900 tx=0x7f97a002a480 comp rx=0 tx=0).stop 2024-09-21T01:05:54.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 -- 172.21.15.148:0/2725362296 shutdown_connections 2024-09-21T01:05:54.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 --2- 172.21.15.148:0/2725362296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a8104070 0x7f97a810aa10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 --2- 172.21.15.148:0/2725362296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97a81036d0 0x7f97a8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 --2- 172.21.15.148:0/2725362296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97a8102640 0x7f97a8102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 -- 172.21.15.148:0/2725362296 >> 172.21.15.148:0/2725362296 conn(0x7f97a80fdfb0 msgr2=0x7f97a8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:54.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 -- 172.21.15.148:0/2725362296 shutdown_connections 2024-09-21T01:05:54.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 -- 172.21.15.148:0/2725362296 wait complete. 2024-09-21T01:05:54.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 Processor -- start 2024-09-21T01:05:54.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.454+0000 7f97af905640 1 -- start start 2024-09-21T01:05:54.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97af905640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97a8102640 0x7f97a806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97af905640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97a81036d0 0x7f97a819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97af905640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a8104070 0x7f97a81a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97af905640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f97a810e150 con 0x7f97a8104070 2024-09-21T01:05:54.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97af905640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f97a810dfd0 con 0x7f97a81036d0 2024-09-21T01:05:54.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97af905640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f97a810e2d0 con 0x7f97a8102640 2024-09-21T01:05:54.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97ad6a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97a8102640 0x7f97a806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97adea2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a8104070 0x7f97a81a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97ad6a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97a8102640 0x7f97a806b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:50788/0 (socket says 172.21.15.148:50788) 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97ad6a1640 1 -- 172.21.15.148:0/127848801 learned_addr learned my addr 172.21.15.148:0/127848801 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97acea0640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97a81036d0 0x7f97a819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97ad6a1640 1 -- 172.21.15.148:0/127848801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97a81036d0 msgr2=0x7f97a819ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97ad6a1640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97a81036d0 0x7f97a819ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97ad6a1640 1 -- 172.21.15.148:0/127848801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a8104070 msgr2=0x7f97a81a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97ad6a1640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a8104070 0x7f97a81a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97ad6a1640 1 -- 172.21.15.148:0/127848801 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a81a1960 con 0x7f97a8102640 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97adea2640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a8104070 0x7f97a81a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97acea0640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97a81036d0 0x7f97a819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.455+0000 7f97ad6a1640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97a8102640 0x7f97a806b6a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f979800ebc0 tx=0x7f979800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.456+0000 7f97a67fc640 1 -- 172.21.15.148:0/127848801 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798010630 con 0x7f97a8102640 2024-09-21T01:05:54.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.456+0000 7f97af905640 1 -- 172.21.15.148:0/127848801 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a81a1c50 con 0x7f97a8102640 2024-09-21T01:05:54.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.456+0000 7f97a67fc640 1 -- 172.21.15.148:0/127848801 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9798010c60 con 0x7f97a8102640 2024-09-21T01:05:54.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.456+0000 7f97a67fc640 1 -- 172.21.15.148:0/127848801 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798018b10 con 0x7f97a8102640 2024-09-21T01:05:54.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.456+0000 7f97af905640 1 -- 172.21.15.148:0/127848801 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a81a2190 con 0x7f97a8102640 2024-09-21T01:05:54.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.457+0000 7f97a67fc640 1 -- 172.21.15.148:0/127848801 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 13) ==== 51899+0+0 (secure 0 0 0) 0x7f9798018cb0 con 0x7f97a8102640 2024-09-21T01:05:54.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.457+0000 7f97af905640 1 -- 172.21.15.148:0/127848801 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a8102ab0 con 0x7f97a8102640 2024-09-21T01:05:54.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.457+0000 7f97a67fc640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f979003fb20 0x7f9790042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.457+0000 7f97a67fc640 1 -- 172.21.15.148:0/127848801 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9798054c60 con 0x7f97a8102640 2024-09-21T01:05:54.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.457+0000 7f97acea0640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f979003fb20 0x7f9790042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.457+0000 7f97acea0640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f979003fb20 0x7f9790042030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f979c009fc0 tx=0x7f979c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:54.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.462+0000 7f97a67fc640 1 -- 172.21.15.148:0/127848801 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9798022d00 con 0x7f97a8102640 2024-09-21T01:05:54.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.645+0000 7f97af905640 1 -- 172.21.15.148:0/127848801 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f97a8063fc0 con 0x7f97a8102640 2024-09-21T01:05:54.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.655+0000 7f97a67fc640 1 -- 172.21.15.148:0/127848801 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f979801fd20 con 0x7f97a8102640 2024-09-21T01:05:54.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 -- 172.21.15.148:0/127848801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f979003fb20 msgr2=0x7f9790042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f979003fb20 0x7f9790042030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f979c009fc0 tx=0x7f979c005f90 comp rx=0 tx=0).stop 2024-09-21T01:05:54.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 -- 172.21.15.148:0/127848801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97a8102640 msgr2=0x7f97a806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97a8102640 0x7f97a806b6a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f979800ebc0 tx=0x7f979800c6a0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 -- 172.21.15.148:0/127848801 shutdown_connections 2024-09-21T01:05:54.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f979003fb20 0x7f9790042030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97a8104070 0x7f97a81a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97a81036d0 0x7f97a819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 --2- 172.21.15.148:0/127848801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97a8102640 0x7f97a806b6a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 -- 172.21.15.148:0/127848801 >> 172.21.15.148:0/127848801 conn(0x7f97a80fdfb0 msgr2=0x7f97a81069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:54.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 -- 172.21.15.148:0/127848801 shutdown_connections 2024-09-21T01:05:54.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:54.658+0000 7f97af905640 1 -- 172.21.15.148:0/127848801 wait complete. 2024-09-21T01:05:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:54 smithi181 ceph-mon[34811]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:54 smithi181 ceph-mon[34811]: from='client.? ' entity='client.admin' 2024-09-21T01:05:55.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.242 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.242 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.242 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:55.242 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:54 smithi157 ceph-mon[34140]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:55.242 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.242 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:54 smithi157 ceph-mon[34140]: from='client.? ' entity='client.admin' 2024-09-21T01:05:55.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:55.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:54 smithi148 ceph-mon[31000]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:55.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:55.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:54 smithi148 ceph-mon[31000]: from='client.? ' entity='client.admin' 2024-09-21T01:05:55.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.446+0000 7f78d057f640 1 -- 172.21.15.148:0/3494826380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78c81051b0 msgr2=0x7f78c810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:55.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.446+0000 7f78d057f640 1 --2- 172.21.15.148:0/3494826380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78c81051b0 0x7f78c810bb50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009ca0 tx=0x7f78c002a950 comp rx=0 tx=0).stop 2024-09-21T01:05:55.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.447+0000 7f78d057f640 1 -- 172.21.15.148:0/3494826380 shutdown_connections 2024-09-21T01:05:55.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.447+0000 7f78d057f640 1 --2- 172.21.15.148:0/3494826380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78c81051b0 0x7f78c810bb50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:55.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.447+0000 7f78d057f640 1 --2- 172.21.15.148:0/3494826380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c8104810 0x7f78c8104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:55.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.447+0000 7f78d057f640 1 --2- 172.21.15.148:0/3494826380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78c8103780 0x7f78c8103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:55.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.447+0000 7f78d057f640 1 -- 172.21.15.148:0/3494826380 >> 172.21.15.148:0/3494826380 conn(0x7f78c80ff0f0 msgr2=0x7f78c81015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:55.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.447+0000 7f78d057f640 1 -- 172.21.15.148:0/3494826380 shutdown_connections 2024-09-21T01:05:55.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.447+0000 7f78d057f640 1 -- 172.21.15.148:0/3494826380 wait complete. 2024-09-21T01:05:55.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.447+0000 7f78d057f640 1 Processor -- start 2024-09-21T01:05:55.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.447+0000 7f78d057f640 1 -- start start 2024-09-21T01:05:55.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78d057f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78c8103780 0x7f78c8199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:55.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78d057f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78c8104810 0x7f78c819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:55.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78d057f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c81051b0 0x7f78c819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:55.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78d057f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f78c810f290 con 0x7f78c8104810 2024-09-21T01:05:55.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78d057f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f78c810f110 con 0x7f78c8103780 2024-09-21T01:05:55.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78d057f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f78c810f410 con 0x7f78c81051b0 2024-09-21T01:05:55.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78cdb1a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78c8104810 0x7f78c819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:55.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78ce31b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78c8103780 0x7f78c8199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:55.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78cdb1a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78c8104810 0x7f78c819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44962/0 (socket says 172.21.15.148:44962) 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78cdb1a640 1 -- 172.21.15.148:0/782523690 learned_addr learned my addr 172.21.15.148:0/782523690 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78ceb1c640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c81051b0 0x7f78c819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78cdb1a640 1 -- 172.21.15.148:0/782523690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c81051b0 msgr2=0x7f78c819b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78cdb1a640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c81051b0 0x7f78c819b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78cdb1a640 1 -- 172.21.15.148:0/782523690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78c8103780 msgr2=0x7f78c8199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78cdb1a640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78c8103780 0x7f78c8199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78cdb1a640 1 -- 172.21.15.148:0/782523690 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c819b8c0 con 0x7f78c8104810 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78ce31b640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78c8103780 0x7f78c8199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78cdb1a640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78c8104810 0x7f78c819a500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f78b800e9f0 tx=0x7f78b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78bf7fe640 1 -- 172.21.15.148:0/782523690 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b800cd80 con 0x7f78c8104810 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78bf7fe640 1 -- 172.21.15.148:0/782523690 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f78b80054b0 con 0x7f78c8104810 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.448+0000 7f78d057f640 1 -- 172.21.15.148:0/782523690 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c819bbb0 con 0x7f78c8104810 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.449+0000 7f78bf7fe640 1 -- 172.21.15.148:0/782523690 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8010430 con 0x7f78c8104810 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.449+0000 7f78d057f640 1 -- 172.21.15.148:0/782523690 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c81a22b0 con 0x7f78c8104810 2024-09-21T01:05:55.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.449+0000 7f78bf7fe640 1 -- 172.21.15.148:0/782523690 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 51899+0+0 (secure 0 0 0) 0x7f78b80106f0 con 0x7f78c8104810 2024-09-21T01:05:55.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.449+0000 7f78d057f640 1 -- 172.21.15.148:0/782523690 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c8103bf0 con 0x7f78c8104810 2024-09-21T01:05:55.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.450+0000 7f78bf7fe640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78b403fb20 0x7f78b4042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:55.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.450+0000 7f78bf7fe640 1 -- 172.21.15.148:0/782523690 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f78b80548b0 con 0x7f78c8104810 2024-09-21T01:05:55.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.450+0000 7f78ce31b640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78b403fb20 0x7f78b4042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:55.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.450+0000 7f78ce31b640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78b403fb20 0x7f78b4042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009fc0 tx=0x7f78c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:55.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.455+0000 7f78bf7fe640 1 -- 172.21.15.148:0/782523690 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78b8016330 con 0x7f78c8104810 2024-09-21T01:05:55.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.658+0000 7f78d057f640 1 -- 172.21.15.148:0/782523690 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f78c802e9d0 con 0x7f78c8104810 2024-09-21T01:05:55.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.662+0000 7f78bf7fe640 1 -- 172.21.15.148:0/782523690 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v17)=0 v17) ==== 116+0+0 (secure 0 0 0) 0x7f78b8019d70 con 0x7f78c8104810 2024-09-21T01:05:55.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 -- 172.21.15.148:0/782523690 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78b403fb20 msgr2=0x7f78b4042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:55.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78b403fb20 0x7f78b4042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009fc0 tx=0x7f78c4005f90 comp rx=0 tx=0).stop 2024-09-21T01:05:55.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 -- 172.21.15.148:0/782523690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78c8104810 msgr2=0x7f78c819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:55.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78c8104810 0x7f78c819a500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f78b800e9f0 tx=0x7f78b800edf0 comp rx=0 tx=0).stop 2024-09-21T01:05:55.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 -- 172.21.15.148:0/782523690 shutdown_connections 2024-09-21T01:05:55.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78b403fb20 0x7f78b4042030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:55.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78c8104810 0x7f78c819a500 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:55.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78c81051b0 0x7f78c819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:55.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 --2- 172.21.15.148:0/782523690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78c8103780 0x7f78c8199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:55.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 -- 172.21.15.148:0/782523690 >> 172.21.15.148:0/782523690 conn(0x7f78c80ff0f0 msgr2=0x7f78c8107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:55.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 -- 172.21.15.148:0/782523690 shutdown_connections 2024-09-21T01:05:55.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:55.664+0000 7f78d057f640 1 -- 172.21.15.148:0/782523690 wait complete. 2024-09-21T01:05:56.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: Reconfiguring daemon mgr.x on smithi148 2024-09-21T01:05:56.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:56 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/782523690' entity='client.admin' 2024-09-21T01:05:56.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:56.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:56.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T01:05:56.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:05:56.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:05:56.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:56.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: Reconfiguring daemon mgr.x on smithi148 2024-09-21T01:05:56.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:56 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/782523690' entity='client.admin' 2024-09-21T01:05:56.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: Reconfiguring daemon mgr.x on smithi148 2024-09-21T01:05:56.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:56 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/782523690' entity='client.admin' 2024-09-21T01:05:57.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:57 smithi148 ceph-mon[31000]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:57.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:57 smithi148 ceph-mon[31000]: Standby manager daemon z started 2024-09-21T01:05:57.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:57 smithi148 ceph-mon[31000]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T01:05:57.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:57 smithi148 ceph-mon[31000]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:05:57.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:57 smithi148 ceph-mon[31000]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T01:05:57.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:57 smithi148 ceph-mon[31000]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:05:57.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:57 smithi181 ceph-mon[34811]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:57.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:57 smithi181 ceph-mon[34811]: Standby manager daemon z started 2024-09-21T01:05:57.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:57 smithi181 ceph-mon[34811]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T01:05:57.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:57 smithi181 ceph-mon[34811]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:05:57.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:57 smithi181 ceph-mon[34811]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T01:05:57.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:57 smithi181 ceph-mon[34811]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:05:57.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:57 smithi157 ceph-mon[34140]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:57.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:57 smithi157 ceph-mon[34140]: Standby manager daemon z started 2024-09-21T01:05:57.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:57 smithi157 ceph-mon[34140]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T01:05:57.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:57 smithi157 ceph-mon[34140]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:05:57.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:57 smithi157 ceph-mon[34140]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T01:05:57.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:57 smithi157 ceph-mon[34140]: from='mgr.? 172.21.15.181:0/1501227522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:05:57.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.549+0000 7f1061c3b640 1 -- 172.21.15.148:0/1771092134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f105c1094e0 msgr2=0x7f105c10b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.549+0000 7f1061c3b640 1 --2- 172.21.15.148:0/1771092134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f105c1094e0 0x7f105c10b9d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1054009ca0 tx=0x7f105402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.549+0000 7f1061c3b640 1 -- 172.21.15.148:0/1771092134 shutdown_connections 2024-09-21T01:05:57.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.549+0000 7f1061c3b640 1 --2- 172.21.15.148:0/1771092134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f105c1094e0 0x7f105c10b9d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.549+0000 7f1061c3b640 1 --2- 172.21.15.148:0/1771092134 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f105c1069a0 0x7f105c108dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.549+0000 7f1061c3b640 1 --2- 172.21.15.148:0/1771092134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c06c2c0 0x7f105c106460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.549+0000 7f1061c3b640 1 -- 172.21.15.148:0/1771092134 >> 172.21.15.148:0/1771092134 conn(0x7f105c0fe000 msgr2=0x7f105c1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.549+0000 7f1061c3b640 1 -- 172.21.15.148:0/1771092134 shutdown_connections 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.549+0000 7f1061c3b640 1 -- 172.21.15.148:0/1771092134 wait complete. 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1061c3b640 1 Processor -- start 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1061c3b640 1 -- start start 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1061c3b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f105c06c2c0 0x7f105c199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1061c3b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f105c1069a0 0x7f105c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1061c3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c1094e0 0x7f105c19b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1061c3b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f105c10f290 con 0x7f105c1069a0 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1061c3b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f105c10f110 con 0x7f105c06c2c0 2024-09-21T01:05:57.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1061c3b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f105c10f410 con 0x7f105c1094e0 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1053fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f105c1069a0 0x7f105c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1053fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f105c1069a0 0x7f105c19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39374/0 (socket says 172.21.15.148:39374) 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f1053fff640 1 -- 172.21.15.148:0/2178680216 learned_addr learned my addr 172.21.15.148:0/2178680216 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f105b7fe640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f105c06c2c0 0x7f105c199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.550+0000 7f105bfff640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c1094e0 0x7f105c19b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f1053fff640 1 -- 172.21.15.148:0/2178680216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c1094e0 msgr2=0x7f105c19b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f1053fff640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c1094e0 0x7f105c19b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f1053fff640 1 -- 172.21.15.148:0/2178680216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f105c06c2c0 msgr2=0x7f105c199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f1053fff640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f105c06c2c0 0x7f105c199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f1053fff640 1 -- 172.21.15.148:0/2178680216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105c19b8e0 con 0x7f105c1069a0 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f105bfff640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c1094e0 0x7f105c19b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f1053fff640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f105c1069a0 0x7f105c19a520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f104400e9f0 tx=0x7f104400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f10597fa640 1 -- 172.21.15.148:0/2178680216 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104400cd80 con 0x7f105c1069a0 2024-09-21T01:05:57.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f10597fa640 1 -- 172.21.15.148:0/2178680216 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f10440108c0 con 0x7f105c1069a0 2024-09-21T01:05:57.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f1061c3b640 1 -- 172.21.15.148:0/2178680216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105c19bbd0 con 0x7f105c1069a0 2024-09-21T01:05:57.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f10597fa640 1 -- 172.21.15.148:0/2178680216 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10440187d0 con 0x7f105c1069a0 2024-09-21T01:05:57.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.551+0000 7f1061c3b640 1 -- 172.21.15.148:0/2178680216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f105c1a22d0 con 0x7f105c1069a0 2024-09-21T01:05:57.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.552+0000 7f1061c3b640 1 -- 172.21.15.148:0/2178680216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f105c106db0 con 0x7f105c1069a0 2024-09-21T01:05:57.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.553+0000 7f10597fa640 1 -- 172.21.15.148:0/2178680216 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) ==== 103178+0+0 (secure 0 0 0) 0x7f1044010430 con 0x7f105c1069a0 2024-09-21T01:05:57.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.553+0000 7f10597fa640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f104807afd0 0x7f104807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.553+0000 7f10597fa640 1 -- 172.21.15.148:0/2178680216 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f104409d130 con 0x7f105c1069a0 2024-09-21T01:05:57.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.553+0000 7f105b7fe640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f104807afd0 0x7f104807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.554+0000 7f105b7fe640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f104807afd0 0x7f104807d4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f104c005fd0 tx=0x7f104c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:57.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.558+0000 7f10597fa640 1 -- 172.21.15.148:0/2178680216 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1044069c50 con 0x7f105c1069a0 2024-09-21T01:05:57.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.745+0000 7f1061c3b640 1 -- 172.21.15.148:0/2178680216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f105c02e9d0 con 0x7f105c1069a0 2024-09-21T01:05:57.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.753+0000 7f10597fa640 1 -- 172.21.15.148:0/2178680216 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f104406eb00 con 0x7f105c1069a0 2024-09-21T01:05:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 -- 172.21.15.148:0/2178680216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f104807afd0 msgr2=0x7f104807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f104807afd0 0x7f104807d4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f104c005fd0 tx=0x7f104c00b390 comp rx=0 tx=0).stop 2024-09-21T01:05:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 -- 172.21.15.148:0/2178680216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f105c1069a0 msgr2=0x7f105c19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f105c1069a0 0x7f105c19a520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f104400e9f0 tx=0x7f104400eeb0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 -- 172.21.15.148:0/2178680216 shutdown_connections 2024-09-21T01:05:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f104807afd0 0x7f104807d4e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f105c1069a0 0x7f105c19a520 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c1094e0 0x7f105c19b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 --2- 172.21.15.148:0/2178680216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f105c06c2c0 0x7f105c199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 -- 172.21.15.148:0/2178680216 >> 172.21.15.148:0/2178680216 conn(0x7f105c0fe000 msgr2=0x7f105c104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:57.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 -- 172.21.15.148:0/2178680216 shutdown_connections 2024-09-21T01:05:57.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.756+0000 7f1061c3b640 1 -- 172.21.15.148:0/2178680216 wait complete. 2024-09-21T01:05:57.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.739+0000 7f09a36a5640 1 -- 172.21.15.148:0/2015724617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f099c102650 msgr2=0x7f099c102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.739+0000 7f09a36a5640 1 --2- 172.21.15.148:0/2015724617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f099c102650 0x7f099c102ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0998009900 tx=0x7f099802a480 comp rx=0 tx=0).stop 2024-09-21T01:05:57.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.739+0000 7f09a36a5640 1 -- 172.21.15.148:0/2015724617 shutdown_connections 2024-09-21T01:05:57.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.739+0000 7f09a36a5640 1 --2- 172.21.15.148:0/2015724617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f099c104080 0x7f099c10aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.739+0000 7f09a36a5640 1 --2- 172.21.15.148:0/2015724617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f099c1036e0 0x7f099c103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.739+0000 7f09a36a5640 1 --2- 172.21.15.148:0/2015724617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f099c102650 0x7f099c102ac0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.739+0000 7f09a36a5640 1 -- 172.21.15.148:0/2015724617 >> 172.21.15.148:0/2015724617 conn(0x7f099c0fdfa0 msgr2=0x7f099c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.740+0000 7f09a36a5640 1 -- 172.21.15.148:0/2015724617 shutdown_connections 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.740+0000 7f09a36a5640 1 -- 172.21.15.148:0/2015724617 wait complete. 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.740+0000 7f09a36a5640 1 Processor -- start 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.740+0000 7f09a36a5640 1 -- start start 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.740+0000 7f09a36a5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f099c102650 0x7f099c106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a36a5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f099c1036e0 0x7f099c104b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a36a5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f099c104080 0x7f099c105050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a36a5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f099c10e130 con 0x7f099c104080 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a36a5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f099c10dfb0 con 0x7f099c1036e0 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a36a5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f099c10e2b0 con 0x7f099c102650 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a0c40640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f099c1036e0 0x7f099c104b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a1c42640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f099c104080 0x7f099c105050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a1c42640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f099c104080 0x7f099c105050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39382/0 (socket says 172.21.15.148:39382) 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a0c40640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f099c1036e0 0x7f099c104b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:40790/0 (socket says 172.21.15.148:40790) 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a1c42640 1 -- 172.21.15.148:0/3258287603 learned_addr learned my addr 172.21.15.148:0/3258287603 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a1441640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f099c102650 0x7f099c106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a1c42640 1 -- 172.21.15.148:0/3258287603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f099c102650 msgr2=0x7f099c106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a1c42640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f099c102650 0x7f099c106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a1c42640 1 -- 172.21.15.148:0/3258287603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f099c1036e0 msgr2=0x7f099c104b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a1c42640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f099c1036e0 0x7f099c104b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a1c42640 1 -- 172.21.15.148:0/3258287603 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c105750 con 0x7f099c104080 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a0c40640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f099c1036e0 0x7f099c104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a1c42640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f099c104080 0x7f099c105050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f099400eb10 tx=0x7f099400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09927fc640 1 -- 172.21.15.148:0/3258287603 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994004b20 con 0x7f099c104080 2024-09-21T01:05:57.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.741+0000 7f09a36a5640 1 -- 172.21.15.148:0/3258287603 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c1a3f60 con 0x7f099c104080 2024-09-21T01:05:57.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.742+0000 7f09a36a5640 1 -- 172.21.15.148:0/3258287603 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c1a4300 con 0x7f099c104080 2024-09-21T01:05:57.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.742+0000 7f09927fc640 1 -- 172.21.15.148:0/3258287603 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0994004cc0 con 0x7f099c104080 2024-09-21T01:05:57.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.742+0000 7f09927fc640 1 -- 172.21.15.148:0/3258287603 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994010690 con 0x7f099c104080 2024-09-21T01:05:57.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.743+0000 7f09a36a5640 1 -- 172.21.15.148:0/3258287603 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09800050b0 con 0x7f099c104080 2024-09-21T01:05:57.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.744+0000 7f09927fc640 1 -- 172.21.15.148:0/3258287603 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) ==== 103178+0+0 (secure 0 0 0) 0x7f0994005020 con 0x7f099c104080 2024-09-21T01:05:57.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.745+0000 7f09927fc640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f098807afd0 0x7f098807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:57.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.745+0000 7f09927fc640 1 -- 172.21.15.148:0/3258287603 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f099409d140 con 0x7f099c104080 2024-09-21T01:05:57.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.745+0000 7f09a1441640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f098807afd0 0x7f098807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:57.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.745+0000 7f09a1441640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f098807afd0 0x7f098807d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0998000c00 tx=0x7f0998031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:57.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.749+0000 7f09927fc640 1 -- 172.21.15.148:0/3258287603 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0994069c20 con 0x7f099c104080 2024-09-21T01:05:57.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.942+0000 7f09a36a5640 1 -- 172.21.15.148:0/3258287603 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f09800053a0 con 0x7f099c104080 2024-09-21T01:05:57.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.946+0000 7f09927fc640 1 -- 172.21.15.148:0/3258287603 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f099406ead0 con 0x7f099c104080 2024-09-21T01:05:57.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.948+0000 7f09a36a5640 1 -- 172.21.15.148:0/3258287603 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f098807afd0 msgr2=0x7f098807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.948+0000 7f09a36a5640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f098807afd0 0x7f098807d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0998000c00 tx=0x7f0998031400 comp rx=0 tx=0).stop 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.949+0000 7f09a36a5640 1 -- 172.21.15.148:0/3258287603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f099c104080 msgr2=0x7f099c105050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.949+0000 7f09a36a5640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f099c104080 0x7f099c105050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f099400eb10 tx=0x7f099400c2d0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.949+0000 7f09a36a5640 1 -- 172.21.15.148:0/3258287603 shutdown_connections 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.949+0000 7f09a36a5640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f098807afd0 0x7f098807d4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.949+0000 7f09a36a5640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f099c104080 0x7f099c105050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.949+0000 7f09a36a5640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f099c1036e0 0x7f099c104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.949+0000 7f09a36a5640 1 --2- 172.21.15.148:0/3258287603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f099c102650 0x7f099c106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.949+0000 7f09a36a5640 1 -- 172.21.15.148:0/3258287603 >> 172.21.15.148:0/3258287603 conn(0x7f099c0fdfa0 msgr2=0x7f099c06b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.949+0000 7f09a36a5640 1 -- 172.21.15.148:0/3258287603 shutdown_connections 2024-09-21T01:05:57.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:57.949+0000 7f09a36a5640 1 -- 172.21.15.148:0/3258287603 wait complete. 2024-09-21T01:05:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.318+0000 7f54d5f4c640 1 -- 172.21.15.148:0/541489048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54d01094a0 msgr2=0x7f54d010b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.318+0000 7f54d5f4c640 1 --2- 172.21.15.148:0/541489048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54d01094a0 0x7f54d010b9b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009ca0 tx=0x7f54c802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.318+0000 7f54d5f4c640 1 -- 172.21.15.148:0/541489048 shutdown_connections 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.318+0000 7f54d5f4c640 1 --2- 172.21.15.148:0/541489048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54d01094a0 0x7f54d010b9b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.318+0000 7f54d5f4c640 1 --2- 172.21.15.148:0/541489048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54d0106900 0x7f54d0108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.318+0000 7f54d5f4c640 1 --2- 172.21.15.148:0/541489048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54d006c680 0x7f54d01063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.318+0000 7f54d5f4c640 1 -- 172.21.15.148:0/541489048 >> 172.21.15.148:0/541489048 conn(0x7f54d00fdfe0 msgr2=0x7f54d0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.318+0000 7f54d5f4c640 1 -- 172.21.15.148:0/541489048 shutdown_connections 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.318+0000 7f54d5f4c640 1 -- 172.21.15.148:0/541489048 wait complete. 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.318+0000 7f54d5f4c640 1 Processor -- start 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54d5f4c640 1 -- start start 2024-09-21T01:05:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54d5f4c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54d006c680 0x7f54d0199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54d5f4c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54d0106900 0x7f54d019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54d5f4c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54d01094a0 0x7f54d019b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54d5f4c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f54d010f260 con 0x7f54d0106900 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54d5f4c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f54d010f0e0 con 0x7f54d006c680 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54d5f4c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f54d010f3e0 con 0x7f54d01094a0 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54ceffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54d0106900 0x7f54d019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54cf7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54d006c680 0x7f54d0199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54ceffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54d0106900 0x7f54d019a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39404/0 (socket says 172.21.15.148:39404) 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54ceffd640 1 -- 172.21.15.148:0/3562972283 learned_addr learned my addr 172.21.15.148:0/3562972283 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54cffff640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54d01094a0 0x7f54d019b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54ceffd640 1 -- 172.21.15.148:0/3562972283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54d01094a0 msgr2=0x7f54d019b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54ceffd640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54d01094a0 0x7f54d019b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54ceffd640 1 -- 172.21.15.148:0/3562972283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54d006c680 msgr2=0x7f54d0199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54ceffd640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54d006c680 0x7f54d0199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54ceffd640 1 -- 172.21.15.148:0/3562972283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d019b890 con 0x7f54d0106900 2024-09-21T01:05:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54cf7fe640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54d006c680 0x7f54d0199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54ceffd640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54d0106900 0x7f54d019a4d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f54c400d950 tx=0x7f54c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.319+0000 7f54ccff9640 1 -- 172.21.15.148:0/3562972283 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4017070 con 0x7f54d0106900 2024-09-21T01:05:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.320+0000 7f54ccff9640 1 -- 172.21.15.148:0/3562972283 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f54c4009c30 con 0x7f54d0106900 2024-09-21T01:05:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.320+0000 7f54ccff9640 1 -- 172.21.15.148:0/3562972283 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c400f620 con 0x7f54d0106900 2024-09-21T01:05:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.320+0000 7f54d5f4c640 1 -- 172.21.15.148:0/3562972283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d019bb80 con 0x7f54d0106900 2024-09-21T01:05:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.320+0000 7f54d5f4c640 1 -- 172.21.15.148:0/3562972283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d01a2280 con 0x7f54d0106900 2024-09-21T01:05:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.321+0000 7f54d5f4c640 1 -- 172.21.15.148:0/3562972283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d0106d50 con 0x7f54d0106900 2024-09-21T01:05:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.321+0000 7f54ccff9640 1 -- 172.21.15.148:0/3562972283 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) ==== 103178+0+0 (secure 0 0 0) 0x7f54c400f7c0 con 0x7f54d0106900 2024-09-21T01:05:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.322+0000 7f54ccff9640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f54b807afd0 0x7f54b807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.322+0000 7f54cf7fe640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f54b807afd0 0x7f54b807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.322+0000 7f54ccff9640 1 -- 172.21.15.148:0/3562972283 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f54c409c950 con 0x7f54d0106900 2024-09-21T01:05:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.322+0000 7f54cf7fe640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f54b807afd0 0x7f54b807d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009fc0 tx=0x7f54c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.326+0000 7f54ccff9640 1 -- 172.21.15.148:0/3562972283 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54c4009de0 con 0x7f54d0106900 2024-09-21T01:05:58.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:58 smithi148 ceph-mon[31000]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-21T01:05:58.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T01:05:58.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:58 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2178680216' entity='client.admin' 2024-09-21T01:05:58.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:58 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3258287603' entity='client.admin' 2024-09-21T01:05:58.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:58 smithi181 ceph-mon[34811]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-21T01:05:58.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T01:05:58.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:58 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2178680216' entity='client.admin' 2024-09-21T01:05:58.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:58 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3258287603' entity='client.admin' 2024-09-21T01:05:58.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:58 smithi157 ceph-mon[34140]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-21T01:05:58.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T01:05:58.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:58 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2178680216' entity='client.admin' 2024-09-21T01:05:58.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:58 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3258287603' entity='client.admin' 2024-09-21T01:05:58.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.513+0000 7f54d5f4c640 1 -- 172.21.15.148:0/3562972283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f54d002e9f0 con 0x7f54d0106900 2024-09-21T01:05:58.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.517+0000 7f54ccff9640 1 -- 172.21.15.148:0/3562972283 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v20)=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f54d002e9f0 con 0x7f54d0106900 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.519+0000 7f54d5f4c640 1 -- 172.21.15.148:0/3562972283 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f54b807afd0 msgr2=0x7f54b807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.519+0000 7f54d5f4c640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f54b807afd0 0x7f54b807d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009fc0 tx=0x7f54c0005f90 comp rx=0 tx=0).stop 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.519+0000 7f54d5f4c640 1 -- 172.21.15.148:0/3562972283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54d0106900 msgr2=0x7f54d019a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.520+0000 7f54d5f4c640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54d0106900 0x7f54d019a4d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f54c400d950 tx=0x7f54c400de10 comp rx=0 tx=0).stop 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.520+0000 7f54d5f4c640 1 -- 172.21.15.148:0/3562972283 shutdown_connections 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.520+0000 7f54d5f4c640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f54b807afd0 0x7f54b807d4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.520+0000 7f54d5f4c640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54d0106900 0x7f54d019a4d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.520+0000 7f54d5f4c640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54d01094a0 0x7f54d019b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.520+0000 7f54d5f4c640 1 --2- 172.21.15.148:0/3562972283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54d006c680 0x7f54d0199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.520+0000 7f54d5f4c640 1 -- 172.21.15.148:0/3562972283 >> 172.21.15.148:0/3562972283 conn(0x7f54d00fdfe0 msgr2=0x7f54d0104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.520+0000 7f54d5f4c640 1 -- 172.21.15.148:0/3562972283 shutdown_connections 2024-09-21T01:05:58.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.520+0000 7f54d5f4c640 1 -- 172.21.15.148:0/3562972283 wait complete. 2024-09-21T01:05:59.195 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:59 smithi148 ceph-mon[31000]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:59.195 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:59 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3562972283' entity='client.admin' 2024-09-21T01:05:59.196 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:59 smithi148 ceph-mon[31000]: Standby manager daemon y started 2024-09-21T01:05:59.196 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:59 smithi148 ceph-mon[31000]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T01:05:59.196 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:59 smithi148 ceph-mon[31000]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:05:59.196 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:59 smithi148 ceph-mon[31000]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T01:05:59.196 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:05:59 smithi148 ceph-mon[31000]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:05:59.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:59 smithi181 ceph-mon[34811]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:59.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:59 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3562972283' entity='client.admin' 2024-09-21T01:05:59.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:59 smithi181 ceph-mon[34811]: Standby manager daemon y started 2024-09-21T01:05:59.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:59 smithi181 ceph-mon[34811]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T01:05:59.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:59 smithi181 ceph-mon[34811]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:05:59.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:59 smithi181 ceph-mon[34811]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T01:05:59.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:05:59 smithi181 ceph-mon[34811]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:05:59.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:59 smithi157 ceph-mon[34140]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:05:59.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:59 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3562972283' entity='client.admin' 2024-09-21T01:05:59.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:59 smithi157 ceph-mon[34140]: Standby manager daemon y started 2024-09-21T01:05:59.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:59 smithi157 ceph-mon[34140]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T01:05:59.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:59 smithi157 ceph-mon[34140]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:05:59.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:59 smithi157 ceph-mon[34140]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T01:05:59.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:05:59 smithi157 ceph-mon[34140]: from='mgr.? 172.21.15.157:0/1154800549' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:06:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.999+0000 7fb720697640 1 -- 172.21.15.148:0/4275791948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb718102e50 msgr2=0x7fb718103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.999+0000 7fb720697640 1 --2- 172.21.15.148:0/4275791948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb718102e50 0x7fb718103260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb708009900 tx=0x7fb70802a480 comp rx=0 tx=0).stop 2024-09-21T01:06:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.999+0000 7fb720697640 1 -- 172.21.15.148:0/4275791948 shutdown_connections 2024-09-21T01:06:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.999+0000 7fb720697640 1 --2- 172.21.15.148:0/4275791948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb718102e50 0x7fb718103260 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.999+0000 7fb720697640 1 --2- 172.21.15.148:0/4275791948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7181037f0 0x7fb71810a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.999+0000 7fb720697640 1 --2- 172.21.15.148:0/4275791948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb718101dc0 0x7fb718102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.999+0000 7fb720697640 1 -- 172.21.15.148:0/4275791948 >> 172.21.15.148:0/4275791948 conn(0x7fb7180fd770 msgr2=0x7fb7180ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.999+0000 7fb720697640 1 -- 172.21.15.148:0/4275791948 shutdown_connections 2024-09-21T01:06:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:58.999+0000 7fb720697640 1 -- 172.21.15.148:0/4275791948 wait complete. 2024-09-21T01:06:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb720697640 1 Processor -- start 2024-09-21T01:06:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb720697640 1 -- start start 2024-09-21T01:06:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb720697640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb718101dc0 0x7fb718199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb720697640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb718102e50 0x7fb71819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb720697640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7181037f0 0x7fb71819b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb720697640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb71810d040 con 0x7fb7181037f0 2024-09-21T01:06:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb720697640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb71810cec0 con 0x7fb718102e50 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb720697640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb71810d1c0 con 0x7fb718101dc0 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71ec34640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7181037f0 0x7fb71819b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71e433640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb718101dc0 0x7fb718199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71ec34640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7181037f0 0x7fb71819b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39428/0 (socket says 172.21.15.148:39428) 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71ec34640 1 -- 172.21.15.148:0/1337924441 learned_addr learned my addr 172.21.15.148:0/1337924441 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71dc32640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb718102e50 0x7fb71819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71ec34640 1 -- 172.21.15.148:0/1337924441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb718101dc0 msgr2=0x7fb718199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71ec34640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb718101dc0 0x7fb718199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71ec34640 1 -- 172.21.15.148:0/1337924441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb718102e50 msgr2=0x7fb71819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71ec34640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb718102e50 0x7fb71819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71ec34640 1 -- 172.21.15.148:0/1337924441 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71819b8e0 con 0x7fb7181037f0 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.000+0000 7fb71ec34640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7181037f0 0x7fb71819b0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb71000eaa0 tx=0x7fb71000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.001+0000 7fb70f7fe640 1 -- 172.21.15.148:0/1337924441 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71000cdb0 con 0x7fb7181037f0 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.001+0000 7fb70f7fe640 1 -- 172.21.15.148:0/1337924441 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb710005020 con 0x7fb7181037f0 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.001+0000 7fb720697640 1 -- 172.21.15.148:0/1337924441 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71819bbd0 con 0x7fb7181037f0 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.001+0000 7fb70f7fe640 1 -- 172.21.15.148:0/1337924441 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7100116d0 con 0x7fb7181037f0 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.001+0000 7fb720697640 1 -- 172.21.15.148:0/1337924441 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7181a22d0 con 0x7fb7181037f0 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.002+0000 7fb720697640 1 -- 172.21.15.148:0/1337924441 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb718102230 con 0x7fb7181037f0 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.002+0000 7fb70f7fe640 1 -- 172.21.15.148:0/1337924441 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) ==== 103178+0+0 (secure 0 0 0) 0x7fb710004a40 con 0x7fb7181037f0 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.003+0000 7fb70f7fe640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb70407afd0 0x7fb70407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.003+0000 7fb70f7fe640 1 -- 172.21.15.148:0/1337924441 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb71009cdf0 con 0x7fb7181037f0 2024-09-21T01:06:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.003+0000 7fb71e433640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb70407afd0 0x7fb70407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.003+0000 7fb71e433640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb70407afd0 0x7fb70407d4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb71400ac40 tx=0x7fb714010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.008+0000 7fb70f7fe640 1 -- 172.21.15.148:0/1337924441 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb710016030 con 0x7fb7181037f0 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.194+0000 7fb720697640 1 -- 172.21.15.148:0/1337924441 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fb7181a2500 con 0x7fb7181037f0 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.198+0000 7fb70f7fe640 1 -- 172.21.15.148:0/1337924441 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v21)=0 v21) ==== 111+0+0 (secure 0 0 0) 0x7fb7100698d0 con 0x7fb7181037f0 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.200+0000 7fb720697640 1 -- 172.21.15.148:0/1337924441 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb70407afd0 msgr2=0x7fb70407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.200+0000 7fb720697640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb70407afd0 0x7fb70407d4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb71400ac40 tx=0x7fb714010040 comp rx=0 tx=0).stop 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.200+0000 7fb720697640 1 -- 172.21.15.148:0/1337924441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7181037f0 msgr2=0x7fb71819b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.200+0000 7fb720697640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7181037f0 0x7fb71819b0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb71000eaa0 tx=0x7fb71000ef60 comp rx=0 tx=0).stop 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.200+0000 7fb720697640 1 -- 172.21.15.148:0/1337924441 shutdown_connections 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.201+0000 7fb720697640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb70407afd0 0x7fb70407d4e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.201+0000 7fb720697640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7181037f0 0x7fb71819b0c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.201+0000 7fb720697640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb718102e50 0x7fb71819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.201+0000 7fb720697640 1 --2- 172.21.15.148:0/1337924441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb718101dc0 0x7fb718199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.201+0000 7fb720697640 1 -- 172.21.15.148:0/1337924441 >> 172.21.15.148:0/1337924441 conn(0x7fb7180fd770 msgr2=0x7fb718108380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:00.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.201+0000 7fb720697640 1 -- 172.21.15.148:0/1337924441 shutdown_connections 2024-09-21T01:06:00.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.201+0000 7fb720697640 1 -- 172.21.15.148:0/1337924441 wait complete. 2024-09-21T01:06:00.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:00 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1337924441' entity='client.admin' 2024-09-21T01:06:00.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:00 smithi148 ceph-mon[31000]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-21T01:06:00.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T01:06:00.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:00 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1770943917' entity='client.admin' 2024-09-21T01:06:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:00 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1337924441' entity='client.admin' 2024-09-21T01:06:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:00 smithi181 ceph-mon[34811]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-21T01:06:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T01:06:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:00 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1770943917' entity='client.admin' 2024-09-21T01:06:00.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:00 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1337924441' entity='client.admin' 2024-09-21T01:06:00.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:00 smithi157 ceph-mon[34140]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-21T01:06:00.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T01:06:00.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:00 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1770943917' entity='client.admin' 2024-09-21T01:06:01.316 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:01 smithi148 ceph-mon[31000]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:01.316 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:01 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2769745889' entity='client.admin' 2024-09-21T01:06:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.408+0000 7f48c938f640 1 -- 172.21.15.148:0/1987475053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48c4106900 msgr2=0x7f48c4108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.408+0000 7f48c938f640 1 --2- 172.21.15.148:0/1987475053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48c4106900 0x7f48c4108d60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009900 tx=0x7f48ac02a410 comp rx=0 tx=0).stop 2024-09-21T01:06:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.408+0000 7f48c938f640 1 -- 172.21.15.148:0/1987475053 shutdown_connections 2024-09-21T01:06:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.408+0000 7f48c938f640 1 --2- 172.21.15.148:0/1987475053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48c4106900 0x7f48c4108d60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.408+0000 7f48c938f640 1 --2- 172.21.15.148:0/1987475053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48c41094a0 0x7f48c410b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.408+0000 7f48c938f640 1 --2- 172.21.15.148:0/1987475053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48c406c340 0x7f48c41063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.408+0000 7f48c938f640 1 -- 172.21.15.148:0/1987475053 >> 172.21.15.148:0/1987475053 conn(0x7f48c40fdfe0 msgr2=0x7f48c4100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:01.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.408+0000 7f48c938f640 1 -- 172.21.15.148:0/1987475053 shutdown_connections 2024-09-21T01:06:01.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.408+0000 7f48c938f640 1 -- 172.21.15.148:0/1987475053 wait complete. 2024-09-21T01:06:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.408+0000 7f48c938f640 1 Processor -- start 2024-09-21T01:06:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c938f640 1 -- start start 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c938f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48c406c340 0x7f48c4199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c938f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48c4106900 0x7f48c419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c938f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48c41094a0 0x7f48c419b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c938f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f48c410f270 con 0x7f48c41094a0 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c938f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f48c410f0f0 con 0x7f48c406c340 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c938f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f48c410f3f0 con 0x7f48c4106900 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48c41094a0 0x7f48c419b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48c41094a0 0x7f48c419b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39476/0 (socket says 172.21.15.148:39476) 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c37fe640 1 -- 172.21.15.148:0/2717522651 learned_addr learned my addr 172.21.15.148:0/2717522651 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48ba7fc640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48c4106900 0x7f48c419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c2ffd640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48c406c340 0x7f48c4199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c37fe640 1 -- 172.21.15.148:0/2717522651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48c4106900 msgr2=0x7f48c419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c37fe640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48c4106900 0x7f48c419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c37fe640 1 -- 172.21.15.148:0/2717522651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48c406c340 msgr2=0x7f48c4199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c37fe640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48c406c340 0x7f48c4199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48c37fe640 1 -- 172.21.15.148:0/2717522651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c419b930 con 0x7f48c41094a0 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.409+0000 7f48ba7fc640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48c4106900 0x7f48c419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.410+0000 7f48c37fe640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48c41094a0 0x7f48c419b110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00eb10 tx=0x7f48bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.410+0000 7f48c0ff9640 1 -- 172.21.15.148:0/2717522651 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc004b20 con 0x7f48c41094a0 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.410+0000 7f48c0ff9640 1 -- 172.21.15.148:0/2717522651 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f48bc004cc0 con 0x7f48c41094a0 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.410+0000 7f48c938f640 1 -- 172.21.15.148:0/2717522651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c419bc20 con 0x7f48c41094a0 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.410+0000 7f48c0ff9640 1 -- 172.21.15.148:0/2717522651 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc010690 con 0x7f48c41094a0 2024-09-21T01:06:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.410+0000 7f48c938f640 1 -- 172.21.15.148:0/2717522651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c41a2320 con 0x7f48c41094a0 2024-09-21T01:06:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.411+0000 7f48c938f640 1 -- 172.21.15.148:0/2717522651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c4106d50 con 0x7f48c41094a0 2024-09-21T01:06:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.413+0000 7f48c0ff9640 1 -- 172.21.15.148:0/2717522651 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7f48bc005000 con 0x7f48c41094a0 2024-09-21T01:06:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.413+0000 7f48c0ff9640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48b00b6500 0x7f48b00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.414+0000 7f48c2ffd640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48b00b6500 0x7f48b00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.414+0000 7f48c0ff9640 1 -- 172.21.15.148:0/2717522651 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f48bc0e5e60 con 0x7f48c41094a0 2024-09-21T01:06:01.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.414+0000 7f48c2ffd640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48b00b6500 0x7f48b00b8a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009b60 tx=0x7f48b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:01.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.416+0000 7f48c0ff9640 1 -- 172.21.15.148:0/2717522651 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f48bc056710 con 0x7f48c41094a0 2024-09-21T01:06:01.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:01 smithi181 ceph-mon[34811]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:01.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:01 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2769745889' entity='client.admin' 2024-09-21T01:06:01.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:01 smithi157 ceph-mon[34140]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:01.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:01 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2769745889' entity='client.admin' 2024-09-21T01:06:01.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.601+0000 7f48c938f640 1 -- 172.21.15.148:0/2717522651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f48c40ffb00 con 0x7f48c41094a0 2024-09-21T01:06:01.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.605+0000 7f48c0ff9640 1 -- 172.21.15.148:0/2717522651 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v24)=0 v24) ==== 125+0+0 (secure 0 0 0) 0x7f48c40ffb00 con 0x7f48c41094a0 2024-09-21T01:06:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 -- 172.21.15.148:0/2717522651 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48b00b6500 msgr2=0x7f48b00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48b00b6500 0x7f48b00b8a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009b60 tx=0x7f48b4005f90 comp rx=0 tx=0).stop 2024-09-21T01:06:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 -- 172.21.15.148:0/2717522651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48c41094a0 msgr2=0x7f48c419b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48c41094a0 0x7f48c419b110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00eb10 tx=0x7f48bc00c2d0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 -- 172.21.15.148:0/2717522651 shutdown_connections 2024-09-21T01:06:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48b00b6500 0x7f48b00b8a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48c41094a0 0x7f48c419b110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48c4106900 0x7f48c419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 --2- 172.21.15.148:0/2717522651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48c406c340 0x7f48c4199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 -- 172.21.15.148:0/2717522651 >> 172.21.15.148:0/2717522651 conn(0x7f48c40fdfe0 msgr2=0x7f48c4104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:01.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 -- 172.21.15.148:0/2717522651 shutdown_connections 2024-09-21T01:06:01.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.608+0000 7f48c938f640 1 -- 172.21.15.148:0/2717522651 wait complete. 2024-09-21T01:06:02.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.703+0000 7f977d7d8640 1 -- 172.21.15.148:0/2968182082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9778106930 msgr2=0x7f9778108d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.703+0000 7f977d7d8640 1 --2- 172.21.15.148:0/2968182082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9778106930 0x7f9778108d50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f976c009900 tx=0x7f976c02a410 comp rx=0 tx=0).stop 2024-09-21T01:06:02.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.703+0000 7f977d7d8640 1 -- 172.21.15.148:0/2968182082 shutdown_connections 2024-09-21T01:06:02.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.703+0000 7f977d7d8640 1 --2- 172.21.15.148:0/2968182082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9778106930 0x7f9778108d50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.703+0000 7f977d7d8640 1 --2- 172.21.15.148:0/2968182082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9778109470 0x7f977810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.703+0000 7f977d7d8640 1 --2- 172.21.15.148:0/2968182082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977806b920 0x7f97781063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.703+0000 7f977d7d8640 1 -- 172.21.15.148:0/2968182082 >> 172.21.15.148:0/2968182082 conn(0x7f97780fdfb0 msgr2=0x7f9778100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.703+0000 7f977d7d8640 1 -- 172.21.15.148:0/2968182082 shutdown_connections 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.703+0000 7f977d7d8640 1 -- 172.21.15.148:0/2968182082 wait complete. 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.703+0000 7f977d7d8640 1 Processor -- start 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f977d7d8640 1 -- start start 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f977d7d8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977806b920 0x7f9778199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f977d7d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9778106930 0x7f977819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f977d7d8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9778109470 0x7f977819b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f977d7d8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f977810f240 con 0x7f9778109470 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f977d7d8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f977810f0c0 con 0x7f977806b920 2024-09-21T01:06:02.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f977d7d8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f977810f3c0 con 0x7f9778106930 2024-09-21T01:06:02.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f97777fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9778109470 0x7f977819b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f97777fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9778109470 0x7f977819b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39438/0 (socket says 172.21.15.148:39438) 2024-09-21T01:06:02.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f97777fe640 1 -- 172.21.15.148:0/1770943917 learned_addr learned my addr 172.21.15.148:0/1770943917 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:02.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f9776ffd640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977806b920 0x7f9778199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f97767fc640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9778106930 0x7f977819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f97777fe640 1 -- 172.21.15.148:0/1770943917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9778106930 msgr2=0x7f977819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f97777fe640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9778106930 0x7f977819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f97777fe640 1 -- 172.21.15.148:0/1770943917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977806b920 msgr2=0x7f9778199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f97777fe640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977806b920 0x7f9778199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f97777fe640 1 -- 172.21.15.148:0/1770943917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977819b8f0 con 0x7f9778109470 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.704+0000 7f97767fc640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9778106930 0x7f977819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.705+0000 7f97777fe640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9778109470 0x7f977819b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f977000eaa0 tx=0x7f977000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.705+0000 7f975ffff640 1 -- 172.21.15.148:0/1770943917 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977000cdb0 con 0x7f9778109470 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.705+0000 7f975ffff640 1 -- 172.21.15.148:0/1770943917 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9770005020 con 0x7f9778109470 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.705+0000 7f977d7d8640 1 -- 172.21.15.148:0/1770943917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f977819bbe0 con 0x7f9778109470 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.705+0000 7f975ffff640 1 -- 172.21.15.148:0/1770943917 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700116d0 con 0x7f9778109470 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.705+0000 7f977d7d8640 1 -- 172.21.15.148:0/1770943917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97781a22e0 con 0x7f9778109470 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.706+0000 7f977d7d8640 1 -- 172.21.15.148:0/1770943917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9778106d40 con 0x7f9778109470 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.708+0000 7f975ffff640 1 -- 172.21.15.148:0/1770943917 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7f9770004a40 con 0x7f9778109470 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.709+0000 7f975ffff640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97600b6480 0x7f97600b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.709+0000 7f9776ffd640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97600b6480 0x7f97600b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.709+0000 7f975ffff640 1 -- 172.21.15.148:0/1770943917 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f97700e5b70 con 0x7f9778109470 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.710+0000 7f9776ffd640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97600b6480 0x7f97600b8990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9768005d00 tx=0x7f976800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.712+0000 7f975ffff640 1 -- 172.21.15.148:0/1770943917 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9770016030 con 0x7f9778109470 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.903+0000 7f977d7d8640 1 -- 172.21.15.148:0/1770943917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f97780ffad0 con 0x7f9778109470 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.908+0000 7f975ffff640 1 -- 172.21.15.148:0/1770943917 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f97780ffad0 con 0x7f9778109470 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 -- 172.21.15.148:0/1770943917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97600b6480 msgr2=0x7f97600b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97600b6480 0x7f97600b8990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9768005d00 tx=0x7f976800b410 comp rx=0 tx=0).stop 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 -- 172.21.15.148:0/1770943917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9778109470 msgr2=0x7f977819b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9778109470 0x7f977819b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f977000eaa0 tx=0x7f977000ef60 comp rx=0 tx=0).stop 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 -- 172.21.15.148:0/1770943917 shutdown_connections 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97600b6480 0x7f97600b8990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9778109470 0x7f977819b0d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9778106930 0x7f977819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 --2- 172.21.15.148:0/1770943917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977806b920 0x7f9778199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 -- 172.21.15.148:0/1770943917 >> 172.21.15.148:0/1770943917 conn(0x7f97780fdfb0 msgr2=0x7f9778104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:02.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 -- 172.21.15.148:0/1770943917 shutdown_connections 2024-09-21T01:06:02.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:05:59.910+0000 7f977d7d8640 1 -- 172.21.15.148:0/1770943917 wait complete. 2024-09-21T01:06:02.715 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:02 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2717522651' entity='client.admin' 2024-09-21T01:06:02.716 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:02.716 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:02.716 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:02.716 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:02 smithi148 ceph-mon[31000]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.813+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/987308807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e08108370 msgr2=0x7f6e0810a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.813+0000 7f6e0d5fa640 1 --2- 172.21.15.148:0/987308807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e08108370 0x7f6e0810a880 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009ca0 tx=0x7f6e0002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.813+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/987308807 shutdown_connections 2024-09-21T01:06:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.813+0000 7f6e0d5fa640 1 --2- 172.21.15.148:0/987308807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e08108370 0x7f6e0810a880 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.813+0000 7f6e0d5fa640 1 --2- 172.21.15.148:0/987308807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e08105750 0x7f6e08107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.813+0000 7f6e0d5fa640 1 --2- 172.21.15.148:0/987308807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e08102cd0 0x7f6e08105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.813+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/987308807 >> 172.21.15.148:0/987308807 conn(0x7f6e080fd770 msgr2=0x7f6e080ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.813+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/987308807 shutdown_connections 2024-09-21T01:06:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.813+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/987308807 wait complete. 2024-09-21T01:06:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.814+0000 7f6e0d5fa640 1 Processor -- start 2024-09-21T01:06:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.814+0000 7f6e0d5fa640 1 -- start start 2024-09-21T01:06:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.814+0000 7f6e0d5fa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e08102cd0 0x7f6e0819c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.814+0000 7f6e0d5fa640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e08105750 0x7f6e0819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.814+0000 7f6e0d5fa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e08108370 0x7f6e0819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.814+0000 7f6e0d5fa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0810e140 con 0x7f6e08108370 2024-09-21T01:06:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.814+0000 7f6e0d5fa640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0810dfc0 con 0x7f6e08105750 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.814+0000 7f6e0d5fa640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0810e2c0 con 0x7f6e08102cd0 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e077fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e08108370 0x7f6e0819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e077fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e08108370 0x7f6e0819d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39488/0 (socket says 172.21.15.148:39488) 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e077fe640 1 -- 172.21.15.148:0/1376009529 learned_addr learned my addr 172.21.15.148:0/1376009529 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e067fc640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e08105750 0x7f6e0819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e06ffd640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e08102cd0 0x7f6e0819c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e077fe640 1 -- 172.21.15.148:0/1376009529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e08102cd0 msgr2=0x7f6e0819c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e077fe640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e08102cd0 0x7f6e0819c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e077fe640 1 -- 172.21.15.148:0/1376009529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e08105750 msgr2=0x7f6e0819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e077fe640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e08105750 0x7f6e0819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e077fe640 1 -- 172.21.15.148:0/1376009529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0819da80 con 0x7f6e08108370 2024-09-21T01:06:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.815+0000 7f6e077fe640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e08108370 0x7f6e0819d260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e00006010 tx=0x7f6e000307f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.816+0000 7f6dfffff640 1 -- 172.21.15.148:0/1376009529 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00030be0 con 0x7f6e08108370 2024-09-21T01:06:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.816+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/1376009529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0819dd10 con 0x7f6e08108370 2024-09-21T01:06:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.816+0000 7f6dfffff640 1 -- 172.21.15.148:0/1376009529 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6e00030d80 con 0x7f6e08108370 2024-09-21T01:06:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.816+0000 7f6dfffff640 1 -- 172.21.15.148:0/1376009529 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00004830 con 0x7f6e08108370 2024-09-21T01:06:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.816+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/1376009529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e081a4470 con 0x7f6e08108370 2024-09-21T01:06:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.817+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/1376009529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e08105c20 con 0x7f6e08108370 2024-09-21T01:06:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.819+0000 7f6dfffff640 1 -- 172.21.15.148:0/1376009529 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7f6e00004050 con 0x7f6e08108370 2024-09-21T01:06:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.820+0000 7f6dfffff640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6df40b6500 0x7f6df40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.820+0000 7f6e06ffd640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6df40b6500 0x7f6df40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.820+0000 7f6dfffff640 1 -- 172.21.15.148:0/1376009529 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6e001066e0 con 0x7f6e08108370 2024-09-21T01:06:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.821+0000 7f6e06ffd640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6df40b6500 0x7f6df40b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6df8005fd0 tx=0x7f6df800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:02.823+0000 7f6dfffff640 1 -- 172.21.15.148:0/1376009529 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e000cec40 con 0x7f6e08108370 2024-09-21T01:06:02.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:02 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2717522651' entity='client.admin' 2024-09-21T01:06:02.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:02.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:02.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:02.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:02 smithi181 ceph-mon[34811]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:02.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:02 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2717522651' entity='client.admin' 2024-09-21T01:06:02.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:02.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:02.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:02.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:02 smithi157 ceph-mon[34140]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:03.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.009+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/1376009529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f6e081a46a0 con 0x7f6e08108370 2024-09-21T01:06:03.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.016+0000 7f6dfffff640 1 -- 172.21.15.148:0/1376009529 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v25)=0 v25) ==== 108+0+0 (secure 0 0 0) 0x7f6e000d3020 con 0x7f6e08108370 2024-09-21T01:06:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/1376009529 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6df40b6500 msgr2=0x7f6df40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6df40b6500 0x7f6df40b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6df8005fd0 tx=0x7f6df800b390 comp rx=0 tx=0).stop 2024-09-21T01:06:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/1376009529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e08108370 msgr2=0x7f6e0819d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e08108370 0x7f6e0819d260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e00006010 tx=0x7f6e000307f0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/1376009529 shutdown_connections 2024-09-21T01:06:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6df40b6500 0x7f6df40b8a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e08108370 0x7f6e0819d260 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e08105750 0x7f6e0819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 --2- 172.21.15.148:0/1376009529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e08102cd0 0x7f6e0819c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/1376009529 >> 172.21.15.148:0/1376009529 conn(0x7f6e080fd770 msgr2=0x7f6e08101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:03.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/1376009529 shutdown_connections 2024-09-21T01:06:03.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.018+0000 7f6e0d5fa640 1 -- 172.21.15.148:0/1376009529 wait complete. 2024-09-21T01:06:03.699 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:03 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:03.699 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:03 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:03.699 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:03 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:03.699 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:03 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1376009529' entity='client.admin' 2024-09-21T01:06:03.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.698+0000 7fcce9896640 1 -- 172.21.15.148:0/341159473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce4105750 msgr2=0x7fcce4107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.698+0000 7fcce9896640 1 --2- 172.21.15.148:0/341159473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce4105750 0x7fcce4107c30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009900 tx=0x7fccd802a410 comp rx=0 tx=0).stop 2024-09-21T01:06:03.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.698+0000 7fcce9896640 1 -- 172.21.15.148:0/341159473 shutdown_connections 2024-09-21T01:06:03.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.698+0000 7fcce9896640 1 --2- 172.21.15.148:0/341159473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce4105750 0x7fcce4107c30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.698+0000 7fcce9896640 1 --2- 172.21.15.148:0/341159473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcce4108370 0x7fcce410a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.698+0000 7fcce9896640 1 --2- 172.21.15.148:0/341159473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcce4102c90 0x7fcce4105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.698+0000 7fcce9896640 1 -- 172.21.15.148:0/341159473 >> 172.21.15.148:0/341159473 conn(0x7fcce40fd770 msgr2=0x7fcce40ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:03.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.698+0000 7fcce9896640 1 -- 172.21.15.148:0/341159473 shutdown_connections 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.698+0000 7fcce9896640 1 -- 172.21.15.148:0/341159473 wait complete. 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce9896640 1 Processor -- start 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce9896640 1 -- start start 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce9896640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcce4102c90 0x7fcce41021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce9896640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcce4105750 0x7fcce419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce9896640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce4108370 0x7fcce41a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce9896640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcce410e120 con 0x7fcce4108370 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce9896640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcce410dfa0 con 0x7fcce4105750 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce9896640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcce410e2a0 con 0x7fcce4102c90 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce4108370 0x7fcce41a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce4108370 0x7fcce41a11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39528/0 (socket says 172.21.15.148:39528) 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce37fe640 1 -- 172.21.15.148:0/2109732629 learned_addr learned my addr 172.21.15.148:0/2109732629 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce2ffd640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcce4102c90 0x7fcce41021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.699+0000 7fcce27fc640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcce4105750 0x7fcce419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce37fe640 1 -- 172.21.15.148:0/2109732629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcce4102c90 msgr2=0x7fcce41021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce37fe640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcce4102c90 0x7fcce41021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce37fe640 1 -- 172.21.15.148:0/2109732629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcce4105750 msgr2=0x7fcce419ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce37fe640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcce4105750 0x7fcce419ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce37fe640 1 -- 172.21.15.148:0/2109732629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce41a1910 con 0x7fcce4108370 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce37fe640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce4108370 0x7fcce41a11a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00cce0 tx=0x7fccdc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce8894640 1 -- 172.21.15.148:0/2109732629 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00f450 con 0x7fcce4108370 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce9896640 1 -- 172.21.15.148:0/2109732629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce41a1c00 con 0x7fcce4108370 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce8894640 1 -- 172.21.15.148:0/2109732629 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fccdc00fa80 con 0x7fcce4108370 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce8894640 1 -- 172.21.15.148:0/2109732629 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc018ae0 con 0x7fcce4108370 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.700+0000 7fcce9896640 1 -- 172.21.15.148:0/2109732629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce41a20f0 con 0x7fcce4108370 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.701+0000 7fcce9896640 1 -- 172.21.15.148:0/2109732629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce4105c20 con 0x7fcce4108370 2024-09-21T01:06:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.703+0000 7fcce8894640 1 -- 172.21.15.148:0/2109732629 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7fccdc00f5f0 con 0x7fcce4108370 2024-09-21T01:06:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.704+0000 7fcce8894640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcccc0b6480 0x7fcccc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.704+0000 7fcce2ffd640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcccc0b6480 0x7fcccc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.704+0000 7fcce8894640 1 -- 172.21.15.148:0/2109732629 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fccdc0e5d80 con 0x7fcce4108370 2024-09-21T01:06:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.704+0000 7fcce2ffd640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcccc0b6480 0x7fcccc0b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009bd0 tx=0x7fccd4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:03.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.708+0000 7fcce8894640 1 -- 172.21.15.148:0/2109732629 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fccdc014030 con 0x7fcce4108370 2024-09-21T01:06:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.586+0000 7f1711cd5640 1 -- 172.21.15.148:0/455651600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c06c660 msgr2=0x7f170c1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.586+0000 7f1711cd5640 1 --2- 172.21.15.148:0/455651600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c06c660 0x7f170c1063a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009900 tx=0x7f16fc02a410 comp rx=0 tx=0).stop 2024-09-21T01:06:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.587+0000 7f1711cd5640 1 -- 172.21.15.148:0/455651600 shutdown_connections 2024-09-21T01:06:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.587+0000 7f1711cd5640 1 --2- 172.21.15.148:0/455651600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f170c109480 0x7f170c10b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.587+0000 7f1711cd5640 1 --2- 172.21.15.148:0/455651600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c1068e0 0x7f170c108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.587+0000 7f1711cd5640 1 --2- 172.21.15.148:0/455651600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c06c660 0x7f170c1063a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.587+0000 7f1711cd5640 1 -- 172.21.15.148:0/455651600 >> 172.21.15.148:0/455651600 conn(0x7f170c0fdfe0 msgr2=0x7f170c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.587+0000 7f1711cd5640 1 -- 172.21.15.148:0/455651600 shutdown_connections 2024-09-21T01:06:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.587+0000 7f1711cd5640 1 -- 172.21.15.148:0/455651600 wait complete. 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.587+0000 7f1711cd5640 1 Processor -- start 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f1711cd5640 1 -- start start 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f1711cd5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c06c660 0x7f170c199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f1711cd5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1068e0 0x7f170c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f1711cd5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f170c109480 0x7f170c19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f1711cd5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f170c10f250 con 0x7f170c1068e0 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f1711cd5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f170c10f0d0 con 0x7f170c06c660 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f1711cd5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f170c10f3d0 con 0x7f170c109480 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1068e0 0x7f170c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1068e0 0x7f170c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39506/0 (socket says 172.21.15.148:39506) 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170affd640 1 -- 172.21.15.148:0/2729617258 learned_addr learned my addr 172.21.15.148:0/2729617258 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170bfff640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f170c109480 0x7f170c19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170b7fe640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c06c660 0x7f170c199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170affd640 1 -- 172.21.15.148:0/2729617258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f170c109480 msgr2=0x7f170c19b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170affd640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f170c109480 0x7f170c19b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170affd640 1 -- 172.21.15.148:0/2729617258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c06c660 msgr2=0x7f170c199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170affd640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c06c660 0x7f170c199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170affd640 1 -- 172.21.15.148:0/2729617258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c19b8a0 con 0x7f170c1068e0 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.588+0000 7f170affd640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1068e0 0x7f170c19a570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f170000c920 tx=0x7f170000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.589+0000 7f1708ff9640 1 -- 172.21.15.148:0/2729617258 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700007c70 con 0x7f170c1068e0 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.589+0000 7f1708ff9640 1 -- 172.21.15.148:0/2729617258 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1700007e10 con 0x7f170c1068e0 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.589+0000 7f1711cd5640 1 -- 172.21.15.148:0/2729617258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170c19bb90 con 0x7f170c1068e0 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.589+0000 7f1708ff9640 1 -- 172.21.15.148:0/2729617258 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700018720 con 0x7f170c1068e0 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.589+0000 7f1711cd5640 1 -- 172.21.15.148:0/2729617258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170c1a2320 con 0x7f170c1068e0 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.590+0000 7f1711cd5640 1 -- 172.21.15.148:0/2729617258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f170c0ffb00 con 0x7f170c1068e0 2024-09-21T01:06:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.591+0000 7f1708ff9640 1 -- 172.21.15.148:0/2729617258 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7f170000f450 con 0x7f170c1068e0 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.592+0000 7f1708ff9640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16f40b6500 0x7f16f40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.592+0000 7f170b7fe640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16f40b6500 0x7f16f40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.592+0000 7f1708ff9640 1 -- 172.21.15.148:0/2729617258 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f17000e59e0 con 0x7f170c1068e0 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.593+0000 7f170b7fe640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16f40b6500 0x7f16f40b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f16fc031440 tx=0x7f16fc009630 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.595+0000 7f1708ff9640 1 -- 172.21.15.148:0/2729617258 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1700014030 con 0x7f170c1068e0 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.785+0000 7f1711cd5640 1 -- 172.21.15.148:0/2729617258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f170c02e9e0 con 0x7f170c1068e0 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.793+0000 7f1708ff9640 1 -- 172.21.15.148:0/2729617258 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v26)=0 v26) ==== 106+0+0 (secure 0 0 0) 0x7f17000ae050 con 0x7f170c1068e0 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.795+0000 7f1711cd5640 1 -- 172.21.15.148:0/2729617258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16f40b6500 msgr2=0x7f16f40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.795+0000 7f1711cd5640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16f40b6500 0x7f16f40b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f16fc031440 tx=0x7f16fc009630 comp rx=0 tx=0).stop 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.795+0000 7f1711cd5640 1 -- 172.21.15.148:0/2729617258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1068e0 msgr2=0x7f170c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.795+0000 7f1711cd5640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1068e0 0x7f170c19a570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f170000c920 tx=0x7f170000cde0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.795+0000 7f1711cd5640 1 -- 172.21.15.148:0/2729617258 shutdown_connections 2024-09-21T01:06:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.795+0000 7f1711cd5640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16f40b6500 0x7f16f40b8a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.795+0000 7f1711cd5640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f170c1068e0 0x7f170c19a570 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.795+0000 7f1711cd5640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f170c109480 0x7f170c19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.795+0000 7f1711cd5640 1 --2- 172.21.15.148:0/2729617258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c06c660 0x7f170c199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.795+0000 7f1711cd5640 1 -- 172.21.15.148:0/2729617258 >> 172.21.15.148:0/2729617258 conn(0x7f170c0fdfe0 msgr2=0x7f170c104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.796+0000 7f1711cd5640 1 -- 172.21.15.148:0/2729617258 shutdown_connections 2024-09-21T01:06:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.796+0000 7f1711cd5640 1 -- 172.21.15.148:0/2729617258 wait complete. 2024-09-21T01:06:03.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.897+0000 7fcce9896640 1 -- 172.21.15.148:0/2109732629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fcce4063fc0 con 0x7fcce4108370 2024-09-21T01:06:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.903+0000 7fcce8894640 1 -- 172.21.15.148:0/2109732629 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v27)=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7fccdc0ae2e0 con 0x7fcce4108370 2024-09-21T01:06:03.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.905+0000 7fcce9896640 1 -- 172.21.15.148:0/2109732629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcccc0b6480 msgr2=0x7fcccc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.905+0000 7fcce9896640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcccc0b6480 0x7fcccc0b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009bd0 tx=0x7fccd4005f90 comp rx=0 tx=0).stop 2024-09-21T01:06:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.905+0000 7fcce9896640 1 -- 172.21.15.148:0/2109732629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce4108370 msgr2=0x7fcce41a11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.905+0000 7fcce9896640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce4108370 0x7fcce41a11a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00cce0 tx=0x7fccdc00a620 comp rx=0 tx=0).stop 2024-09-21T01:06:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.906+0000 7fcce9896640 1 -- 172.21.15.148:0/2109732629 shutdown_connections 2024-09-21T01:06:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.906+0000 7fcce9896640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcccc0b6480 0x7fcccc0b8990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.906+0000 7fcce9896640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce4108370 0x7fcce41a11a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.906+0000 7fcce9896640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcce4105750 0x7fcce419ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.906+0000 7fcce9896640 1 --2- 172.21.15.148:0/2109732629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcce4102c90 0x7fcce41021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.906+0000 7fcce9896640 1 -- 172.21.15.148:0/2109732629 >> 172.21.15.148:0/2109732629 conn(0x7fcce40fd770 msgr2=0x7fcce4103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.906+0000 7fcce9896640 1 -- 172.21.15.148:0/2109732629 shutdown_connections 2024-09-21T01:06:03.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:03.906+0000 7fcce9896640 1 -- 172.21.15.148:0/2109732629 wait complete. 2024-09-21T01:06:03.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:03 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:03.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:03 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:03.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:03 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:03.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:03 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1376009529' entity='client.admin' 2024-09-21T01:06:03.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:03 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:03.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:03 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:03.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:03 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:03.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:03 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1376009529' entity='client.admin' 2024-09-21T01:06:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:04.989 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:04 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2729617258' entity='client.admin' 2024-09-21T01:06:04.990 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:04 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2109732629' entity='client.admin' 2024-09-21T01:06:04.990 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:04 smithi148 ceph-mon[31000]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:04.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.988+0000 7f25f518c640 1 -- 172.21.15.148:0/3232676908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0105180 msgr2=0x7f25f010bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:04.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.988+0000 7f25f518c640 1 --2- 172.21.15.148:0/3232676908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0105180 0x7f25f010bb20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009ca0 tx=0x7f25e802a950 comp rx=0 tx=0).stop 2024-09-21T01:06:04.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.988+0000 7f25f518c640 1 -- 172.21.15.148:0/3232676908 shutdown_connections 2024-09-21T01:06:04.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.988+0000 7f25f518c640 1 --2- 172.21.15.148:0/3232676908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0105180 0x7f25f010bb20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.988+0000 7f25f518c640 1 --2- 172.21.15.148:0/3232676908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f01047e0 0x7f25f0104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.988+0000 7f25f518c640 1 --2- 172.21.15.148:0/3232676908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f0103750 0x7f25f0103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.988+0000 7f25f518c640 1 -- 172.21.15.148:0/3232676908 >> 172.21.15.148:0/3232676908 conn(0x7f25f00ff0e0 msgr2=0x7f25f0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.988+0000 7f25f518c640 1 -- 172.21.15.148:0/3232676908 shutdown_connections 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.988+0000 7f25f518c640 1 -- 172.21.15.148:0/3232676908 wait complete. 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.989+0000 7f25f518c640 1 Processor -- start 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.989+0000 7f25f518c640 1 -- start start 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.989+0000 7f25f518c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f0103750 0x7f25f0076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.989+0000 7f25f518c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f01047e0 0x7f25f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.989+0000 7f25f518c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f0105180 0x7f25f0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.989+0000 7f25f518c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f25f010f240 con 0x7f25f01047e0 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.989+0000 7f25f518c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f25f010f0c0 con 0x7f25f0103750 2024-09-21T01:06:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.989+0000 7f25f518c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f25f010f3c0 con 0x7f25f0105180 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25ee59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f01047e0 0x7f25f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25ee59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f01047e0 0x7f25f0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39546/0 (socket says 172.21.15.148:39546) 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25ee59c640 1 -- 172.21.15.148:0/762287588 learned_addr learned my addr 172.21.15.148:0/762287588 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25eed9d640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f0103750 0x7f25f0076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25ef59e640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f0105180 0x7f25f0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25ee59c640 1 -- 172.21.15.148:0/762287588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f0105180 msgr2=0x7f25f0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25ee59c640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f0105180 0x7f25f0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25ee59c640 1 -- 172.21.15.148:0/762287588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f0103750 msgr2=0x7f25f0076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25ee59c640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f0103750 0x7f25f0076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25ee59c640 1 -- 172.21.15.148:0/762287588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f00762c0 con 0x7f25f01047e0 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25ee59c640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f01047e0 0x7f25f0075710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f25e400d950 tx=0x7f25e400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25d7fff640 1 -- 172.21.15.148:0/762287588 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4017070 con 0x7f25f01047e0 2024-09-21T01:06:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25d7fff640 1 -- 172.21.15.148:0/762287588 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f25e400de80 con 0x7f25f01047e0 2024-09-21T01:06:04.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25f518c640 1 -- 172.21.15.148:0/762287588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f01a3f00 con 0x7f25f01047e0 2024-09-21T01:06:04.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25d7fff640 1 -- 172.21.15.148:0/762287588 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e400f620 con 0x7f25f01047e0 2024-09-21T01:06:04.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.990+0000 7f25f518c640 1 -- 172.21.15.148:0/762287588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f01a42a0 con 0x7f25f01047e0 2024-09-21T01:06:04.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.992+0000 7f25f518c640 1 -- 172.21.15.148:0/762287588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f010fa00 con 0x7f25f01047e0 2024-09-21T01:06:04.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.994+0000 7f25d7fff640 1 -- 172.21.15.148:0/762287588 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7f25e4005030 con 0x7f25f01047e0 2024-09-21T01:06:04.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.995+0000 7f25d7fff640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25d80b6480 0x7f25d80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:04.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.995+0000 7f25eed9d640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25d80b6480 0x7f25d80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:04.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.995+0000 7f25d7fff640 1 -- 172.21.15.148:0/762287588 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f25e40e5170 con 0x7f25f01047e0 2024-09-21T01:06:04.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.995+0000 7f25eed9d640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25d80b6480 0x7f25d80b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f25e000abe0 tx=0x7f25e000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:04.998+0000 7f25d7fff640 1 -- 172.21.15.148:0/762287588 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25e40ad6d0 con 0x7f25f01047e0 2024-09-21T01:06:05.095 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:05.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.187+0000 7f25f518c640 1 -- 172.21.15.148:0/762287588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f25f0103bc0 con 0x7f25f01047e0 2024-09-21T01:06:05.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.193+0000 7f25d7fff640 1 -- 172.21.15.148:0/762287588 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v28)=0 v28) ==== 123+0+0 (secure 0 0 0) 0x7f25f0103bc0 con 0x7f25f01047e0 2024-09-21T01:06:05.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.194+0000 7f25d7fff640 1 -- 172.21.15.148:0/762287588 <== mon.0 v2:172.21.15.148:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25e40acae0 con 0x7f25f01047e0 2024-09-21T01:06:05.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 -- 172.21.15.148:0/762287588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25d80b6480 msgr2=0x7f25d80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25d80b6480 0x7f25d80b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f25e000abe0 tx=0x7f25e000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 -- 172.21.15.148:0/762287588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f01047e0 msgr2=0x7f25f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f01047e0 0x7f25f0075710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f25e400d950 tx=0x7f25e400dd50 comp rx=0 tx=0).stop 2024-09-21T01:06:05.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 -- 172.21.15.148:0/762287588 shutdown_connections 2024-09-21T01:06:05.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25d80b6480 0x7f25d80b8990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f01047e0 0x7f25f0075710 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f0105180 0x7f25f0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 --2- 172.21.15.148:0/762287588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f0103750 0x7f25f0076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 -- 172.21.15.148:0/762287588 >> 172.21.15.148:0/762287588 conn(0x7f25f00ff0e0 msgr2=0x7f25f0107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 -- 172.21.15.148:0/762287588 shutdown_connections 2024-09-21T01:06:05.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.196+0000 7f25f518c640 1 -- 172.21.15.148:0/762287588 wait complete. 2024-09-21T01:06:05.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:04 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2729617258' entity='client.admin' 2024-09-21T01:06:05.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:04 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2109732629' entity='client.admin' 2024-09-21T01:06:05.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:04 smithi181 ceph-mon[34811]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:05.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:04 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2729617258' entity='client.admin' 2024-09-21T01:06:05.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:04 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2109732629' entity='client.admin' 2024-09-21T01:06:05.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:04 smithi157 ceph-mon[34140]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:05.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 -- 172.21.15.148:0/1930490275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cc0102640 msgr2=0x7f9cc0102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 --2- 172.21.15.148:0/1930490275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cc0102640 0x7f9cc0102ab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009900 tx=0x7f9cb002a480 comp rx=0 tx=0).stop 2024-09-21T01:06:05.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 -- 172.21.15.148:0/1930490275 shutdown_connections 2024-09-21T01:06:05.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 --2- 172.21.15.148:0/1930490275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cc0104070 0x7f9cc010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 --2- 172.21.15.148:0/1930490275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc01036d0 0x7f9cc0103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 --2- 172.21.15.148:0/1930490275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cc0102640 0x7f9cc0102ab0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 -- 172.21.15.148:0/1930490275 >> 172.21.15.148:0/1930490275 conn(0x7f9cc00fdfb0 msgr2=0x7f9cc0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 -- 172.21.15.148:0/1930490275 shutdown_connections 2024-09-21T01:06:05.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 -- 172.21.15.148:0/1930490275 wait complete. 2024-09-21T01:06:05.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 Processor -- start 2024-09-21T01:06:05.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.436+0000 7f9cc66d0640 1 -- start start 2024-09-21T01:06:05.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc66d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc0102640 0x7f9cc006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc66d0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cc01036d0 0x7f9cc019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc66d0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cc0104070 0x7f9cc01a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc66d0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc010e2d0 con 0x7f9cc0104070 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc66d0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc010e150 con 0x7f9cc01036d0 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc66d0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc010e450 con 0x7f9cc0102640 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc4c6d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cc0104070 0x7f9cc01a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc4c6d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cc0104070 0x7f9cc01a1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39594/0 (socket says 172.21.15.148:39594) 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc4c6d640 1 -- 172.21.15.148:0/3558979107 learned_addr learned my addr 172.21.15.148:0/3558979107 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cbffff640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc0102640 0x7f9cc006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cb7fff640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cc01036d0 0x7f9cc019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc4c6d640 1 -- 172.21.15.148:0/3558979107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc0102640 msgr2=0x7f9cc006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc4c6d640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc0102640 0x7f9cc006b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc4c6d640 1 -- 172.21.15.148:0/3558979107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cc01036d0 msgr2=0x7f9cc019ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc4c6d640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cc01036d0 0x7f9cc019ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc4c6d640 1 -- 172.21.15.148:0/3558979107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc01a1a60 con 0x7f9cc0104070 2024-09-21T01:06:05.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cbffff640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc0102640 0x7f9cc006b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:05.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.437+0000 7f9cc4c6d640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cc0104070 0x7f9cc01a1260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800eaa0 tx=0x7f9cb800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.438+0000 7f9cbdffb640 1 -- 172.21.15.148:0/3558979107 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb800cdb0 con 0x7f9cc0104070 2024-09-21T01:06:05.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.438+0000 7f9cbdffb640 1 -- 172.21.15.148:0/3558979107 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cb8005020 con 0x7f9cc0104070 2024-09-21T01:06:05.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.438+0000 7f9cc66d0640 1 -- 172.21.15.148:0/3558979107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc01a1d50 con 0x7f9cc0104070 2024-09-21T01:06:05.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.438+0000 7f9cbdffb640 1 -- 172.21.15.148:0/3558979107 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80116d0 con 0x7f9cc0104070 2024-09-21T01:06:05.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.438+0000 7f9cc66d0640 1 -- 172.21.15.148:0/3558979107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc01a2180 con 0x7f9cc0104070 2024-09-21T01:06:05.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.439+0000 7f9cc66d0640 1 -- 172.21.15.148:0/3558979107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc0109820 con 0x7f9cc0104070 2024-09-21T01:06:05.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.440+0000 7f9cbdffb640 1 -- 172.21.15.148:0/3558979107 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7f9cb80051d0 con 0x7f9cc0104070 2024-09-21T01:06:05.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.441+0000 7f9cbdffb640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9cac0b6480 0x7f9cac0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.441+0000 7f9cbffff640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9cac0b6480 0x7f9cac0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.441+0000 7f9cbdffb640 1 -- 172.21.15.148:0/3558979107 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9cb80e5750 con 0x7f9cc0104070 2024-09-21T01:06:05.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.442+0000 7f9cbffff640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9cac0b6480 0x7f9cac0b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0004770 tx=0x7f9cb00314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.445+0000 7f9cbdffb640 1 -- 172.21.15.148:0/3558979107 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cb8016030 con 0x7f9cc0104070 2024-09-21T01:06:05.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.637+0000 7f9cc66d0640 1 -- 172.21.15.148:0/3558979107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f9cc002e640 con 0x7f9cc0104070 2024-09-21T01:06:05.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.643+0000 7f9cbdffb640 1 -- 172.21.15.148:0/3558979107 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v30)=0 v30) ==== 116+0+0 (secure 0 0 0) 0x7f9cb80b2090 con 0x7f9cc0104070 2024-09-21T01:06:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.645+0000 7f9cc66d0640 1 -- 172.21.15.148:0/3558979107 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9cac0b6480 msgr2=0x7f9cac0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.645+0000 7f9cc66d0640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9cac0b6480 0x7f9cac0b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0004770 tx=0x7f9cb00314a0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.645+0000 7f9cc66d0640 1 -- 172.21.15.148:0/3558979107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cc0104070 msgr2=0x7f9cc01a1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.645+0000 7f9cc66d0640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cc0104070 0x7f9cc01a1260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800eaa0 tx=0x7f9cb800ef60 comp rx=0 tx=0).stop 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.646+0000 7f9cc66d0640 1 -- 172.21.15.148:0/3558979107 shutdown_connections 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.646+0000 7f9cc66d0640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9cac0b6480 0x7f9cac0b8990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.646+0000 7f9cc66d0640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cc0104070 0x7f9cc01a1260 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.646+0000 7f9cc66d0640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cc01036d0 0x7f9cc019ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.646+0000 7f9cc66d0640 1 --2- 172.21.15.148:0/3558979107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc0102640 0x7f9cc006b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.646+0000 7f9cc66d0640 1 -- 172.21.15.148:0/3558979107 >> 172.21.15.148:0/3558979107 conn(0x7f9cc00fdfb0 msgr2=0x7f9cc01069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.646+0000 7f9cc66d0640 1 -- 172.21.15.148:0/3558979107 shutdown_connections 2024-09-21T01:06:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.646+0000 7f9cc66d0640 1 -- 172.21.15.148:0/3558979107 wait complete. 2024-09-21T01:06:05.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.292+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2116150794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7dc103750 msgr2=0x7fa7dc103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.292+0000 7fa7e10e1640 1 --2- 172.21.15.148:0/2116150794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7dc103750 0x7fa7dc103bc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009900 tx=0x7fa7cc02a480 comp rx=0 tx=0).stop 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.292+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2116150794 shutdown_connections 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.292+0000 7fa7e10e1640 1 --2- 172.21.15.148:0/2116150794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7dc105180 0x7fa7dc10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.292+0000 7fa7e10e1640 1 --2- 172.21.15.148:0/2116150794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc1047e0 0x7fa7dc104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.292+0000 7fa7e10e1640 1 --2- 172.21.15.148:0/2116150794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7dc103750 0x7fa7dc103bc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.292+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2116150794 >> 172.21.15.148:0/2116150794 conn(0x7fa7dc0ff0c0 msgr2=0x7fa7dc101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.293+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2116150794 shutdown_connections 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.293+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2116150794 wait complete. 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.293+0000 7fa7e10e1640 1 Processor -- start 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7e10e1640 1 -- start start 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7e10e1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7dc103750 0x7fa7dc199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7e10e1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc1047e0 0x7fa7dc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7e10e1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7dc105180 0x7fa7dc19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7e10e1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc10f390 con 0x7fa7dc103750 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7e10e1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc10f210 con 0x7fa7dc105180 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7e10e1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc10f510 con 0x7fa7dc1047e0 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7dad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7dc103750 0x7fa7dc199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7dad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7dc103750 0x7fa7dc199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39568/0 (socket says 172.21.15.148:39568) 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7dad9d640 1 -- 172.21.15.148:0/2104562871 learned_addr learned my addr 172.21.15.148:0/2104562871 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7db59e640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7dc105180 0x7fa7dc19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7da59c640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc1047e0 0x7fa7dc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7dad9d640 1 -- 172.21.15.148:0/2104562871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc1047e0 msgr2=0x7fa7dc19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7dad9d640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc1047e0 0x7fa7dc19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7dad9d640 1 -- 172.21.15.148:0/2104562871 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7dc105180 msgr2=0x7fa7dc19b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7dad9d640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7dc105180 0x7fa7dc19b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7dad9d640 1 -- 172.21.15.148:0/2104562871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc19b9f0 con 0x7fa7dc103750 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.294+0000 7fa7da59c640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc1047e0 0x7fa7dc19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.295+0000 7fa7dad9d640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7dc103750 0x7fa7dc199fc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc006010 tx=0x7fa7cc004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.295+0000 7fa7c3fff640 1 -- 172.21.15.148:0/2104562871 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc03f030 con 0x7fa7dc103750 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.295+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2104562871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7dc19bc80 con 0x7fa7dc103750 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.295+0000 7fa7c3fff640 1 -- 172.21.15.148:0/2104562871 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7cc003cb0 con 0x7fa7dc103750 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.295+0000 7fa7c3fff640 1 -- 172.21.15.148:0/2104562871 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc035070 con 0x7fa7dc103750 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.295+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2104562871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7dc1a2210 con 0x7fa7dc103750 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.296+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2104562871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7dc10a930 con 0x7fa7dc103750 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.297+0000 7fa7c3fff640 1 -- 172.21.15.148:0/2104562871 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7fa7cc042030 con 0x7fa7dc103750 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.298+0000 7fa7c3fff640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7c40b6480 0x7fa7c40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.298+0000 7fa7da59c640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7c40b6480 0x7fa7c40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.298+0000 7fa7c3fff640 1 -- 172.21.15.148:0/2104562871 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa7cc106320 con 0x7fa7dc103750 2024-09-21T01:06:05.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.299+0000 7fa7da59c640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7c40b6480 0x7fa7c40b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009b40 tx=0x7fa7d0005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.301+0000 7fa7c3fff640 1 -- 172.21.15.148:0/2104562871 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7cc0ce880 con 0x7fa7dc103750 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.490+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2104562871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fa7dc02e640 con 0x7fa7dc103750 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.496+0000 7fa7c3fff640 1 -- 172.21.15.148:0/2104562871 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7fa7cc0d2c60 con 0x7fa7dc103750 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.499+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2104562871 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7c40b6480 msgr2=0x7fa7c40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.499+0000 7fa7e10e1640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7c40b6480 0x7fa7c40b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009b40 tx=0x7fa7d0005e50 comp rx=0 tx=0).stop 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.499+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2104562871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7dc103750 msgr2=0x7fa7dc199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.499+0000 7fa7e10e1640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7dc103750 0x7fa7dc199fc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc006010 tx=0x7fa7cc004340 comp rx=0 tx=0).stop 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.499+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2104562871 shutdown_connections 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.499+0000 7fa7e10e1640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7c40b6480 0x7fa7c40b8990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.499+0000 7fa7e10e1640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7dc105180 0x7fa7dc19b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.500+0000 7fa7e10e1640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc1047e0 0x7fa7dc19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.500+0000 7fa7e10e1640 1 --2- 172.21.15.148:0/2104562871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7dc103750 0x7fa7dc199fc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.500+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2104562871 >> 172.21.15.148:0/2104562871 conn(0x7fa7dc0ff0c0 msgr2=0x7fa7dc107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.500+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2104562871 shutdown_connections 2024-09-21T01:06:05.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:05.500+0000 7fa7e10e1640 1 -- 172.21.15.148:0/2104562871 wait complete. 2024-09-21T01:06:06.247 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:06 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/762287588' entity='client.admin' 2024-09-21T01:06:06.247 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:06 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2104562871' entity='client.admin' 2024-09-21T01:06:06.247 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:06.247 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:06.247 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:06.247 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:06.247 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:06 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3558979107' entity='client.admin' 2024-09-21T01:06:06.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:06 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/762287588' entity='client.admin' 2024-09-21T01:06:06.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:06 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2104562871' entity='client.admin' 2024-09-21T01:06:06.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:06.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:06.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:06.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:06.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:06 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3558979107' entity='client.admin' 2024-09-21T01:06:06.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:06 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/762287588' entity='client.admin' 2024-09-21T01:06:06.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:06 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2104562871' entity='client.admin' 2024-09-21T01:06:06.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:06.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:06.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:06.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:06.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:06 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3558979107' entity='client.admin' 2024-09-21T01:06:07.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:07 smithi148 ceph-mon[31000]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:07.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:07 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/694592810' entity='client.admin' 2024-09-21T01:06:07.691 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:07 smithi181 ceph-mon[34811]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:07.691 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:07 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/694592810' entity='client.admin' 2024-09-21T01:06:07.698 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:07 smithi157 ceph-mon[34140]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:07.698 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:07 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/694592810' entity='client.admin' 2024-09-21T01:06:08.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.913+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/439099611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4b41036d0 msgr2=0x7fd4b4103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:08.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.913+0000 7fd4bb1fc640 1 --2- 172.21.15.148:0/439099611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4b41036d0 0x7fd4b4103ae0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009900 tx=0x7fd4a002a480 comp rx=0 tx=0).stop 2024-09-21T01:06:08.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.913+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/439099611 shutdown_connections 2024-09-21T01:06:08.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.913+0000 7fd4bb1fc640 1 --2- 172.21.15.148:0/439099611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4b41036d0 0x7fd4b4103ae0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.913+0000 7fd4bb1fc640 1 --2- 172.21.15.148:0/439099611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4b4104070 0x7fd4b410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.913+0000 7fd4bb1fc640 1 --2- 172.21.15.148:0/439099611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4102640 0x7fd4b4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.913+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/439099611 >> 172.21.15.148:0/439099611 conn(0x7fd4b40fdfb0 msgr2=0x7fd4b4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:08.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.913+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/439099611 shutdown_connections 2024-09-21T01:06:08.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.913+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/439099611 wait complete. 2024-09-21T01:06:08.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.913+0000 7fd4bb1fc640 1 Processor -- start 2024-09-21T01:06:08.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4bb1fc640 1 -- start start 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4bb1fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4102640 0x7fd4b406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4bb1fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4b41036d0 0x7fd4b419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4bb1fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4b4104070 0x7fd4b41a1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4bb1fc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b410e1b0 con 0x7fd4b4104070 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4bb1fc640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b410e030 con 0x7fd4b4102640 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4bb1fc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b410e330 con 0x7fd4b41036d0 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b9799640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4b4104070 0x7fd4b41a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b9799640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4b4104070 0x7fd4b41a1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39460/0 (socket says 172.21.15.148:39460) 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b9799640 1 -- 172.21.15.148:0/2769745889 learned_addr learned my addr 172.21.15.148:0/2769745889 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b8f98640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4102640 0x7fd4b406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b3fff640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4b41036d0 0x7fd4b419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b9799640 1 -- 172.21.15.148:0/2769745889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4b41036d0 msgr2=0x7fd4b419ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:08.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b9799640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4b41036d0 0x7fd4b419ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b9799640 1 -- 172.21.15.148:0/2769745889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4102640 msgr2=0x7fd4b406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b9799640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4102640 0x7fd4b406b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b9799640 1 -- 172.21.15.148:0/2769745889 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b41a1a00 con 0x7fd4b4104070 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b9799640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4b4104070 0x7fd4b41a1200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00b970 tx=0x7fd4ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.914+0000 7fd4b1ffb640 1 -- 172.21.15.148:0/2769745889 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac019070 con 0x7fd4b4104070 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.915+0000 7fd4b1ffb640 1 -- 172.21.15.148:0/2769745889 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd4ac014440 con 0x7fd4b4104070 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.915+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/2769745889 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b41a1cf0 con 0x7fd4b4104070 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.915+0000 7fd4b1ffb640 1 -- 172.21.15.148:0/2769745889 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0075d0 con 0x7fd4b4104070 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.915+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/2769745889 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b41a2200 con 0x7fd4b4104070 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.916+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/2769745889 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b4102ab0 con 0x7fd4b4104070 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.917+0000 7fd4b1ffb640 1 -- 172.21.15.148:0/2769745889 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7fd4ac01c070 con 0x7fd4b4104070 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.918+0000 7fd4b1ffb640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4a40b6500 0x7fd4a40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:08.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.918+0000 7fd4b8f98640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4a40b6500 0x7fd4a40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.918+0000 7fd4b1ffb640 1 -- 172.21.15.148:0/2769745889 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd4ac0e4a80 con 0x7fd4b4104070 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.918+0000 7fd4b8f98640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4a40b6500 0x7fd4a40b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800bbe0 tx=0x7fd4a800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:00.922+0000 7fd4b1ffb640 1 -- 172.21.15.148:0/2769745889 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4ac0b13c0 con 0x7fd4b4104070 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.103+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/2769745889 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fd4b4063fc0 con 0x7fd4b4104070 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.107+0000 7fd4b1ffb640 1 -- 172.21.15.148:0/2769745889 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v23)=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7fd4ac0b6300 con 0x7fd4b4104070 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/2769745889 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4a40b6500 msgr2=0x7fd4a40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4a40b6500 0x7fd4a40b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800bbe0 tx=0x7fd4a800b390 comp rx=0 tx=0).stop 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/2769745889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4b4104070 msgr2=0x7fd4b41a1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4b4104070 0x7fd4b41a1200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00b970 tx=0x7fd4ac00be30 comp rx=0 tx=0).stop 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/2769745889 shutdown_connections 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4a40b6500 0x7fd4a40b8a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4b4104070 0x7fd4b41a1200 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4b41036d0 0x7fd4b419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 --2- 172.21.15.148:0/2769745889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4102640 0x7fd4b406b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/2769745889 >> 172.21.15.148:0/2769745889 conn(0x7fd4b40fdfb0 msgr2=0x7fd4b41069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:08.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/2769745889 shutdown_connections 2024-09-21T01:06:08.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:01.110+0000 7fd4bb1fc640 1 -- 172.21.15.148:0/2769745889 wait complete. 2024-09-21T01:06:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.053+0000 7fb64038b640 1 -- 172.21.15.148:0/1146676039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6381036d0 msgr2=0x7fb638103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.053+0000 7fb64038b640 1 --2- 172.21.15.148:0/1146676039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6381036d0 0x7fb638103ae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009ca0 tx=0x7fb62c02a950 comp rx=0 tx=0).stop 2024-09-21T01:06:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.053+0000 7fb64038b640 1 -- 172.21.15.148:0/1146676039 shutdown_connections 2024-09-21T01:06:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.053+0000 7fb64038b640 1 --2- 172.21.15.148:0/1146676039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6381036d0 0x7fb638103ae0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.053+0000 7fb64038b640 1 --2- 172.21.15.148:0/1146676039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb638104070 0x7fb63810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.053+0000 7fb64038b640 1 --2- 172.21.15.148:0/1146676039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb638102640 0x7fb638102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.053+0000 7fb64038b640 1 -- 172.21.15.148:0/1146676039 >> 172.21.15.148:0/1146676039 conn(0x7fb6380fdfb0 msgr2=0x7fb638100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.053+0000 7fb64038b640 1 -- 172.21.15.148:0/1146676039 shutdown_connections 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.053+0000 7fb64038b640 1 -- 172.21.15.148:0/1146676039 wait complete. 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb64038b640 1 Processor -- start 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb64038b640 1 -- start start 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb64038b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb638102640 0x7fb638199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb64038b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6381036d0 0x7fb63819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb64038b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb638104070 0x7fb63819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb64038b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb63810e290 con 0x7fb638102640 2024-09-21T01:06:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb64038b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb63810e110 con 0x7fb6381036d0 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb64038b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb63810e410 con 0x7fb638104070 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63e127640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb638102640 0x7fb638199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63e127640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb638102640 0x7fb638199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39614/0 (socket says 172.21.15.148:39614) 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63e127640 1 -- 172.21.15.148:0/694592810 learned_addr learned my addr 172.21.15.148:0/694592810 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63d926640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6381036d0 0x7fb63819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63e127640 1 -- 172.21.15.148:0/694592810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb638104070 msgr2=0x7fb63819b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63e928640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb638104070 0x7fb63819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63e127640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb638104070 0x7fb63819b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63e127640 1 -- 172.21.15.148:0/694592810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6381036d0 msgr2=0x7fb63819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63e127640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6381036d0 0x7fb63819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63e127640 1 -- 172.21.15.148:0/694592810 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63819b9f0 con 0x7fb638102640 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.054+0000 7fb63d926640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6381036d0 0x7fb63819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:06:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.055+0000 7fb63e127640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb638102640 0x7fb638199fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c970 tx=0x7fb63000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.055+0000 7fb6377fe640 1 -- 172.21.15.148:0/694592810 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630007bb0 con 0x7fb638102640 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.055+0000 7fb6377fe640 1 -- 172.21.15.148:0/694592810 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb630007d50 con 0x7fb638102640 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.055+0000 7fb64038b640 1 -- 172.21.15.148:0/694592810 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63819bce0 con 0x7fb638102640 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.055+0000 7fb6377fe640 1 -- 172.21.15.148:0/694592810 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63000f450 con 0x7fb638102640 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.055+0000 7fb64038b640 1 -- 172.21.15.148:0/694592810 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6381a23e0 con 0x7fb638102640 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.056+0000 7fb64038b640 1 -- 172.21.15.148:0/694592810 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6381a25b0 con 0x7fb638102640 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.057+0000 7fb6377fe640 1 -- 172.21.15.148:0/694592810 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7fb630004f00 con 0x7fb638102640 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.058+0000 7fb6377fe640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb6200b6480 0x7fb6200b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.058+0000 7fb63d926640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb6200b6480 0x7fb6200b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.058+0000 7fb6377fe640 1 -- 172.21.15.148:0/694592810 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb6300e57d0 con 0x7fb638102640 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.059+0000 7fb63d926640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb6200b6480 0x7fb6200b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb62c006010 tx=0x7fb62c009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.061+0000 7fb6377fe640 1 -- 172.21.15.148:0/694592810 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb630014030 con 0x7fb638102640 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.246+0000 7fb64038b640 1 -- 172.21.15.148:0/694592810 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb6381a2780 con 0x7fb638102640 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.250+0000 7fb6377fe640 1 -- 172.21.15.148:0/694592810 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v31)=0 v31) ==== 120+0+0 (secure 0 0 0) 0x7fb6300add30 con 0x7fb638102640 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 -- 172.21.15.148:0/694592810 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb6200b6480 msgr2=0x7fb6200b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb6200b6480 0x7fb6200b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb62c006010 tx=0x7fb62c009360 comp rx=0 tx=0).stop 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 -- 172.21.15.148:0/694592810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb638102640 msgr2=0x7fb638199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb638102640 0x7fb638199fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c970 tx=0x7fb63000ce30 comp rx=0 tx=0).stop 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 -- 172.21.15.148:0/694592810 shutdown_connections 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb6200b6480 0x7fb6200b8990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb638104070 0x7fb63819b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6381036d0 0x7fb63819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 --2- 172.21.15.148:0/694592810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb638102640 0x7fb638199fc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 -- 172.21.15.148:0/694592810 >> 172.21.15.148:0/694592810 conn(0x7fb6380fdfb0 msgr2=0x7fb6380ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 -- 172.21.15.148:0/694592810 shutdown_connections 2024-09-21T01:06:08.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:06.252+0000 7fb64038b640 1 -- 172.21.15.148:0/694592810 wait complete. 2024-09-21T01:06:08.893 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:09.509 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:09 smithi148 ceph-mon[31000]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:09.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:09 smithi181 ceph-mon[34811]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:09.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:09 smithi157 ceph-mon[34140]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:10.485 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:10 smithi148 ceph-mon[31000]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:10.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:10 smithi181 ceph-mon[34811]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:10.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:10 smithi157 ceph-mon[34140]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.075+0000 7f9326444640 1 -- 172.21.15.148:0/1158271093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9320101b00 msgr2=0x7f9320101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.075+0000 7f9326444640 1 --2- 172.21.15.148:0/1158271093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9320101b00 0x7f9320101f10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9310009900 tx=0x7f931002a410 comp rx=0 tx=0).stop 2024-09-21T01:06:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.075+0000 7f9326444640 1 -- 172.21.15.148:0/1158271093 shutdown_connections 2024-09-21T01:06:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.075+0000 7f9326444640 1 --2- 172.21.15.148:0/1158271093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9320109500 0x7f932010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.075+0000 7f9326444640 1 --2- 172.21.15.148:0/1158271093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9320106ba0 0x7f9320108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.075+0000 7f9326444640 1 --2- 172.21.15.148:0/1158271093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9320101b00 0x7f9320101f10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.075+0000 7f9326444640 1 -- 172.21.15.148:0/1158271093 >> 172.21.15.148:0/1158271093 conn(0x7f93200fd770 msgr2=0x7f93200ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.075+0000 7f9326444640 1 -- 172.21.15.148:0/1158271093 shutdown_connections 2024-09-21T01:06:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.075+0000 7f9326444640 1 -- 172.21.15.148:0/1158271093 wait complete. 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f9326444640 1 Processor -- start 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f9326444640 1 -- start start 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f9326444640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9320101b00 0x7f932019a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f9326444640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9320106ba0 0x7f932019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f9326444640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9320109500 0x7f932019b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f9326444640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f932010f380 con 0x7f9320109500 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f9326444640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f932010f200 con 0x7f9320101b00 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f9326444640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f932010f500 con 0x7f9320106ba0 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f93249e1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9320109500 0x7f932019b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f93249e1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9320109500 0x7f932019b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52194/0 (socket says 172.21.15.148:52194) 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.076+0000 7f93249e1640 1 -- 172.21.15.148:0/3780109536 learned_addr learned my addr 172.21.15.148:0/3780109536 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f9317fff640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9320106ba0 0x7f932019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f931ffff640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9320101b00 0x7f932019a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f93249e1640 1 -- 172.21.15.148:0/3780109536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9320106ba0 msgr2=0x7f932019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f93249e1640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9320106ba0 0x7f932019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f93249e1640 1 -- 172.21.15.148:0/3780109536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9320101b00 msgr2=0x7f932019a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f93249e1640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9320101b00 0x7f932019a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f93249e1640 1 -- 172.21.15.148:0/3780109536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932019ba40 con 0x7f9320109500 2024-09-21T01:06:12.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f93249e1640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9320109500 0x7f932019b220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f931800eb10 tx=0x7f931800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:12.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f931dffb640 1 -- 172.21.15.148:0/3780109536 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318004b20 con 0x7f9320109500 2024-09-21T01:06:12.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f931dffb640 1 -- 172.21.15.148:0/3780109536 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9318004cc0 con 0x7f9320109500 2024-09-21T01:06:12.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f931dffb640 1 -- 172.21.15.148:0/3780109536 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318010670 con 0x7f9320109500 2024-09-21T01:06:12.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f9326444640 1 -- 172.21.15.148:0/3780109536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932019bd30 con 0x7f9320109500 2024-09-21T01:06:12.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.077+0000 7f9326444640 1 -- 172.21.15.148:0/3780109536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93201a2430 con 0x7f9320109500 2024-09-21T01:06:12.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.078+0000 7f9326444640 1 -- 172.21.15.148:0/3780109536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93200ff290 con 0x7f9320109500 2024-09-21T01:06:12.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.080+0000 7f931dffb640 1 -- 172.21.15.148:0/3780109536 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7f9318005000 con 0x7f9320109500 2024-09-21T01:06:12.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.081+0000 7f931dffb640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f930c0b6500 0x7f930c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.081+0000 7f931ffff640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f930c0b6500 0x7f930c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.081+0000 7f931dffb640 1 -- 172.21.15.148:0/3780109536 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f93180e5e10 con 0x7f9320109500 2024-09-21T01:06:12.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.081+0000 7f931ffff640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f930c0b6500 0x7f930c0b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9310031440 tx=0x7f93100314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.084+0000 7f931dffb640 1 -- 172.21.15.148:0/3780109536 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9318056710 con 0x7f9320109500 2024-09-21T01:06:12.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.268+0000 7f9326444640 1 -- 172.21.15.148:0/3780109536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f932002e640 con 0x7f9320109500 2024-09-21T01:06:12.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.272+0000 7f931dffb640 1 -- 172.21.15.148:0/3780109536 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v32)=0 v32) ==== 127+0+0 (secure 0 0 0) 0x7f93180ae370 con 0x7f9320109500 2024-09-21T01:06:12.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 -- 172.21.15.148:0/3780109536 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f930c0b6500 msgr2=0x7f930c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f930c0b6500 0x7f930c0b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9310031440 tx=0x7f93100314a0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 -- 172.21.15.148:0/3780109536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9320109500 msgr2=0x7f932019b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9320109500 0x7f932019b220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f931800eb10 tx=0x7f931800c2d0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 -- 172.21.15.148:0/3780109536 shutdown_connections 2024-09-21T01:06:12.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f930c0b6500 0x7f930c0b8a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9320109500 0x7f932019b220 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9320106ba0 0x7f932019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 --2- 172.21.15.148:0/3780109536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9320101b00 0x7f932019a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 -- 172.21.15.148:0/3780109536 >> 172.21.15.148:0/3780109536 conn(0x7f93200fd770 msgr2=0x7f9320107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:12.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 -- 172.21.15.148:0/3780109536 shutdown_connections 2024-09-21T01:06:12.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.275+0000 7f9326444640 1 -- 172.21.15.148:0/3780109536 wait complete. 2024-09-21T01:06:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.288+0000 7fc952ba9640 1 -- 172.21.15.148:0/281620515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc94c103720 msgr2=0x7fc94c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.288+0000 7fc952ba9640 1 --2- 172.21.15.148:0/281620515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc94c103720 0x7fc94c103b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc938009900 tx=0x7fc93802a480 comp rx=0 tx=0).stop 2024-09-21T01:06:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.289+0000 7fc952ba9640 1 -- 172.21.15.148:0/281620515 shutdown_connections 2024-09-21T01:06:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.289+0000 7fc952ba9640 1 --2- 172.21.15.148:0/281620515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc94c103720 0x7fc94c103b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.289+0000 7fc952ba9640 1 --2- 172.21.15.148:0/281620515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc94c1040c0 0x7fc94c10aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.289+0000 7fc952ba9640 1 --2- 172.21.15.148:0/281620515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c102690 0x7fc94c102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.289+0000 7fc952ba9640 1 -- 172.21.15.148:0/281620515 >> 172.21.15.148:0/281620515 conn(0x7fc94c0fe000 msgr2=0x7fc94c1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:12.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.289+0000 7fc952ba9640 1 -- 172.21.15.148:0/281620515 shutdown_connections 2024-09-21T01:06:12.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.289+0000 7fc952ba9640 1 -- 172.21.15.148:0/281620515 wait complete. 2024-09-21T01:06:12.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.290+0000 7fc952ba9640 1 Processor -- start 2024-09-21T01:06:12.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.290+0000 7fc952ba9640 1 -- start start 2024-09-21T01:06:12.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.290+0000 7fc952ba9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc94c102690 0x7fc94c06c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.290+0000 7fc952ba9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc94c103720 0x7fc94c19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.290+0000 7fc952ba9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c1040c0 0x7fc94c1a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.290+0000 7fc952ba9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c10e310 con 0x7fc94c103720 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.290+0000 7fc952ba9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c10e190 con 0x7fc94c1040c0 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.290+0000 7fc952ba9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c10e490 con 0x7fc94c102690 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc94bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc94c103720 0x7fc94c19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc94bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc94c103720 0x7fc94c19edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52212/0 (socket says 172.21.15.148:52212) 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc94bfff640 1 -- 172.21.15.148:0/960934494 learned_addr learned my addr 172.21.15.148:0/960934494 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc950945640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc94c102690 0x7fc94c06c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc951146640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c1040c0 0x7fc94c1a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc94bfff640 1 -- 172.21.15.148:0/960934494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc94c102690 msgr2=0x7fc94c06c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc94bfff640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc94c102690 0x7fc94c06c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc94bfff640 1 -- 172.21.15.148:0/960934494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c1040c0 msgr2=0x7fc94c1a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc94bfff640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c1040c0 0x7fc94c1a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc94bfff640 1 -- 172.21.15.148:0/960934494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94c1a1b00 con 0x7fc94c103720 2024-09-21T01:06:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc950945640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc94c102690 0x7fc94c06c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc951146640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c1040c0 0x7fc94c1a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.291+0000 7fc94bfff640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc94c103720 0x7fc94c19edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc938031440 tx=0x7fc938003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.292+0000 7fc949ffb640 1 -- 172.21.15.148:0/960934494 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93803f070 con 0x7fc94c103720 2024-09-21T01:06:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.292+0000 7fc949ffb640 1 -- 172.21.15.148:0/960934494 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc938031c50 con 0x7fc94c103720 2024-09-21T01:06:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.292+0000 7fc952ba9640 1 -- 172.21.15.148:0/960934494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc94c1a1d90 con 0x7fc94c103720 2024-09-21T01:06:12.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.292+0000 7fc949ffb640 1 -- 172.21.15.148:0/960934494 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938035030 con 0x7fc94c103720 2024-09-21T01:06:12.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.293+0000 7fc952ba9640 1 -- 172.21.15.148:0/960934494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc94c1a21b0 con 0x7fc94c103720 2024-09-21T01:06:12.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.294+0000 7fc952ba9640 1 -- 172.21.15.148:0/960934494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc94c109850 con 0x7fc94c103720 2024-09-21T01:06:12.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.295+0000 7fc949ffb640 1 -- 172.21.15.148:0/960934494 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7fc938042070 con 0x7fc94c103720 2024-09-21T01:06:12.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.296+0000 7fc949ffb640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc93c0b6500 0x7fc93c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.296+0000 7fc950945640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc93c0b6500 0x7fc93c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.296+0000 7fc949ffb640 1 -- 172.21.15.148:0/960934494 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc9381060a0 con 0x7fc94c103720 2024-09-21T01:06:12.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.297+0000 7fc950945640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc93c0b6500 0x7fc93c0b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc940009fc0 tx=0x7fc940005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:12.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.303+0000 7fc949ffb640 1 -- 172.21.15.148:0/960934494 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9380ce600 con 0x7fc94c103720 2024-09-21T01:06:12.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.488+0000 7fc952ba9640 1 -- 172.21.15.148:0/960934494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fc94c02e640 con 0x7fc94c103720 2024-09-21T01:06:12.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.488+0000 7fc949ffb640 1 -- 172.21.15.148:0/960934494 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v32)=0 v32) ==== 108+0+0 (secure 0 0 0) 0x7fc9380d29e0 con 0x7fc94c103720 2024-09-21T01:06:12.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 -- 172.21.15.148:0/960934494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc93c0b6500 msgr2=0x7fc93c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc93c0b6500 0x7fc93c0b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc940009fc0 tx=0x7fc940005f90 comp rx=0 tx=0).stop 2024-09-21T01:06:12.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 -- 172.21.15.148:0/960934494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc94c103720 msgr2=0x7fc94c19edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc94c103720 0x7fc94c19edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc938031440 tx=0x7fc938003c10 comp rx=0 tx=0).stop 2024-09-21T01:06:12.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 -- 172.21.15.148:0/960934494 shutdown_connections 2024-09-21T01:06:12.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc93c0b6500 0x7fc93c0b8a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc94c103720 0x7fc94c19edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c1040c0 0x7fc94c1a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 --2- 172.21.15.148:0/960934494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc94c102690 0x7fc94c06c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 -- 172.21.15.148:0/960934494 >> 172.21.15.148:0/960934494 conn(0x7fc94c0fe000 msgr2=0x7fc94c106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:12.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 -- 172.21.15.148:0/960934494 shutdown_connections 2024-09-21T01:06:12.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.491+0000 7fc952ba9640 1 -- 172.21.15.148:0/960934494 wait complete. 2024-09-21T01:06:12.544 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:12 smithi148 ceph-mon[31000]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:12.544 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:12 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3780109536' entity='client.admin' 2024-09-21T01:06:12.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.636+0000 7f9250f41640 1 -- 172.21.15.148:0/3721886296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f924c1036d0 msgr2=0x7f924c103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.636+0000 7f9250f41640 1 --2- 172.21.15.148:0/3721886296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f924c1036d0 0x7f924c103ae0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9240009ca0 tx=0x7f924002a950 comp rx=0 tx=0).stop 2024-09-21T01:06:12.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.636+0000 7f9250f41640 1 -- 172.21.15.148:0/3721886296 shutdown_connections 2024-09-21T01:06:12.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.636+0000 7f9250f41640 1 --2- 172.21.15.148:0/3721886296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f924c1036d0 0x7f924c103ae0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.636+0000 7f9250f41640 1 --2- 172.21.15.148:0/3721886296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f924c104070 0x7f924c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.636+0000 7f9250f41640 1 --2- 172.21.15.148:0/3721886296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f924c102640 0x7f924c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.636+0000 7f9250f41640 1 -- 172.21.15.148:0/3721886296 >> 172.21.15.148:0/3721886296 conn(0x7f924c0fdfd0 msgr2=0x7f924c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.636+0000 7f9250f41640 1 -- 172.21.15.148:0/3721886296 shutdown_connections 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.636+0000 7f9250f41640 1 -- 172.21.15.148:0/3721886296 wait complete. 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.637+0000 7f9250f41640 1 Processor -- start 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.637+0000 7f9250f41640 1 -- start start 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.637+0000 7f9250f41640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f924c102640 0x7f924c199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.637+0000 7f9250f41640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f924c1036d0 0x7f924c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.637+0000 7f9250f41640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f924c104070 0x7f924c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.637+0000 7f9250f41640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f924c10e270 con 0x7f924c104070 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.637+0000 7f9250f41640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f924c10e0f0 con 0x7f924c1036d0 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.637+0000 7f9250f41640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f924c10e3f0 con 0x7f924c102640 2024-09-21T01:06:12.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.637+0000 7f924ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f924c104070 0x7f924c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f924ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f924c104070 0x7f924c19b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52226/0 (socket says 172.21.15.148:52226) 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f924ad9d640 1 -- 172.21.15.148:0/3330103468 learned_addr learned my addr 172.21.15.148:0/3330103468 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f924a59c640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f924c102640 0x7f924c199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f9249d9b640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f924c1036d0 0x7f924c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f924ad9d640 1 -- 172.21.15.148:0/3330103468 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f924c102640 msgr2=0x7f924c199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f924ad9d640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f924c102640 0x7f924c199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f924ad9d640 1 -- 172.21.15.148:0/3330103468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f924c1036d0 msgr2=0x7f924c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f924ad9d640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f924c1036d0 0x7f924c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f924ad9d640 1 -- 172.21.15.148:0/3330103468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924c19b930 con 0x7f924c104070 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f924ad9d640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f924c104070 0x7f924c19b1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f923c00c970 tx=0x7f923c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f923b7fe640 1 -- 172.21.15.148:0/3330103468 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c007bb0 con 0x7f924c104070 2024-09-21T01:06:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f923b7fe640 1 -- 172.21.15.148:0/3330103468 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f923c007d50 con 0x7f924c104070 2024-09-21T01:06:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f9250f41640 1 -- 172.21.15.148:0/3330103468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924c19bc20 con 0x7f924c104070 2024-09-21T01:06:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f923b7fe640 1 -- 172.21.15.148:0/3330103468 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c018770 con 0x7f924c104070 2024-09-21T01:06:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.638+0000 7f9250f41640 1 -- 172.21.15.148:0/3330103468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924c1a23b0 con 0x7f924c104070 2024-09-21T01:06:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.639+0000 7f9250f41640 1 -- 172.21.15.148:0/3330103468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924c1a2580 con 0x7f924c104070 2024-09-21T01:06:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.641+0000 7f923b7fe640 1 -- 172.21.15.148:0/3330103468 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7f923c00f990 con 0x7f924c104070 2024-09-21T01:06:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.641+0000 7f923b7fe640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f92340b6480 0x7f92340b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.642+0000 7f924a59c640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f92340b6480 0x7f92340b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.642+0000 7f923b7fe640 1 -- 172.21.15.148:0/3330103468 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f923c0e58c0 con 0x7f924c104070 2024-09-21T01:06:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.642+0000 7f924a59c640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f92340b6480 0x7f92340b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9244005e10 tx=0x7f9244005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.645+0000 7f923b7fe640 1 -- 172.21.15.148:0/3330103468 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f923c056710 con 0x7f924c104070 2024-09-21T01:06:12.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:12 smithi181 ceph-mon[34811]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:12.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:12 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3780109536' entity='client.admin' 2024-09-21T01:06:12.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:12 smithi157 ceph-mon[34140]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:12.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:12 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3780109536' entity='client.admin' 2024-09-21T01:06:12.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.825+0000 7f9250f41640 1 -- 172.21.15.148:0/3330103468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f924c1a2750 con 0x7f924c104070 2024-09-21T01:06:12.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.829+0000 7f923b7fe640 1 -- 172.21.15.148:0/3330103468 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f923c0a7e20 con 0x7f924c104070 2024-09-21T01:06:12.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 -- 172.21.15.148:0/3330103468 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f92340b6480 msgr2=0x7f92340b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f92340b6480 0x7f92340b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9244005e10 tx=0x7f9244005da0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 -- 172.21.15.148:0/3330103468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f924c104070 msgr2=0x7f924c19b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:12.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f924c104070 0x7f924c19b1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f923c00c970 tx=0x7f923c00ce30 comp rx=0 tx=0).stop 2024-09-21T01:06:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 -- 172.21.15.148:0/3330103468 shutdown_connections 2024-09-21T01:06:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f92340b6480 0x7f92340b8990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f924c104070 0x7f924c19b1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f924c1036d0 0x7f924c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 --2- 172.21.15.148:0/3330103468 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f924c102640 0x7f924c199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 -- 172.21.15.148:0/3330103468 >> 172.21.15.148:0/3330103468 conn(0x7f924c0fdfd0 msgr2=0x7f924c0ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 -- 172.21.15.148:0/3330103468 shutdown_connections 2024-09-21T01:06:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:12.832+0000 7f9250f41640 1 -- 172.21.15.148:0/3330103468 wait complete. 2024-09-21T01:06:13.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi148') 2024-09-21T01:06:13.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi148') 2024-09-21T01:06:13.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi148') 2024-09-21T01:06:13.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi148') 2024-09-21T01:06:13.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi148') 2024-09-21T01:06:13.779 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi148') 2024-09-21T01:06:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.893+0000 7fbfb2467640 1 -- 172.21.15.148:0/1261311941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac1047e0 msgr2=0x7fbfac104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.893+0000 7fbfb2467640 1 --2- 172.21.15.148:0/1261311941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac1047e0 0x7fbfac104bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009900 tx=0x7fbf9402a480 comp rx=0 tx=0).stop 2024-09-21T01:06:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.893+0000 7fbfb2467640 1 -- 172.21.15.148:0/1261311941 shutdown_connections 2024-09-21T01:06:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.893+0000 7fbfb2467640 1 --2- 172.21.15.148:0/1261311941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac1047e0 0x7fbfac104bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.893+0000 7fbfb2467640 1 --2- 172.21.15.148:0/1261311941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfac105180 0x7fbfac10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.893+0000 7fbfb2467640 1 --2- 172.21.15.148:0/1261311941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfac103750 0x7fbfac103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.893+0000 7fbfb2467640 1 -- 172.21.15.148:0/1261311941 >> 172.21.15.148:0/1261311941 conn(0x7fbfac0ff0c0 msgr2=0x7fbfac101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.893+0000 7fbfb2467640 1 -- 172.21.15.148:0/1261311941 shutdown_connections 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.893+0000 7fbfb2467640 1 -- 172.21.15.148:0/1261311941 wait complete. 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.893+0000 7fbfb2467640 1 Processor -- start 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb2467640 1 -- start start 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb2467640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfac103750 0x7fbfac199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb2467640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfac1047e0 0x7fbfac19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb2467640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac105180 0x7fbfac19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb2467640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac10f380 con 0x7fbfac105180 2024-09-21T01:06:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb2467640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac10f200 con 0x7fbfac103750 2024-09-21T01:06:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb2467640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac10f500 con 0x7fbfac1047e0 2024-09-21T01:06:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb0a04640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac105180 0x7fbfac19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb0a04640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac105180 0x7fbfac19b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52188/0 (socket says 172.21.15.148:52188) 2024-09-21T01:06:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb0a04640 1 -- 172.21.15.148:0/549947375 learned_addr learned my addr 172.21.15.148:0/549947375 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfabfff640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfac103750 0x7fbfac199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfa3fff640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfac1047e0 0x7fbfac19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb0a04640 1 -- 172.21.15.148:0/549947375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfac1047e0 msgr2=0x7fbfac19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb0a04640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfac1047e0 0x7fbfac19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb0a04640 1 -- 172.21.15.148:0/549947375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfac103750 msgr2=0x7fbfac199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb0a04640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfac103750 0x7fbfac199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb0a04640 1 -- 172.21.15.148:0/549947375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfac19ba10 con 0x7fbfac105180 2024-09-21T01:06:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfa3fff640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfac1047e0 0x7fbfac19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:06:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfb0a04640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac105180 0x7fbfac19b1f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400cad0 tx=0x7fbfa400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.894+0000 7fbfa9ffb640 1 -- 172.21.15.148:0/549947375 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400ae20 con 0x7fbfac105180 2024-09-21T01:06:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.895+0000 7fbfa9ffb640 1 -- 172.21.15.148:0/549947375 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa4005020 con 0x7fbfac105180 2024-09-21T01:06:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.895+0000 7fbfb2467640 1 -- 172.21.15.148:0/549947375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfac19bd00 con 0x7fbfac105180 2024-09-21T01:06:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.895+0000 7fbfa9ffb640 1 -- 172.21.15.148:0/549947375 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400f6b0 con 0x7fbfac105180 2024-09-21T01:06:13.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.895+0000 7fbfb2467640 1 -- 172.21.15.148:0/549947375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfac1a2400 con 0x7fbfac105180 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.896+0000 7fbfb2467640 1 -- 172.21.15.148:0/549947375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfac10a910 con 0x7fbfac105180 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.898+0000 7fbfa9ffb640 1 -- 172.21.15.148:0/549947375 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7fbfa40051d0 con 0x7fbfac105180 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.899+0000 7fbfa9ffb640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbf980b6500 0x7fbf980b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.899+0000 7fbfabfff640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbf980b6500 0x7fbf980b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.899+0000 7fbfa9ffb640 1 -- 172.21.15.148:0/549947375 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbfa40e59b0 con 0x7fbfac105180 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.899+0000 7fbfabfff640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbf980b6500 0x7fbf980b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00bbe0 tx=0x7fbf9c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:10.902+0000 7fbfa9ffb640 1 -- 172.21.15.148:0/549947375 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbfa4014030 con 0x7fbfac105180 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.082+0000 7fbfb2467640 1 -- 172.21.15.148:0/549947375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fbfac02e640 con 0x7fbfac105180 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.082+0000 7fbfa9ffb640 1 -- 172.21.15.148:0/549947375 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v31)=0 v31) ==== 106+0+0 (secure 0 0 0) 0x7fbfa40adf90 con 0x7fbfac105180 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.084+0000 7fbfb2467640 1 -- 172.21.15.148:0/549947375 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbf980b6500 msgr2=0x7fbf980b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.084+0000 7fbfb2467640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbf980b6500 0x7fbf980b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00bbe0 tx=0x7fbf9c00b390 comp rx=0 tx=0).stop 2024-09-21T01:06:13.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.084+0000 7fbfb2467640 1 -- 172.21.15.148:0/549947375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac105180 msgr2=0x7fbfac19b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:13.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.084+0000 7fbfb2467640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac105180 0x7fbfac19b1f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400cad0 tx=0x7fbfa400cf90 comp rx=0 tx=0).stop 2024-09-21T01:06:13.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.084+0000 7fbfb2467640 1 -- 172.21.15.148:0/549947375 shutdown_connections 2024-09-21T01:06:13.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.084+0000 7fbfb2467640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbf980b6500 0x7fbf980b8a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:13.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.084+0000 7fbfb2467640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac105180 0x7fbfac19b1f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:13.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.084+0000 7fbfb2467640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfac1047e0 0x7fbfac19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:13.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.084+0000 7fbfb2467640 1 --2- 172.21.15.148:0/549947375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfac103750 0x7fbfac199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:13.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.084+0000 7fbfb2467640 1 -- 172.21.15.148:0/549947375 >> 172.21.15.148:0/549947375 conn(0x7fbfac0ff0c0 msgr2=0x7fbfac107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:13.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.085+0000 7fbfb2467640 1 -- 172.21.15.148:0/549947375 shutdown_connections 2024-09-21T01:06:13.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:11.085+0000 7fbfb2467640 1 -- 172.21.15.148:0/549947375 wait complete. 2024-09-21T01:06:14.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:13 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3330103468' entity='client.admin' 2024-09-21T01:06:14.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:13 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3330103468' entity='client.admin' 2024-09-21T01:06:14.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:13 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3330103468' entity='client.admin' 2024-09-21T01:06:15.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:14 smithi148 ceph-mon[31000]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:15.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:14 smithi181 ceph-mon[34811]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:15.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:14 smithi157 ceph-mon[34140]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:15.802 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.802 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.802 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.802 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.802 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.803 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.803 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.803 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.803 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.803 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.803 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.803 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.803 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi148') 2024-09-21T01:06:15.804 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi148') 2024-09-21T01:06:16.206 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi148') 2024-09-21T01:06:16.207 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi148') 2024-09-21T01:06:16.207 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3872f802-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi148') 2024-09-21T01:06:16.207 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T01:06:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:16.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:16 smithi148 ceph-mon[31000]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:16.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:16 smithi181 ceph-mon[34811]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:16.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:16 smithi157 ceph-mon[34140]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.882+0000 7fbe75d2b640 1 -- 172.21.15.148:0/4170909995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe70103750 msgr2=0x7fbe70103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.882+0000 7fbe75d2b640 1 --2- 172.21.15.148:0/4170909995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe70103750 0x7fbe70103bc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009ca0 tx=0x7fbe6002a950 comp rx=0 tx=0).stop 2024-09-21T01:06:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.882+0000 7fbe75d2b640 1 -- 172.21.15.148:0/4170909995 shutdown_connections 2024-09-21T01:06:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.882+0000 7fbe75d2b640 1 --2- 172.21.15.148:0/4170909995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe70105180 0x7fbe7010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.882+0000 7fbe75d2b640 1 --2- 172.21.15.148:0/4170909995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe701047e0 0x7fbe70104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.882+0000 7fbe75d2b640 1 --2- 172.21.15.148:0/4170909995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe70103750 0x7fbe70103bc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.882+0000 7fbe75d2b640 1 -- 172.21.15.148:0/4170909995 >> 172.21.15.148:0/4170909995 conn(0x7fbe700ff0c0 msgr2=0x7fbe70101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:16.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.882+0000 7fbe75d2b640 1 -- 172.21.15.148:0/4170909995 shutdown_connections 2024-09-21T01:06:16.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.882+0000 7fbe75d2b640 1 -- 172.21.15.148:0/4170909995 wait complete. 2024-09-21T01:06:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe75d2b640 1 Processor -- start 2024-09-21T01:06:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe75d2b640 1 -- start start 2024-09-21T01:06:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe75d2b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe70103750 0x7fbe7019a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe75d2b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe701047e0 0x7fbe7019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe75d2b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe70105180 0x7fbe7019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe75d2b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7010f390 con 0x7fbe70103750 2024-09-21T01:06:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe75d2b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7010f210 con 0x7fbe701047e0 2024-09-21T01:06:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe75d2b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7010f510 con 0x7fbe70105180 2024-09-21T01:06:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe6f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe70103750 0x7fbe7019a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe6f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe70103750 0x7fbe7019a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36274/0 (socket says 172.21.15.148:36274) 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe6f7fe640 1 -- 172.21.15.148:0/2758184177 learned_addr learned my addr 172.21.15.148:0/2758184177 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe6effd640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe701047e0 0x7fbe7019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe6ffff640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe70105180 0x7fbe7019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe6f7fe640 1 -- 172.21.15.148:0/2758184177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe70105180 msgr2=0x7fbe7019b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe6f7fe640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe70105180 0x7fbe7019b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe6f7fe640 1 -- 172.21.15.148:0/2758184177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe701047e0 msgr2=0x7fbe7019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe6f7fe640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe701047e0 0x7fbe7019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.883+0000 7fbe6f7fe640 1 -- 172.21.15.148:0/2758184177 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7019b9d0 con 0x7fbe70103750 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.884+0000 7fbe6f7fe640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe70103750 0x7fbe7019a010 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbe60030040 tx=0x7fbe6002fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.884+0000 7fbe6cff9640 1 -- 172.21.15.148:0/2758184177 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60034040 con 0x7fbe70103750 2024-09-21T01:06:16.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.884+0000 7fbe6cff9640 1 -- 172.21.15.148:0/2758184177 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe600308f0 con 0x7fbe70103750 2024-09-21T01:06:16.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.884+0000 7fbe75d2b640 1 -- 172.21.15.148:0/2758184177 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe7019bc60 con 0x7fbe70103750 2024-09-21T01:06:16.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.884+0000 7fbe6cff9640 1 -- 172.21.15.148:0/2758184177 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60004840 con 0x7fbe70103750 2024-09-21T01:06:16.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.884+0000 7fbe75d2b640 1 -- 172.21.15.148:0/2758184177 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe701a23c0 con 0x7fbe70103750 2024-09-21T01:06:16.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.885+0000 7fbe75d2b640 1 -- 172.21.15.148:0/2758184177 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe70103bc0 con 0x7fbe70103750 2024-09-21T01:06:16.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.886+0000 7fbe6cff9640 1 -- 172.21.15.148:0/2758184177 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7fbe60037020 con 0x7fbe70103750 2024-09-21T01:06:16.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.887+0000 7fbe6cff9640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbe580b6500 0x7fbe580b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:16.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.887+0000 7fbe6effd640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbe580b6500 0x7fbe580b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:16.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.887+0000 7fbe6cff9640 1 -- 172.21.15.148:0/2758184177 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbe601064b0 con 0x7fbe70103750 2024-09-21T01:06:16.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.888+0000 7fbe6effd640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbe580b6500 0x7fbe580b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009bd0 tx=0x7fbe64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:16.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:16.892+0000 7fbe6cff9640 1 -- 172.21.15.148:0/2758184177 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbe600ceaa0 con 0x7fbe70103750 2024-09-21T01:06:17.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.073+0000 7fbe75d2b640 1 -- 172.21.15.148:0/2758184177 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fbe70063fc0 con 0x7fbe70103750 2024-09-21T01:06:17.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.074+0000 7fbe6cff9640 1 -- 172.21.15.148:0/2758184177 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21518 (secure 0 0 0) 0x7fbe60030ac0 con 0x7fbe70103750 2024-09-21T01:06:17.075 INFO:teuthology.orchestra.run.smithi148.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T01:06:17.075 INFO:teuthology.orchestra.run.smithi148.stdout:global dev auth_debug true 2024-09-21T01:06:17.075 INFO:teuthology.orchestra.run.smithi148.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global basic log_to_file true 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global basic log_to_journald false 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global basic log_to_stderr false 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced mon_allow_pool_delete true 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T01:06:17.076 INFO:teuthology.orchestra.run.smithi148.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:global dev ms_die_on_bug true 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:global dev ms_die_on_old_message true 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:global dev ms_die_on_skipped_message false 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced debug_mon 20/20 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced debug_ms 1/1 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced debug_paxos 20/20 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T01:06:17.077 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced client_mount_timeout 30 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced debug_client 20/20 2024-09-21T01:06:17.078 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced debug_mgr 20/20 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced debug_ms 1/1 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd dev bdev_debug_aio true 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced bdev_enable_discard true 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced bluestore_allocator bitmap * 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T01:06:17.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced debug_bluefs 1/20 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced debug_bluestore 1/20 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced debug_ms 1/1 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced debug_osd 20/20 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced debug_rocksdb 4/10 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd dev osd_debug_op_order true 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd dev osd_debug_shutdown true 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T01:06:17.080 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T01:06:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced debug_mds 20/20 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced debug_ms 2/2 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced mds_bal_split_size 100 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds dev mds_debug_frag true 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds dev mds_debug_scatterstat true 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced mds_export_ephemeral_random_max 0.100000 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds dev mds_verify_scatter true 2024-09-21T01:06:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T01:06:17.083 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T01:06:17.083 INFO:teuthology.orchestra.run.smithi148.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T01:06:17.083 INFO:teuthology.orchestra.run.smithi148.stdout:client advanced client_mount_timeout 600 2024-09-21T01:06:17.083 INFO:teuthology.orchestra.run.smithi148.stdout:client advanced debug_client 20/20 2024-09-21T01:06:17.083 INFO:teuthology.orchestra.run.smithi148.stdout:client advanced debug_ms 1/1 2024-09-21T01:06:17.083 INFO:teuthology.orchestra.run.smithi148.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T01:06:17.083 INFO:teuthology.orchestra.run.smithi148.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T01:06:17.083 INFO:teuthology.orchestra.run.smithi148.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T01:06:17.083 INFO:teuthology.orchestra.run.smithi148.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T01:06:17.083 INFO:teuthology.orchestra.run.smithi148.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T01:06:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.076+0000 7fbe75d2b640 1 -- 172.21.15.148:0/2758184177 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbe580b6500 msgr2=0x7fbe580b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.076+0000 7fbe75d2b640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbe580b6500 0x7fbe580b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009bd0 tx=0x7fbe64005f90 comp rx=0 tx=0).stop 2024-09-21T01:06:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.076+0000 7fbe75d2b640 1 -- 172.21.15.148:0/2758184177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe70103750 msgr2=0x7fbe7019a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.076+0000 7fbe75d2b640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe70103750 0x7fbe7019a010 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbe60030040 tx=0x7fbe6002fc20 comp rx=0 tx=0).stop 2024-09-21T01:06:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.077+0000 7fbe75d2b640 1 -- 172.21.15.148:0/2758184177 shutdown_connections 2024-09-21T01:06:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.077+0000 7fbe75d2b640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbe580b6500 0x7fbe580b8a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.077+0000 7fbe75d2b640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe70105180 0x7fbe7019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.077+0000 7fbe75d2b640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe701047e0 0x7fbe7019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.077+0000 7fbe75d2b640 1 --2- 172.21.15.148:0/2758184177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe70103750 0x7fbe7019a010 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.077+0000 7fbe75d2b640 1 -- 172.21.15.148:0/2758184177 >> 172.21.15.148:0/2758184177 conn(0x7fbe700ff0c0 msgr2=0x7fbe70107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.077+0000 7fbe75d2b640 1 -- 172.21.15.148:0/2758184177 shutdown_connections 2024-09-21T01:06:17.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:17.077+0000 7fbe75d2b640 1 -- 172.21.15.148:0/2758184177 wait complete. 2024-09-21T01:06:17.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:17 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2758184177' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T01:06:17.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:17 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2758184177' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T01:06:17.570 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:17 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2758184177' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T01:06:17.842 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T01:06:17.842 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:06:17.842 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:06:17.858 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:06:17.858 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-09-21T01:06:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:06:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:17.914 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T01:06:17.914 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:17.914 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:17.914 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 01:05:07.892117096 +0000 2024-09-21T01:06:17.914 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 00:59:47.892855173 +0000 2024-09-21T01:06:17.914 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 00:59:47.892855173 +0000 2024-09-21T01:06:17.914 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 00:59:47.892855173 +0000 2024-09-21T01:06:17.914 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:06:17.978 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T01:06:17.978 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T01:06:17.978 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000188697 s, 2.7 MB/s 2024-09-21T01:06:17.980 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:06:18.035 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-09-21T01:06:18.090 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:06:18.091 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:18.091 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T01:06:18.091 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:18.091 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:18.091 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 01:05:07.924116857 +0000 2024-09-21T01:06:18.091 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 00:59:48.215853146 +0000 2024-09-21T01:06:18.091 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 00:59:48.215853146 +0000 2024-09-21T01:06:18.091 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 00:59:48.215853146 +0000 2024-09-21T01:06:18.091 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:06:18.153 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T01:06:18.154 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T01:06:18.154 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000189285 s, 2.7 MB/s 2024-09-21T01:06:18.155 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:06:18.211 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-09-21T01:06:18.267 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:06:18.267 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:18.267 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T01:06:18.267 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:18.267 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:18.267 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 01:05:07.955116626 +0000 2024-09-21T01:06:18.267 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 00:59:48.541851100 +0000 2024-09-21T01:06:18.267 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 00:59:48.541851100 +0000 2024-09-21T01:06:18.267 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 00:59:48.541851100 +0000 2024-09-21T01:06:18.268 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:06:18.330 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T01:06:18.330 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T01:06:18.330 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000181423 s, 2.8 MB/s 2024-09-21T01:06:18.332 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:06:18.389 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-09-21T01:06:18.444 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:06:18.444 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:18.444 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T01:06:18.444 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:18.444 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:18.444 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 01:05:07.987116387 +0000 2024-09-21T01:06:18.445 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 00:59:48.869849042 +0000 2024-09-21T01:06:18.445 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 00:59:48.869849042 +0000 2024-09-21T01:06:18.445 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 00:59:48.869849042 +0000 2024-09-21T01:06:18.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:06:18.506 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:18 smithi148 ceph-mon[31000]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:18.508 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T01:06:18.508 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T01:06:18.508 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000199402 s, 2.6 MB/s 2024-09-21T01:06:18.509 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:06:18.566 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-21T01:06:18.566 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:06:18.587 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:06:18.587 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-09-21T01:06:18.647 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:06:18.647 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:18.647 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T01:06:18.647 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:18.647 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:18.647 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-21 01:05:53.349709471 +0000 2024-09-21T01:06:18.647 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-21 01:00:33.010050315 +0000 2024-09-21T01:06:18.647 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-21 01:00:33.010050315 +0000 2024-09-21T01:06:18.647 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-09-21 01:00:33.010050315 +0000 2024-09-21T01:06:18.648 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:06:18.715 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:18 smithi157 ceph-mon[34140]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:18.719 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-21T01:06:18.719 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-21T01:06:18.719 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000124574 s, 4.1 MB/s 2024-09-21T01:06:18.721 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:06:18.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:18 smithi181 ceph-mon[34811]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:18.779 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-09-21T01:06:18.837 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:06:18.838 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:18.838 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T01:06:18.838 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:18.838 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:18.838 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-21 01:05:53.350709453 +0000 2024-09-21T01:06:18.838 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-21 01:00:33.314044844 +0000 2024-09-21T01:06:18.838 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-21 01:00:33.314044844 +0000 2024-09-21T01:06:18.838 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-09-21 01:00:33.314044844 +0000 2024-09-21T01:06:18.838 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:06:18.904 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-21T01:06:18.904 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-21T01:06:18.904 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000133582 s, 3.8 MB/s 2024-09-21T01:06:18.905 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:06:18.966 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-09-21T01:06:19.023 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:06:19.023 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:19.023 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T01:06:19.023 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:19.023 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:19.023 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-21 01:05:53.350709453 +0000 2024-09-21T01:06:19.024 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-21 01:00:33.621039319 +0000 2024-09-21T01:06:19.024 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-21 01:00:33.621039319 +0000 2024-09-21T01:06:19.024 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-09-21 01:00:33.621039319 +0000 2024-09-21T01:06:19.024 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:06:19.089 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-21T01:06:19.089 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-21T01:06:19.089 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000119101 s, 4.3 MB/s 2024-09-21T01:06:19.090 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:06:19.148 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-09-21T01:06:19.205 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:06:19.205 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:19.205 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-21T01:06:19.205 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:19.205 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:19.205 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-21 01:05:53.350709453 +0000 2024-09-21T01:06:19.205 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-21 01:00:33.938033615 +0000 2024-09-21T01:06:19.206 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-21 01:00:33.938033615 +0000 2024-09-21T01:06:19.206 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-09-21 01:00:33.938033615 +0000 2024-09-21T01:06:19.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:06:19.270 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-21T01:06:19.270 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-21T01:06:19.270 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000116304 s, 4.4 MB/s 2024-09-21T01:06:19.271 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:06:19.329 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T01:06:19.329 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:06:19.349 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:06:19.349 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-09-21T01:06:19.408 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:06:19.409 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:19.409 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T01:06:19.409 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:19.409 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:19.409 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 01:05:51.024890458 +0000 2024-09-21T01:06:19.409 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 00:59:51.609009894 +0000 2024-09-21T01:06:19.409 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 00:59:51.609009894 +0000 2024-09-21T01:06:19.409 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 00:59:51.609009894 +0000 2024-09-21T01:06:19.409 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:06:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T01:06:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T01:06:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000287244 s, 1.8 MB/s 2024-09-21T01:06:19.480 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:06:19.539 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-09-21T01:06:19.597 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:06:19.597 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:19.597 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-21T01:06:19.597 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:19.597 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:19.598 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 01:05:51.024890458 +0000 2024-09-21T01:06:19.598 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 00:59:51.954003047 +0000 2024-09-21T01:06:19.598 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 00:59:51.954003047 +0000 2024-09-21T01:06:19.598 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 00:59:51.954003047 +0000 2024-09-21T01:06:19.598 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:06:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T01:06:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T01:06:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000209908 s, 2.4 MB/s 2024-09-21T01:06:19.663 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:06:19.720 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-09-21T01:06:19.776 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:06:19.776 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:19.776 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T01:06:19.776 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:19.776 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:19.776 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 01:05:51.025890439 +0000 2024-09-21T01:06:19.776 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 00:59:52.279996577 +0000 2024-09-21T01:06:19.776 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 00:59:52.279996577 +0000 2024-09-21T01:06:19.776 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 00:59:52.279996577 +0000 2024-09-21T01:06:19.776 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:06:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T01:06:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T01:06:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000204682 s, 2.5 MB/s 2024-09-21T01:06:19.841 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:06:19.898 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-09-21T01:06:19.954 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:06:19.955 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:06:19.955 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T01:06:19.955 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:06:19.955 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:06:19.955 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 01:05:51.025890439 +0000 2024-09-21T01:06:19.955 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 00:59:52.600990206 +0000 2024-09-21T01:06:19.955 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 00:59:52.600990206 +0000 2024-09-21T01:06:19.955 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 00:59:52.600990206 +0000 2024-09-21T01:06:19.955 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:06:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T01:06:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T01:06:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000194932 s, 2.6 MB/s 2024-09-21T01:06:20.020 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:06:20.077 INFO:tasks.cephadm:Deploying osd.0 on smithi148 with /dev/vg_nvme/lv_4... 2024-09-21T01:06:20.077 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T01:06:20.330 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:20.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:20 smithi148 ceph-mon[31000]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:20 smithi181 ceph-mon[34811]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:20.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:20 smithi157 ceph-mon[34140]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:22.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:22 smithi148 ceph-mon[31000]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:22.663 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:06:22.688 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_4 2024-09-21T01:06:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:22 smithi181 ceph-mon[34811]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:22.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:22 smithi157 ceph-mon[34140]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:22.931 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.382+0000 7fb534e81640 1 -- 172.21.15.148:0/2961529238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb530109470 msgr2=0x7fb53010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.382+0000 7fb534e81640 1 --2- 172.21.15.148:0/2961529238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb530109470 0x7fb53010b980 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb528009ca0 tx=0x7fb52802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:06:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.382+0000 7fb534e81640 1 -- 172.21.15.148:0/2961529238 shutdown_connections 2024-09-21T01:06:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.382+0000 7fb534e81640 1 --2- 172.21.15.148:0/2961529238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb530109470 0x7fb53010b980 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.382+0000 7fb534e81640 1 --2- 172.21.15.148:0/2961529238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb530106930 0x7fb530108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.382+0000 7fb534e81640 1 --2- 172.21.15.148:0/2961529238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb53006b920 0x7fb5301063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.382+0000 7fb534e81640 1 -- 172.21.15.148:0/2961529238 >> 172.21.15.148:0/2961529238 conn(0x7fb5300fdfb0 msgr2=0x7fb530100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.382+0000 7fb534e81640 1 -- 172.21.15.148:0/2961529238 shutdown_connections 2024-09-21T01:06:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.382+0000 7fb534e81640 1 -- 172.21.15.148:0/2961529238 wait complete. 2024-09-21T01:06:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb534e81640 1 Processor -- start 2024-09-21T01:06:23.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb534e81640 1 -- start start 2024-09-21T01:06:23.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb534e81640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53006b920 0x7fb530199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:23.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb534e81640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb530106930 0x7fb53019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:23.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb534e81640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb530109470 0x7fb53019b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb534e81640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb53010f380 con 0x7fb530109470 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb534e81640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb53010f200 con 0x7fb530106930 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb534e81640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb53010f500 con 0x7fb53006b920 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb52ed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb530109470 0x7fb53019b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb52ed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb530109470 0x7fb53019b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36296/0 (socket says 172.21.15.148:36296) 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.383+0000 7fb52ed9d640 1 -- 172.21.15.148:0/3831512396 learned_addr learned my addr 172.21.15.148:0/3831512396 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb52e59c640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53006b920 0x7fb530199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb525d9b640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb530106930 0x7fb53019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb52ed9d640 1 -- 172.21.15.148:0/3831512396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53006b920 msgr2=0x7fb530199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb52ed9d640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53006b920 0x7fb530199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb52ed9d640 1 -- 172.21.15.148:0/3831512396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb530106930 msgr2=0x7fb53019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb52ed9d640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb530106930 0x7fb53019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb52ed9d640 1 -- 172.21.15.148:0/3831512396 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53019b8e0 con 0x7fb530109470 2024-09-21T01:06:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb52ed9d640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb530109470 0x7fb53019b150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb5280097b0 tx=0x7fb528003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb527fff640 1 -- 172.21.15.148:0/3831512396 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528004240 con 0x7fb530109470 2024-09-21T01:06:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb527fff640 1 -- 172.21.15.148:0/3831512396 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb52802f380 con 0x7fb530109470 2024-09-21T01:06:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb534e81640 1 -- 172.21.15.148:0/3831512396 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53019bb70 con 0x7fb530109470 2024-09-21T01:06:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb527fff640 1 -- 172.21.15.148:0/3831512396 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52802fc20 con 0x7fb530109470 2024-09-21T01:06:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.384+0000 7fb534e81640 1 -- 172.21.15.148:0/3831512396 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5301a2190 con 0x7fb530109470 2024-09-21T01:06:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.385+0000 7fb534e81640 1 -- 172.21.15.148:0/3831512396 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5300ffad0 con 0x7fb530109470 2024-09-21T01:06:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.387+0000 7fb527fff640 1 -- 172.21.15.148:0/3831512396 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7fb5280043e0 con 0x7fb530109470 2024-09-21T01:06:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.387+0000 7fb527fff640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb51c0b6480 0x7fb51c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.388+0000 7fb52e59c640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb51c0b6480 0x7fb51c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.388+0000 7fb527fff640 1 -- 172.21.15.148:0/3831512396 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb528106f30 con 0x7fb530109470 2024-09-21T01:06:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.388+0000 7fb52e59c640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb51c0b6480 0x7fb51c0b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb52000abe0 tx=0x7fb52000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:23.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.391+0000 7fb527fff640 1 -- 172.21.15.148:0/3831512396 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5280cf490 con 0x7fb530109470 2024-09-21T01:06:23.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:23.577+0000 7fb534e81640 1 -- 172.21.15.148:0/3831512396 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb530063800 con 0x7fb51c0b6480 2024-09-21T01:06:23.948 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:23 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:06:23.949 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:23 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:06:23.949 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:23 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:23.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:23 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:06:23.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:23 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:06:23.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:23 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:23.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:23 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:06:23.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:23 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:06:23.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:23 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:24.957 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:24 smithi148 ceph-mon[31000]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:24.957 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:24 smithi148 ceph-mon[31000]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:24.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:24 smithi181 ceph-mon[34811]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:24.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:24 smithi181 ceph-mon[34811]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:24.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:24 smithi157 ceph-mon[34140]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:24.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:24 smithi157 ceph-mon[34140]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:26.139 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:25 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/96962423' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e35550a-2857-479e-9465-d64c90a2f2f1"} : dispatch 2024-09-21T01:06:26.140 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:25 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/96962423' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e35550a-2857-479e-9465-d64c90a2f2f1"}]': finished 2024-09-21T01:06:26.140 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:25 smithi148 ceph-mon[31000]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T01:06:26.140 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:26.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:25 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/96962423' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e35550a-2857-479e-9465-d64c90a2f2f1"} : dispatch 2024-09-21T01:06:26.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:25 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/96962423' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e35550a-2857-479e-9465-d64c90a2f2f1"}]': finished 2024-09-21T01:06:26.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:25 smithi181 ceph-mon[34811]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T01:06:26.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:26.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:25 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/96962423' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1e35550a-2857-479e-9465-d64c90a2f2f1"} : dispatch 2024-09-21T01:06:26.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:25 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/96962423' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e35550a-2857-479e-9465-d64c90a2f2f1"}]': finished 2024-09-21T01:06:26.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:25 smithi157 ceph-mon[34140]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T01:06:26.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:27.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:26 smithi181 ceph-mon[34811]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:27.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:26 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1711532886' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:06:27.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:26 smithi157 ceph-mon[34140]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:27.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:26 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1711532886' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:06:27.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:26 smithi148 ceph-mon[31000]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:27.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:26 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1711532886' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:06:28.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:28 smithi148 ceph-mon[31000]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:28.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:28 smithi181 ceph-mon[34811]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:28.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:28 smithi157 ceph-mon[34140]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:30.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:30 smithi148 ceph-mon[31000]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:30.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:30 smithi181 ceph-mon[34811]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:30.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:30 smithi157 ceph-mon[34140]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:32.594 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:32 smithi148 ceph-mon[31000]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:32.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:32 smithi181 ceph-mon[34811]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:32.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:32 smithi157 ceph-mon[34140]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:34.521 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:34 smithi148 ceph-mon[31000]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:34 smithi181 ceph-mon[34811]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:34.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:34 smithi157 ceph-mon[34140]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:06:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:35 smithi148 ceph-mon[31000]: Deploying daemon osd.0 on smithi148 2024-09-21T01:06:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:06:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:35 smithi181 ceph-mon[34811]: Deploying daemon osd.0 on smithi148 2024-09-21T01:06:35.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:06:35.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:35.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:35 smithi157 ceph-mon[34140]: Deploying daemon osd.0 on smithi148 2024-09-21T01:06:36.463 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:36 smithi148 ceph-mon[31000]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:36.631 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:36 smithi181 ceph-mon[34811]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:36.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:36 smithi157 ceph-mon[34140]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:38.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:38 smithi148 ceph-mon[31000]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:38.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:38 smithi181 ceph-mon[34811]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:38.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:38 smithi157 ceph-mon[34140]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:40.425 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:40 smithi148 ceph-mon[31000]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:40.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:40 smithi181 ceph-mon[34811]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:40.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:40 smithi157 ceph-mon[34140]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:41.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:41.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:41.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:41.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:41.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:41.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:41.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:41.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:41.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:42.351 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:42 smithi148 ceph-mon[31000]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:42.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:42 smithi181 ceph-mon[34811]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:42.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:42 smithi157 ceph-mon[34140]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:44.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:44 smithi148 ceph-mon[31000]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:44 smithi181 ceph-mon[34811]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:44 smithi157 ceph-mon[34140]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:45.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.173+0000 7fb527fff640 1 -- 172.21.15.148:0/3831512396 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb530063800 con 0x7fb51c0b6480 2024-09-21T01:06:45.174 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 0 on host 'smithi148' 2024-09-21T01:06:45.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.175+0000 7fb534e81640 1 -- 172.21.15.148:0/3831512396 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb51c0b6480 msgr2=0x7fb51c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.175+0000 7fb534e81640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb51c0b6480 0x7fb51c0b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb52000abe0 tx=0x7fb52000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.175+0000 7fb534e81640 1 -- 172.21.15.148:0/3831512396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb530109470 msgr2=0x7fb53019b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.175+0000 7fb534e81640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb530109470 0x7fb53019b150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb5280097b0 tx=0x7fb528003c20 comp rx=0 tx=0).stop 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.176+0000 7fb534e81640 1 -- 172.21.15.148:0/3831512396 shutdown_connections 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.176+0000 7fb534e81640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb51c0b6480 0x7fb51c0b8990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.176+0000 7fb534e81640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb530109470 0x7fb53019b150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.176+0000 7fb534e81640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb530106930 0x7fb53019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.176+0000 7fb534e81640 1 --2- 172.21.15.148:0/3831512396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53006b920 0x7fb530199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.176+0000 7fb534e81640 1 -- 172.21.15.148:0/3831512396 >> 172.21.15.148:0/3831512396 conn(0x7fb5300fdfb0 msgr2=0x7fb530104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.176+0000 7fb534e81640 1 -- 172.21.15.148:0/3831512396 shutdown_connections 2024-09-21T01:06:45.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:06:45.176+0000 7fb534e81640 1 -- 172.21.15.148:0/3831512396 wait complete. 2024-09-21T01:06:45.756 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:45.756 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:45.756 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:45.790 DEBUG:teuthology.orchestra.run.smithi148:osd.0> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T01:06:45.792 INFO:tasks.cephadm:Deploying osd.1 on smithi157 with /dev/vg_nvme/lv_4... 2024-09-21T01:06:45.793 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T01:06:45.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:45.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:45.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:45.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:45.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:45.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:46.043 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:06:46.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:46 smithi157 ceph-mon[34140]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:46 smithi148 ceph-mon[31000]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:46.864 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:06:46 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0[46418]: 2024-09-21T01:06:46.809+0000 7f2dc2882640 -1 osd.0 0 log_to_monitors true 2024-09-21T01:06:46.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:46 smithi181 ceph-mon[34811]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:47.912 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:47 smithi157 ceph-mon[34140]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:06:47.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:47 smithi181 ceph-mon[34811]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:06:48.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:47 smithi148 ceph-mon[31000]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:06:48.256 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:06:48.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi157:vg_nvme/lv_4 2024-09-21T01:06:48.535 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:06:48.741 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0[46418]: 2024-09-21T01:06:48.654+0000 7f2dbe804640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T01:06:48.741 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0[46418]: 2024-09-21T01:06:48.658+0000 7f2dba602640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:06:48.741 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:06:48.741 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T01:06:48.741 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:06:48.741 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:48.742 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:48.742 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.742 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.742 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:48.742 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.742 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:48.742 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:48.742 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.873 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:48.874 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.969+0000 7fcb56872640 1 -- 172.21.15.157:0/3776672307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb50103780 msgr2=0x7fcb50103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:48.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.969+0000 7fcb56872640 1 --2- 172.21.15.157:0/3776672307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb50103780 0x7fcb50103bf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009900 tx=0x7fcb4002a480 comp rx=0 tx=0).stop 2024-09-21T01:06:48.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.969+0000 7fcb56872640 1 -- 172.21.15.157:0/3776672307 shutdown_connections 2024-09-21T01:06:48.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.969+0000 7fcb56872640 1 --2- 172.21.15.157:0/3776672307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb501051b0 0x7fcb5010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:48.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.969+0000 7fcb56872640 1 --2- 172.21.15.157:0/3776672307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb50104810 0x7fcb50104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:48.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.969+0000 7fcb56872640 1 --2- 172.21.15.157:0/3776672307 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb50103780 0x7fcb50103bf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:48.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.969+0000 7fcb56872640 1 -- 172.21.15.157:0/3776672307 >> 172.21.15.157:0/3776672307 conn(0x7fcb500ff0f0 msgr2=0x7fcb501015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:48.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.970+0000 7fcb56872640 1 -- 172.21.15.157:0/3776672307 shutdown_connections 2024-09-21T01:06:48.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.970+0000 7fcb56872640 1 -- 172.21.15.157:0/3776672307 wait complete. 2024-09-21T01:06:48.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.970+0000 7fcb56872640 1 Processor -- start 2024-09-21T01:06:48.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.970+0000 7fcb56872640 1 -- start start 2024-09-21T01:06:48.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.970+0000 7fcb56872640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb50103780 0x7fcb50199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:48.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb56872640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb50104810 0x7fcb5019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:48.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb56872640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb501051b0 0x7fcb5019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb56872640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5010f3a0 con 0x7fcb50104810 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb56872640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5010f220 con 0x7fcb50103780 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb56872640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5010f520 con 0x7fcb501051b0 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb4ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb50103780 0x7fcb50199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb4ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb50103780 0x7fcb50199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38196/0 (socket says 172.21.15.157:38196) 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb47fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb50104810 0x7fcb5019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb4ffff640 1 -- 172.21.15.157:0/2242264777 learned_addr learned my addr 172.21.15.157:0/2242264777 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb54e0f640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb501051b0 0x7fcb5019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb47fff640 1 -- 172.21.15.157:0/2242264777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb501051b0 msgr2=0x7fcb5019b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb47fff640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb501051b0 0x7fcb5019b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb47fff640 1 -- 172.21.15.157:0/2242264777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb50103780 msgr2=0x7fcb50199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:48.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb47fff640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb50103780 0x7fcb50199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:48.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb47fff640 1 -- 172.21.15.157:0/2242264777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5019b9c0 con 0x7fcb50104810 2024-09-21T01:06:48.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb4ffff640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb50103780 0x7fcb50199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:48.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb47fff640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb50104810 0x7fcb5019a600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800d6d0 tx=0x7fcb3800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:48.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb4dffb640 1 -- 172.21.15.157:0/2242264777 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38017070 con 0x7fcb50104810 2024-09-21T01:06:48.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb56872640 1 -- 172.21.15.157:0/2242264777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5019bcb0 con 0x7fcb50104810 2024-09-21T01:06:48.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb4dffb640 1 -- 172.21.15.157:0/2242264777 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb38009820 con 0x7fcb50104810 2024-09-21T01:06:48.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.971+0000 7fcb4dffb640 1 -- 172.21.15.157:0/2242264777 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38004c40 con 0x7fcb50104810 2024-09-21T01:06:48.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.972+0000 7fcb56872640 1 -- 172.21.15.157:0/2242264777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb500757c0 con 0x7fcb50104810 2024-09-21T01:06:48.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.972+0000 7fcb56872640 1 -- 172.21.15.157:0/2242264777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb50103bf0 con 0x7fcb50104810 2024-09-21T01:06:48.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.974+0000 7fcb4dffb640 1 -- 172.21.15.157:0/2242264777 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7fcb38005220 con 0x7fcb50104810 2024-09-21T01:06:48.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.975+0000 7fcb4dffb640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcb3c0b6480 0x7fcb3c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:48.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.975+0000 7fcb4dffb640 1 -- 172.21.15.157:0/2242264777 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fcb380e5660 con 0x7fcb50104810 2024-09-21T01:06:48.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.975+0000 7fcb4ffff640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcb3c0b6480 0x7fcb3c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:48.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.976+0000 7fcb4ffff640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcb3c0b6480 0x7fcb3c0b8990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb40032fd0 tx=0x7fcb400314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:48.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:48.978+0000 7fcb4dffb640 1 -- 172.21.15.157:0/2242264777 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb380b1dc0 con 0x7fcb50104810 2024-09-21T01:06:48.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:06:48.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T01:06:48.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:06:48.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:48.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:48.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:48.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:48.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:48.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:48.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:06:49.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:06:49.172+0000 7fcb56872640 1 -- 172.21.15.157:0/2242264777 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fcb5002e9d0 con 0x7fcb3c0b6480 2024-09-21T01:06:49.851 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:49 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi148 2024-09-21T01:06:49.851 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:49 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-21T01:06:49.851 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:49 smithi157 ceph-mon[34140]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:06:49.851 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:49 smithi157 ceph-mon[34140]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T01:06:49.851 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:49.851 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:49.851 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:49 smithi157 ceph-mon[34140]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:49.851 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:06:49.852 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:06:49.852 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:49.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:49 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi148 2024-09-21T01:06:49.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:49 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-21T01:06:49.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:49 smithi181 ceph-mon[34811]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:06:49.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:49 smithi181 ceph-mon[34811]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T01:06:49.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:49.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:49.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:49 smithi181 ceph-mon[34811]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:49.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:06:49.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:06:49.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:50.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:49 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi148 2024-09-21T01:06:50.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:49 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-21T01:06:50.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:49 smithi148 ceph-mon[31000]: from='osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:06:50.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:49 smithi148 ceph-mon[31000]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T01:06:50.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:50.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:50.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:49 smithi148 ceph-mon[31000]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:50.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:06:50.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:06:50.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:50.699 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:50 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:06:50.699 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:50 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:06:50.699 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:50 smithi157 ceph-mon[34140]: osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] boot 2024-09-21T01:06:50.699 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:50 smithi157 ceph-mon[34140]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T01:06:50.699 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:50.699 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:50 smithi157 ceph-mon[34140]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:50.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:50 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:06:50.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:50 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:06:50.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:50 smithi181 ceph-mon[34811]: osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] boot 2024-09-21T01:06:50.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:50 smithi181 ceph-mon[34811]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T01:06:50.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:50.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:50 smithi181 ceph-mon[34811]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:51.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:50 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:06:51.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:50 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:06:51.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:50 smithi148 ceph-mon[31000]: osd.0 [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] boot 2024-09-21T01:06:51.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:50 smithi148 ceph-mon[31000]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T01:06:51.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:06:51.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:50 smithi148 ceph-mon[31000]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:51.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:51 smithi181 ceph-mon[34811]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T01:06:51.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:51 smithi181 ceph-mon[34811]: from='client.? 172.21.15.157:0/3899682207' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2d43be5-822d-4353-bb16-35d6d61e9488"} : dispatch 2024-09-21T01:06:51.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:51 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2d43be5-822d-4353-bb16-35d6d61e9488"} : dispatch 2024-09-21T01:06:51.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:51 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2d43be5-822d-4353-bb16-35d6d61e9488"}]': finished 2024-09-21T01:06:51.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:51 smithi181 ceph-mon[34811]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T01:06:51.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:51 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:06:51.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:51 smithi157 ceph-mon[34140]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T01:06:51.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:51 smithi157 ceph-mon[34140]: from='client.? 172.21.15.157:0/3899682207' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2d43be5-822d-4353-bb16-35d6d61e9488"} : dispatch 2024-09-21T01:06:51.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:51 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2d43be5-822d-4353-bb16-35d6d61e9488"} : dispatch 2024-09-21T01:06:51.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:51 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2d43be5-822d-4353-bb16-35d6d61e9488"}]': finished 2024-09-21T01:06:51.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:51 smithi157 ceph-mon[34140]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T01:06:51.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:51 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:06:52.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:51 smithi148 ceph-mon[31000]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T01:06:52.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:51 smithi148 ceph-mon[31000]: from='client.? 172.21.15.157:0/3899682207' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2d43be5-822d-4353-bb16-35d6d61e9488"} : dispatch 2024-09-21T01:06:52.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:51 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2d43be5-822d-4353-bb16-35d6d61e9488"} : dispatch 2024-09-21T01:06:52.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:51 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2d43be5-822d-4353-bb16-35d6d61e9488"}]': finished 2024-09-21T01:06:52.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:51 smithi148 ceph-mon[31000]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T01:06:52.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:51 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:06:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:52 smithi181 ceph-mon[34811]: from='client.? 172.21.15.157:0/1307201256' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:06:52.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:52 smithi181 ceph-mon[34811]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:52.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:52 smithi157 ceph-mon[34140]: from='client.? 172.21.15.157:0/1307201256' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:06:52.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:52 smithi157 ceph-mon[34140]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:53.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:52 smithi148 ceph-mon[31000]: from='client.? 172.21.15.157:0/1307201256' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:06:53.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:52 smithi148 ceph-mon[31000]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:54.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:54 smithi148 ceph-mon[31000]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:54.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:54 smithi181 ceph-mon[34811]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:54.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:54 smithi157 ceph-mon[34140]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:56 smithi148 ceph-mon[31000]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:56.638 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:56 smithi157 ceph-mon[34140]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:56.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:56 smithi181 ceph-mon[34811]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:58.440 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:58 smithi157 ceph-mon[34140]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:58.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:58 smithi148 ceph-mon[31000]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:06:58.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:58 smithi181 ceph-mon[34811]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:00.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:59 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:07:00.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:06:59 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:00.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:59 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:07:00.242 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:06:59 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:00.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:59 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:07:00.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:06:59 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:01.225 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:00 smithi157 ceph-mon[34140]: Deploying daemon osd.1 on smithi157 2024-09-21T01:07:01.226 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:00 smithi157 ceph-mon[34140]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:01.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:00 smithi181 ceph-mon[34811]: Deploying daemon osd.1 on smithi157 2024-09-21T01:07:01.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:00 smithi181 ceph-mon[34811]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:01.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:00 smithi148 ceph-mon[31000]: Deploying daemon osd.1 on smithi157 2024-09-21T01:07:01.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:00 smithi148 ceph-mon[31000]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:02.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:02 smithi157 ceph-mon[34140]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:02.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:02 smithi148 ceph-mon[31000]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:02.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:02 smithi181 ceph-mon[34811]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:04 smithi148 ceph-mon[31000]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:04 smithi181 ceph-mon[34811]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:04.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:04 smithi157 ceph-mon[34140]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:06.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:06 smithi157 ceph-mon[34140]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:06.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:06.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:06.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:06.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:06 smithi148 ceph-mon[31000]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:06.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:06.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:06.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:06.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:06 smithi181 ceph-mon[34811]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:06.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:06.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:06.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:08.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:08 smithi157 ceph-mon[34140]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:08.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:08 smithi148 ceph-mon[31000]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:08.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:08 smithi181 ceph-mon[34811]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:09.675 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:09.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:09.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:09.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:09.676 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:09.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:09.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:09.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:09.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:09.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:09.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:09.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:09.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:09.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:09.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:10.278 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 1 on host 'smithi157' 2024-09-21T01:07:10.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.277+0000 7fcb4dffb640 1 -- 172.21.15.157:0/2242264777 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcb5002e9d0 con 0x7fcb3c0b6480 2024-09-21T01:07:10.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.279+0000 7fcb56872640 1 -- 172.21.15.157:0/2242264777 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcb3c0b6480 msgr2=0x7fcb3c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:10.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.279+0000 7fcb56872640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcb3c0b6480 0x7fcb3c0b8990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb40032fd0 tx=0x7fcb400314a0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.279+0000 7fcb56872640 1 -- 172.21.15.157:0/2242264777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb50104810 msgr2=0x7fcb5019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.279+0000 7fcb56872640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb50104810 0x7fcb5019a600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800d6d0 tx=0x7fcb3800db90 comp rx=0 tx=0).stop 2024-09-21T01:07:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.279+0000 7fcb56872640 1 -- 172.21.15.157:0/2242264777 shutdown_connections 2024-09-21T01:07:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.279+0000 7fcb56872640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcb3c0b6480 0x7fcb3c0b8990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.279+0000 7fcb56872640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb50104810 0x7fcb5019a600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.279+0000 7fcb56872640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb501051b0 0x7fcb5019b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.279+0000 7fcb56872640 1 --2- 172.21.15.157:0/2242264777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb50103780 0x7fcb50199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.279+0000 7fcb56872640 1 -- 172.21.15.157:0/2242264777 >> 172.21.15.157:0/2242264777 conn(0x7fcb500ff0f0 msgr2=0x7fcb50107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.280+0000 7fcb56872640 1 -- 172.21.15.157:0/2242264777 shutdown_connections 2024-09-21T01:07:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:07:10.280+0000 7fcb56872640 1 -- 172.21.15.157:0/2242264777 wait complete. 2024-09-21T01:07:10.603 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:10 smithi157 ceph-mon[34140]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:10.603 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:10 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:10.604 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:10 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:10.604 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:10 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:10.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:10 smithi181 ceph-mon[34811]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:10.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:10 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:10.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:10 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:10.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:10 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:10.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:10 smithi148 ceph-mon[31000]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:10.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:10 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:10.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:10 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:10.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:10 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:10.924 DEBUG:teuthology.orchestra.run.smithi157:osd.1> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T01:07:10.927 INFO:tasks.cephadm:Deploying osd.2 on smithi181 with /dev/vg_nvme/lv_4... 2024-09-21T01:07:10.927 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:07:12.424 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:12 smithi157 ceph-mon[34140]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:12.555 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:12 smithi181 ceph-mon[34811]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:12.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:12 smithi148 ceph-mon[31000]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:12.741 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:12 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1[38086]: 2024-09-21T01:07:12.427+0000 7fc87e311640 -1 osd.1 0 log_to_monitors true 2024-09-21T01:07:13.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:13 smithi157 ceph-mon[34140]: from='osd.1 [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:07:13.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:13 smithi157 ceph-mon[34140]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:07:13.586 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:13 smithi181 ceph-mon[34811]: from='osd.1 [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:07:13.586 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:13 smithi181 ceph-mon[34811]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:07:13.588 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:07:13.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:13 smithi148 ceph-mon[31000]: from='osd.1 [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:07:13.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:13 smithi148 ceph-mon[31000]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:07:13.619 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_4 2024-09-21T01:07:13.865 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:07:14.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.300+0000 7f3990b6d640 1 -- 172.21.15.181:0/4071948560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398c06b980 msgr2=0x7f398c106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.300+0000 7f3990b6d640 1 --2- 172.21.15.181:0/4071948560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398c06b980 0x7f398c106390 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3984009ca0 tx=0x7f398402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.300+0000 7f3990b6d640 1 -- 172.21.15.181:0/4071948560 shutdown_connections 2024-09-21T01:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.300+0000 7f3990b6d640 1 --2- 172.21.15.181:0/4071948560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f398c1068d0 0x7f398c108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.300+0000 7f3990b6d640 1 --2- 172.21.15.181:0/4071948560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f398c109470 0x7f398c10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.300+0000 7f3990b6d640 1 --2- 172.21.15.181:0/4071948560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398c06b980 0x7f398c106390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.300+0000 7f3990b6d640 1 -- 172.21.15.181:0/4071948560 >> 172.21.15.181:0/4071948560 conn(0x7f398c0fdfb0 msgr2=0x7f398c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.301+0000 7f3990b6d640 1 -- 172.21.15.181:0/4071948560 shutdown_connections 2024-09-21T01:07:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.301+0000 7f3990b6d640 1 -- 172.21.15.181:0/4071948560 wait complete. 2024-09-21T01:07:14.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f3990b6d640 1 Processor -- start 2024-09-21T01:07:14.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f3990b6d640 1 -- start start 2024-09-21T01:07:14.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f3990b6d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f398c06b980 0x7f398c199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:14.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f3990b6d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f398c1068d0 0x7f398c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:14.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f3990b6d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398c109470 0x7f398c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:14.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f3990b6d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f398c10f3d0 con 0x7f398c1068d0 2024-09-21T01:07:14.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f3990b6d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f398c10f250 con 0x7f398c06b980 2024-09-21T01:07:14.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f3990b6d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f398c10f550 con 0x7f398c109470 2024-09-21T01:07:14.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f398ad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398c109470 0x7f398c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:14.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f398ad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398c109470 0x7f398c19b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32780/0 (socket says 172.21.15.181:32780) 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f398ad9d640 1 -- 172.21.15.181:0/1327102590 learned_addr learned my addr 172.21.15.181:0/1327102590 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f3989d9b640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f398c1068d0 0x7f398c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f398a59c640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f398c06b980 0x7f398c199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f398ad9d640 1 -- 172.21.15.181:0/1327102590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f398c06b980 msgr2=0x7f398c199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f398ad9d640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f398c06b980 0x7f398c199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f398ad9d640 1 -- 172.21.15.181:0/1327102590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f398c1068d0 msgr2=0x7f398c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f398ad9d640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f398c1068d0 0x7f398c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.302+0000 7f398ad9d640 1 -- 172.21.15.181:0/1327102590 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c19b9c0 con 0x7f398c109470 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.303+0000 7f398ad9d640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398c109470 0x7f398c19b1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f397c00d750 tx=0x7f397c00dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.303+0000 7f39837fe640 1 -- 172.21.15.181:0/1327102590 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c017070 con 0x7f398c109470 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.303+0000 7f39837fe640 1 -- 172.21.15.181:0/1327102590 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f397c0054d0 con 0x7f398c109470 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.303+0000 7f39837fe640 1 -- 172.21.15.181:0/1327102590 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c004c60 con 0x7f398c109470 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.303+0000 7f3990b6d640 1 -- 172.21.15.181:0/1327102590 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398c19bcb0 con 0x7f398c109470 2024-09-21T01:07:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.303+0000 7f3990b6d640 1 -- 172.21.15.181:0/1327102590 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398c1a23b0 con 0x7f398c109470 2024-09-21T01:07:14.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.304+0000 7f3990b6d640 1 -- 172.21.15.181:0/1327102590 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398c0ffad0 con 0x7f398c109470 2024-09-21T01:07:14.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.307+0000 7f39837fe640 1 -- 172.21.15.181:0/1327102590 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7f397c009bd0 con 0x7f398c109470 2024-09-21T01:07:14.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.308+0000 7f39837fe640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f39780b6480 0x7f39780b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:14.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.308+0000 7f39837fe640 1 -- 172.21.15.181:0/1327102590 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f397c0e55f0 con 0x7f398c109470 2024-09-21T01:07:14.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.308+0000 7f398a59c640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f39780b6480 0x7f39780b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:14.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.308+0000 7f398a59c640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f39780b6480 0x7f39780b8990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3984004af0 tx=0x7f3984000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:14.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.311+0000 7f39837fe640 1 -- 172.21.15.181:0/1327102590 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f397c0ad870 con 0x7f398c109470 2024-09-21T01:07:14.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:14.504+0000 7f3990b6d640 1 -- 172.21.15.181:0/1327102590 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f398c063800 con 0x7f39780b6480 2024-09-21T01:07:14.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:07:14.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='osd.1 [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:07:14.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi157 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi157 to 17088M 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:14 smithi148 ceph-mon[31000]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:07:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='osd.1 [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:07:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T01:07:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:07:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi157 2024-09-21T01:07:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:07:14.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi157 to 17088M 2024-09-21T01:07:14.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:14.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:14.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:14 smithi181 ceph-mon[34811]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:14.740 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1[38086]: 2024-09-21T01:07:14.327+0000 7fc87a293640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T01:07:14.740 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1[38086]: 2024-09-21T01:07:14.333+0000 7fc876091640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='osd.1 [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi157 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi157 to 17088M 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:14.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:14.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:14.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:14 smithi157 ceph-mon[34140]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:15.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:15 smithi181 ceph-mon[34811]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:07:15.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:15 smithi181 ceph-mon[34811]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T01:07:15.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:15.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:15.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:15 smithi181 ceph-mon[34811]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:15.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:07:15.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:07:15.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:15.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:15 smithi148 ceph-mon[31000]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:07:15.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:15 smithi148 ceph-mon[31000]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T01:07:15.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:15.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:15.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:15 smithi148 ceph-mon[31000]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:15.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:07:15.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:07:15.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:15.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:15 smithi157 ceph-mon[34140]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:07:15.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:15 smithi157 ceph-mon[34140]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T01:07:15.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:15.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:15.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:15 smithi157 ceph-mon[34140]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:15.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:07:15.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:07:15.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:16.470 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:16 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:07:16.471 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:16 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:07:16.471 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:16 smithi181 ceph-mon[34811]: osd.1 [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] boot 2024-09-21T01:07:16.471 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:16 smithi181 ceph-mon[34811]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T01:07:16.471 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:16 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:16.471 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:16 smithi181 ceph-mon[34811]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:16.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:16 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:07:16.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:16 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:07:16.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:16 smithi148 ceph-mon[31000]: osd.1 [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] boot 2024-09-21T01:07:16.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:16 smithi148 ceph-mon[31000]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T01:07:16.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:16 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:16.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:16 smithi148 ceph-mon[31000]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:16.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:16 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:07:16.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:16 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:07:16.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:16 smithi157 ceph-mon[34140]: osd.1 [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] boot 2024-09-21T01:07:16.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:16 smithi157 ceph-mon[34140]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T01:07:16.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:16 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:07:16.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:16 smithi157 ceph-mon[34140]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:07:17.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:17 smithi148 ceph-mon[31000]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T01:07:17.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:17 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/3637169935' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c23db819-7af8-4b21-9a9b-8ff53251d19f"} : dispatch 2024-09-21T01:07:17.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:17 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c23db819-7af8-4b21-9a9b-8ff53251d19f"} : dispatch 2024-09-21T01:07:17.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:17 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c23db819-7af8-4b21-9a9b-8ff53251d19f"}]': finished 2024-09-21T01:07:17.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:17 smithi148 ceph-mon[31000]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T01:07:17.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:17 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:17.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:17 smithi181 ceph-mon[34811]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T01:07:17.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:17 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/3637169935' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c23db819-7af8-4b21-9a9b-8ff53251d19f"} : dispatch 2024-09-21T01:07:17.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:17 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c23db819-7af8-4b21-9a9b-8ff53251d19f"} : dispatch 2024-09-21T01:07:17.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:17 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c23db819-7af8-4b21-9a9b-8ff53251d19f"}]': finished 2024-09-21T01:07:17.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:17 smithi181 ceph-mon[34811]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T01:07:17.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:17 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:17.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:17 smithi157 ceph-mon[34140]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T01:07:17.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:17 smithi157 ceph-mon[34140]: from='client.? 172.21.15.181:0/3637169935' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c23db819-7af8-4b21-9a9b-8ff53251d19f"} : dispatch 2024-09-21T01:07:17.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:17 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c23db819-7af8-4b21-9a9b-8ff53251d19f"} : dispatch 2024-09-21T01:07:17.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:17 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c23db819-7af8-4b21-9a9b-8ff53251d19f"}]': finished 2024-09-21T01:07:17.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:17 smithi157 ceph-mon[34140]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T01:07:17.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:17 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:18.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:18 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/2466777560' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:07:18.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:18 smithi148 ceph-mon[31000]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:18.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:18 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/2466777560' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:07:18.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:18 smithi181 ceph-mon[34811]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:18.732 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:18 smithi157 ceph-mon[34140]: from='client.? 172.21.15.181:0/2466777560' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:07:18.732 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:18 smithi157 ceph-mon[34140]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:20 smithi148 ceph-mon[31000]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:20 smithi181 ceph-mon[34811]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:20.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:20 smithi157 ceph-mon[34140]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:22.570 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:22 smithi181 ceph-mon[34811]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:22.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:22 smithi148 ceph-mon[31000]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:22.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:22 smithi157 ceph-mon[34140]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:24.419 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:24 smithi181 ceph-mon[34811]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:24 smithi148 ceph-mon[31000]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:24.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:24 smithi157 ceph-mon[34140]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:25.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:07:25.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:25.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:07:25.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:25.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:07:25.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:26.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:26 smithi181 ceph-mon[34811]: Deploying daemon osd.2 on smithi181 2024-09-21T01:07:26.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:26 smithi181 ceph-mon[34811]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:26.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:26 smithi157 ceph-mon[34140]: Deploying daemon osd.2 on smithi181 2024-09-21T01:07:26.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:26 smithi157 ceph-mon[34140]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:26.764 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:26 smithi148 ceph-mon[31000]: Deploying daemon osd.2 on smithi181 2024-09-21T01:07:26.765 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:26 smithi148 ceph-mon[31000]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:28.449 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:28 smithi181 ceph-mon[34811]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:28.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:28 smithi148 ceph-mon[31000]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:28.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:28 smithi157 ceph-mon[34140]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:30.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:30 smithi148 ceph-mon[31000]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:30.692 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:30 smithi181 ceph-mon[34811]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:30.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:30 smithi157 ceph-mon[34140]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:32.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:31 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:32.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:31 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:32.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:31 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:32.197 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:31 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:32.198 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:31 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:32.198 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:31 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:32.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:31 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:32.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:31 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:32.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:31 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:33.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:32 smithi148 ceph-mon[31000]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:33.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:32 smithi181 ceph-mon[34811]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:33.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:32 smithi157 ceph-mon[34140]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:34.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:34 smithi148 ceph-mon[31000]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:34 smithi181 ceph-mon[34811]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:34.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:34 smithi157 ceph-mon[34140]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:35.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.428+0000 7f39837fe640 1 -- 172.21.15.181:0/1327102590 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f398c063800 con 0x7f39780b6480 2024-09-21T01:07:35.429 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 2 on host 'smithi181' 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.430+0000 7f3990b6d640 1 -- 172.21.15.181:0/1327102590 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f39780b6480 msgr2=0x7f39780b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f39780b6480 0x7f39780b8990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3984004af0 tx=0x7f3984000f40 comp rx=0 tx=0).stop 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 -- 172.21.15.181:0/1327102590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398c109470 msgr2=0x7f398c19b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398c109470 0x7f398c19b1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f397c00d750 tx=0x7f397c00dc10 comp rx=0 tx=0).stop 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 -- 172.21.15.181:0/1327102590 shutdown_connections 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f39780b6480 0x7f39780b8990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f398c1068d0 0x7f398c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398c109470 0x7f398c19b1a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 --2- 172.21.15.181:0/1327102590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f398c06b980 0x7f398c199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 -- 172.21.15.181:0/1327102590 >> 172.21.15.181:0/1327102590 conn(0x7f398c0fdfb0 msgr2=0x7f398c104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:35.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 -- 172.21.15.181:0/1327102590 shutdown_connections 2024-09-21T01:07:35.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:07:35.431+0000 7f3990b6d640 1 -- 172.21.15.181:0/1327102590 wait complete. 2024-09-21T01:07:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:35.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:35.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:35.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:35.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:35.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:35.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:35.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:36.001 DEBUG:teuthology.orchestra.run.smithi181:osd.2> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T01:07:36.003 INFO:tasks.cephadm:Deploying osd.3 on smithi148 with /dev/vg_nvme/lv_3... 2024-09-21T01:07:36.004 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T01:07:36.256 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:36.635 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:36 smithi148 ceph-mon[31000]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:36.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:36 smithi181 ceph-mon[34811]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:36.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:36 smithi157 ceph-mon[34140]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:38.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:37 smithi181 ceph-mon[34811]: from='osd.2 [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:07:38.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:37 smithi181 ceph-mon[34811]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:07:38.189 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2[39225]: 2024-09-21T01:07:37.911+0000 7f465bed8640 -1 osd.2 0 log_to_monitors true 2024-09-21T01:07:38.224 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:37 smithi148 ceph-mon[31000]: from='osd.2 [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:07:38.224 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:37 smithi148 ceph-mon[31000]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:07:38.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:37 smithi157 ceph-mon[34140]: from='osd.2 [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:07:38.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:37 smithi157 ceph-mon[34140]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:07:38.818 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:07:38.849 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_3 2024-09-21T01:07:39.105 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:39.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:07:39.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T01:07:39.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:39.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='osd.2 [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:07:39.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:07:39.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:39.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:07:39.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:39.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:39.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:38 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:07:39.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T01:07:39.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:39.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='osd.2 [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:07:39.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:07:39.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:39.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:07:39.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:39.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:39.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:38 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='osd.2 [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:39.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:38 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:39.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 -- 172.21.15.148:0/1832487646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f255806c680 msgr2=0x7f25581063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:39.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 --2- 172.21.15.148:0/1832487646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f255806c680 0x7f25581063c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2548009900 tx=0x7f254802a410 comp rx=0 tx=0).stop 2024-09-21T01:07:39.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 -- 172.21.15.148:0/1832487646 shutdown_connections 2024-09-21T01:07:39.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 --2- 172.21.15.148:0/1832487646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25581094a0 0x7f255810b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 --2- 172.21.15.148:0/1832487646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2558106900 0x7f2558108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 --2- 172.21.15.148:0/1832487646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f255806c680 0x7f25581063c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 -- 172.21.15.148:0/1832487646 >> 172.21.15.148:0/1832487646 conn(0x7f25580fdfe0 msgr2=0x7f2558100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:39.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 -- 172.21.15.148:0/1832487646 shutdown_connections 2024-09-21T01:07:39.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 -- 172.21.15.148:0/1832487646 wait complete. 2024-09-21T01:07:39.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 Processor -- start 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.593+0000 7f255e703640 1 -- start start 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255e703640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f255806c680 0x7f2558199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255e703640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2558106900 0x7f255819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255e703640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25581094a0 0x7f255819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255e703640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f255810f390 con 0x7f25581094a0 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255e703640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f255810f210 con 0x7f255806c680 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255e703640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f255810f510 con 0x7f2558106900 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255cca0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25581094a0 0x7f255819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f25577fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2558106900 0x7f255819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f25577fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2558106900 0x7f255819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:46010/0 (socket says 172.21.15.148:46010) 2024-09-21T01:07:39.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255cca0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25581094a0 0x7f255819b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59688/0 (socket says 172.21.15.148:59688) 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f25577fe640 1 -- 172.21.15.148:0/1375712523 learned_addr learned my addr 172.21.15.148:0/1375712523 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f2557fff640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f255806c680 0x7f2558199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255cca0640 1 -- 172.21.15.148:0/1375712523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2558106900 msgr2=0x7f255819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255cca0640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2558106900 0x7f255819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255cca0640 1 -- 172.21.15.148:0/1375712523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f255806c680 msgr2=0x7f2558199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255cca0640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f255806c680 0x7f2558199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f255cca0640 1 -- 172.21.15.148:0/1375712523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255819ba10 con 0x7f25581094a0 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.594+0000 7f25577fe640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2558106900 0x7f255819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.595+0000 7f255cca0640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25581094a0 0x7f255819b1f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f255000ca30 tx=0x7f255000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.595+0000 7f25557fa640 1 -- 172.21.15.148:0/1375712523 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550007d90 con 0x7f25581094a0 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.595+0000 7f255e703640 1 -- 172.21.15.148:0/1375712523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255819bd00 con 0x7f25581094a0 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.595+0000 7f25557fa640 1 -- 172.21.15.148:0/1375712523 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2550005020 con 0x7f25581094a0 2024-09-21T01:07:39.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.595+0000 7f25557fa640 1 -- 172.21.15.148:0/1375712523 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255000f690 con 0x7f25581094a0 2024-09-21T01:07:39.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.595+0000 7f255e703640 1 -- 172.21.15.148:0/1375712523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25581a2400 con 0x7f25581094a0 2024-09-21T01:07:39.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.596+0000 7f255e703640 1 -- 172.21.15.148:0/1375712523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25580ffb00 con 0x7f25581094a0 2024-09-21T01:07:39.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.597+0000 7f25557fa640 1 -- 172.21.15.148:0/1375712523 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 154457+0+0 (secure 0 0 0) 0x7f25500051d0 con 0x7f25581094a0 2024-09-21T01:07:39.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.598+0000 7f25557fa640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25400b6480 0x7f25400b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:39.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.598+0000 7f2557fff640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25400b6480 0x7f25400b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:39.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.598+0000 7f25557fa640 1 -- 172.21.15.148:0/1375712523 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f25500e61b0 con 0x7f25581094a0 2024-09-21T01:07:39.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.598+0000 7f2557fff640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25400b6480 0x7f25400b8990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2548000c00 tx=0x7f2548031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:39.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.601+0000 7f25557fa640 1 -- 172.21.15.148:0/1375712523 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2550014070 con 0x7f25581094a0 2024-09-21T01:07:39.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:39.789+0000 7f255e703640 1 -- 172.21.15.148:0/1375712523 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2558063800 con 0x7f25400b6480 2024-09-21T01:07:40.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:39 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi181 2024-09-21T01:07:40.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:39 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi181 to 17088M 2024-09-21T01:07:40.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:39 smithi148 ceph-mon[31000]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:07:40.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:39 smithi148 ceph-mon[31000]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T01:07:40.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:40.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:40.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:07:40.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:07:40.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:40.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:39 smithi148 ceph-mon[31000]: from='osd.2 ' entity='osd.2' 2024-09-21T01:07:40.230 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2[39225]: 2024-09-21T01:07:39.891+0000 7f465866f640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T01:07:40.230 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:40 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2[39225]: 2024-09-21T01:07:40.055+0000 7f464fc50640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:07:40.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi181 2024-09-21T01:07:40.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi181 to 17088M 2024-09-21T01:07:40.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-mon[34811]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:07:40.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-mon[34811]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T01:07:40.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:40.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:40.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:07:40.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:07:40.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:40.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:39 smithi181 ceph-mon[34811]: from='osd.2 ' entity='osd.2' 2024-09-21T01:07:40.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:39 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi181 2024-09-21T01:07:40.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:39 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi181 to 17088M 2024-09-21T01:07:40.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:39 smithi157 ceph-mon[34140]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:07:40.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:39 smithi157 ceph-mon[34140]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T01:07:40.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:40.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:40.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:07:40.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:07:40.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:40.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:39 smithi157 ceph-mon[34140]: from='osd.2 ' entity='osd.2' 2024-09-21T01:07:41.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:40 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:07:41.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:40 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:07:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:40 smithi148 ceph-mon[31000]: from='client.14463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:40 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:40 smithi148 ceph-mon[31000]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:41.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:40 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:07:41.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:40 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:07:41.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:40 smithi157 ceph-mon[34140]: from='client.14463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:41.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:40 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:41.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:40 smithi157 ceph-mon[34140]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:41.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:40 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:07:41.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:40 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:07:41.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:40 smithi181 ceph-mon[34811]: from='client.14463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:41.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:40 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:41.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:40 smithi181 ceph-mon[34811]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:07:42.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:42.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:41 smithi157 ceph-mon[34140]: osd.2 [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] boot 2024-09-21T01:07:42.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:41 smithi157 ceph-mon[34140]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T01:07:42.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:42.315 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:42.315 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:41 smithi148 ceph-mon[31000]: osd.2 [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] boot 2024-09-21T01:07:42.315 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:41 smithi148 ceph-mon[31000]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T01:07:42.315 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:42.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:42.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:41 smithi181 ceph-mon[34811]: osd.2 [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] boot 2024-09-21T01:07:42.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:41 smithi181 ceph-mon[34811]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T01:07:42.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:07:43.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:42 smithi148 ceph-mon[31000]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T01:07:43.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:42 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2172888303' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09b1f0c6-d745-4a7f-af0b-e27ba52e188c"} : dispatch 2024-09-21T01:07:43.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:42 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2172888303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09b1f0c6-d745-4a7f-af0b-e27ba52e188c"}]': finished 2024-09-21T01:07:43.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:42 smithi148 ceph-mon[31000]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T01:07:43.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:42 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:43.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:42 smithi148 ceph-mon[31000]: pgmap v94: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:43.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:42 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:07:43.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:42 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3277040810' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:07:43.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:42 smithi181 ceph-mon[34811]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T01:07:43.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:42 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2172888303' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09b1f0c6-d745-4a7f-af0b-e27ba52e188c"} : dispatch 2024-09-21T01:07:43.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:42 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2172888303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09b1f0c6-d745-4a7f-af0b-e27ba52e188c"}]': finished 2024-09-21T01:07:43.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:42 smithi181 ceph-mon[34811]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T01:07:43.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:42 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:43.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:42 smithi181 ceph-mon[34811]: pgmap v94: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:42 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:07:43.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:42 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3277040810' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:07:43.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:42 smithi157 ceph-mon[34140]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T01:07:43.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:42 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2172888303' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09b1f0c6-d745-4a7f-af0b-e27ba52e188c"} : dispatch 2024-09-21T01:07:43.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:42 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2172888303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09b1f0c6-d745-4a7f-af0b-e27ba52e188c"}]': finished 2024-09-21T01:07:43.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:42 smithi157 ceph-mon[34140]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T01:07:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:42 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:42 smithi157 ceph-mon[34140]: pgmap v94: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:42 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:07:43.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:42 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3277040810' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:07:44.453 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50809]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:07:44.453 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50809]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.453 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.453 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50809]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.453 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50812]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:07:44.453 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50812]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.453 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.454 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50812]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.454 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T01:07:44.454 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 ceph-mon[31000]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T01:07:44.454 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:44.454 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:07:44.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T01:07:44.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 ceph-mon[34811]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T01:07:44.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:44.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:07:44.480 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43177]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:07:44.481 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43177]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.481 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.481 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43177]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.481 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43180]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:07:44.481 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43180]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.481 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.481 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43180]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T01:07:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 ceph-mon[34140]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T01:07:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:07:44.491 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41904]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:07:44.491 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41904]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.491 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.491 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41904]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.491 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41907]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:07:44.491 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41907]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.491 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.491 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41907]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50998]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:07:44.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50998]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[50998]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[51001]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:07:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[51001]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[51001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:44 smithi148 sudo[51001]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43183]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:07:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43183]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43183]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43186]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:07:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43186]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:44 smithi181 sudo[43186]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41910]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:07:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41910]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41910]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41913]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:07:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41913]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:07:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:07:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:44 smithi157 sudo[41913]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:07:45.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:07:45.187+0000 7f25557fa640 1 -- 172.21.15.148:0/1375712523 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f25500a9db0 con 0x7f25581094a0 2024-09-21T01:07:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:07:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T01:07:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:07:45.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:07:45.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:45.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:45.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:45.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:45 smithi181 ceph-mon[34811]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:07:45.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:07:45.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:07:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:07:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:45.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:45 smithi157 ceph-mon[34140]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:07:45.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:07:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:45.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:45.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:45.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:07:45.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:07:45.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:45.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:45.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:45.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:45 smithi148 ceph-mon[31000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:07:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:46 smithi181 ceph-mon[34811]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T01:07:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:46 smithi181 ceph-mon[34811]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T01:07:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:46 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:46 smithi157 ceph-mon[34140]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T01:07:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:46 smithi157 ceph-mon[34140]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T01:07:46.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:46 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:46.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:46 smithi148 ceph-mon[31000]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T01:07:46.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:46 smithi148 ceph-mon[31000]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T01:07:46.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:46 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:07:47.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:47 smithi181 ceph-mon[34811]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:47.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:47 smithi157 ceph-mon[34140]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:47.522 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:47 smithi148 ceph-mon[31000]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:48.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:48 smithi181 ceph-mon[34811]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:48.544 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:48 smithi148 ceph-mon[31000]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:48.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:48 smithi157 ceph-mon[34140]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:50.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:50 smithi148 ceph-mon[31000]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:50.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:50 smithi181 ceph-mon[34811]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:50.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:50 smithi157 ceph-mon[34140]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:51.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:51 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:07:51.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:51 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:51.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:51 smithi148 ceph-mon[31000]: Deploying daemon osd.3 on smithi148 2024-09-21T01:07:51.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:51 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:07:51.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:51 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:51.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:51 smithi181 ceph-mon[34811]: Deploying daemon osd.3 on smithi148 2024-09-21T01:07:51.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:51 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:07:51.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:51 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:51.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:51 smithi157 ceph-mon[34140]: Deploying daemon osd.3 on smithi148 2024-09-21T01:07:52.452 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:52 smithi148 ceph-mon[31000]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:52.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:52 smithi181 ceph-mon[34811]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:52.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:52 smithi157 ceph-mon[34140]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:54.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:54 smithi148 ceph-mon[31000]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:54.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:54 smithi181 ceph-mon[34811]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:54.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:54 smithi157 ceph-mon[34140]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:56.603 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:56 smithi148 ceph-mon[31000]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:56.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:56 smithi181 ceph-mon[34811]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:56.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:56 smithi157 ceph-mon[34140]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:57.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:57.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:57.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:57 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:57 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:57 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:57 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:57 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:57 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:07:58.594 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:07:58 smithi148 ceph-mon[31000]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:58.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:07:58 smithi181 ceph-mon[34811]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:07:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:07:58 smithi157 ceph-mon[34140]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:08:00.519 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:00.519 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:00.519 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:00.519 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:00.519 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:00.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.560+0000 7f25557fa640 1 -- 172.21.15.148:0/1375712523 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2558063800 con 0x7f25400b6480 2024-09-21T01:08:00.561 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 3 on host 'smithi148' 2024-09-21T01:08:00.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 -- 172.21.15.148:0/1375712523 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25400b6480 msgr2=0x7f25400b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:00.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25400b6480 0x7f25400b8990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2548000c00 tx=0x7f2548031400 comp rx=0 tx=0).stop 2024-09-21T01:08:00.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 -- 172.21.15.148:0/1375712523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25581094a0 msgr2=0x7f255819b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:00.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25581094a0 0x7f255819b1f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f255000ca30 tx=0x7f255000cef0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 -- 172.21.15.148:0/1375712523 shutdown_connections 2024-09-21T01:08:00.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25400b6480 0x7f25400b8990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25581094a0 0x7f255819b1f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2558106900 0x7f255819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 --2- 172.21.15.148:0/1375712523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f255806c680 0x7f2558199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 -- 172.21.15.148:0/1375712523 >> 172.21.15.148:0/1375712523 conn(0x7f25580fdfe0 msgr2=0x7f2558104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:00.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.562+0000 7f255e703640 1 -- 172.21.15.148:0/1375712523 shutdown_connections 2024-09-21T01:08:00.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:00.563+0000 7f255e703640 1 -- 172.21.15.148:0/1375712523 wait complete. 2024-09-21T01:08:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:00.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:00.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:00.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:00.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:00.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:01.200 DEBUG:teuthology.orchestra.run.smithi148:osd.3> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T01:08:01.202 INFO:tasks.cephadm:Deploying osd.4 on smithi157 with /dev/vg_nvme/lv_3... 2024-09-21T01:08:01.202 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T01:08:01.458 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:08:01.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:01 smithi157 ceph-mon[34140]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:08:01.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:01 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:01.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:01 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:01.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:01 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:01.500 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:01 smithi148 ceph-mon[31000]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:08:01.501 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:01 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:01.501 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:01 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:01.501 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:01 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:01.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:01 smithi181 ceph-mon[34811]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:08:01.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:01 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:01.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:01 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:01.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:01 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:02.520 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:02 smithi148 ceph-mon[31000]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:08:02.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:02 smithi157 ceph-mon[34140]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:08:02.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:02 smithi181 ceph-mon[34811]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:08:03.228 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:08:02 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3[52517]: 2024-09-21T01:08:02.968+0000 7f40fb1fb640 -1 osd.3 0 log_to_monitors true 2024-09-21T01:08:03.433 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:03 smithi157 ceph-mon[34140]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:08:03.535 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:03 smithi148 ceph-mon[31000]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:08:03.713 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:08:03.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:03 smithi181 ceph-mon[34811]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:08:03.741 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi157:vg_nvme/lv_3 2024-09-21T01:08:04.008 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:08:04.398 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:08:04.398 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi148 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.399 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:04 smithi157 ceph-mon[34140]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.493+0000 7f978caeb640 1 -- 172.21.15.157:0/2784577867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f978806c680 msgr2=0x7f97881063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.493+0000 7f978caeb640 1 --2- 172.21.15.157:0/2784577867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f978806c680 0x7f97881063e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9778009900 tx=0x7f977802a410 comp rx=0 tx=0).stop 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.493+0000 7f978caeb640 1 -- 172.21.15.157:0/2784577867 shutdown_connections 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.493+0000 7f978caeb640 1 --2- 172.21.15.157:0/2784577867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97881094c0 0x7f978810b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.493+0000 7f978caeb640 1 --2- 172.21.15.157:0/2784577867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9788106920 0x7f9788108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.493+0000 7f978caeb640 1 --2- 172.21.15.157:0/2784577867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f978806c680 0x7f97881063e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.493+0000 7f978caeb640 1 -- 172.21.15.157:0/2784577867 >> 172.21.15.157:0/2784577867 conn(0x7f97880fe000 msgr2=0x7f97881004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.493+0000 7f978caeb640 1 -- 172.21.15.157:0/2784577867 shutdown_connections 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.493+0000 7f978caeb640 1 -- 172.21.15.157:0/2784577867 wait complete. 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978caeb640 1 Processor -- start 2024-09-21T01:08:04.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978caeb640 1 -- start start 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978caeb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f978806c680 0x7f978819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978caeb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9788106920 0x7f978819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978caeb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97881094c0 0x7f978819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978caeb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f978810f3d0 con 0x7f97881094c0 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978caeb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f978810f250 con 0x7f978806c680 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978caeb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f978810f550 con 0x7f9788106920 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978659c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f978806c680 0x7f978819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978659c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f978806c680 0x7f978819a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37268/0 (socket says 172.21.15.157:37268) 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978659c640 1 -- 172.21.15.157:0/3995356262 learned_addr learned my addr 172.21.15.157:0/3995356262 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f9785d9b640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9788106920 0x7f978819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f9786d9d640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97881094c0 0x7f978819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978659c640 1 -- 172.21.15.157:0/3995356262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9788106920 msgr2=0x7f978819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:04.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978659c640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9788106920 0x7f978819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978659c640 1 -- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97881094c0 msgr2=0x7f978819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978659c640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97881094c0 0x7f978819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f978659c640 1 -- 172.21.15.157:0/3995356262 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978819ba50 con 0x7f978806c680 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.494+0000 7f9786d9d640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97881094c0 0x7f978819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.495+0000 7f978659c640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f978806c680 0x7f978819a020 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9778006010 tx=0x7f9778004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.495+0000 7f97777fe640 1 -- 172.21.15.157:0/3995356262 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977803f030 con 0x7f978806c680 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.495+0000 7f97777fe640 1 -- 172.21.15.157:0/3995356262 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9778003cb0 con 0x7f978806c680 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.495+0000 7f97777fe640 1 -- 172.21.15.157:0/3995356262 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778035070 con 0x7f978806c680 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.495+0000 7f978caeb640 1 -- 172.21.15.157:0/3995356262 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978819bce0 con 0x7f978806c680 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.495+0000 7f978caeb640 1 -- 172.21.15.157:0/3995356262 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97881a2440 con 0x7f978806c680 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.496+0000 7f978caeb640 1 -- 172.21.15.157:0/3995356262 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97880ffb20 con 0x7f978806c680 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.497+0000 7f97777fe640 1 -- 172.21.15.157:0/3995356262 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f9778042030 con 0x7f978806c680 2024-09-21T01:08:04.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.498+0000 7f97777fe640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97700b6590 0x7f97700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:04.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.498+0000 7f97777fe640 1 -- 172.21.15.157:0/3995356262 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3389+0+0 (secure 0 0 0) 0x7f9778106cc0 con 0x7f978806c680 2024-09-21T01:08:04.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.498+0000 7f9785d9b640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97700b6590 0x7f97700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:04.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.499+0000 7f9785d9b640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97700b6590 0x7f97700b8aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f977c005fd0 tx=0x7f977c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:04.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.502+0000 7f97777fe640 1 -- 172.21.15.157:0/3995356262 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97780ce890 con 0x7f978806c680 2024-09-21T01:08:04.613 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3[52517]: 2024-09-21T01:08:04.337+0000 7f40f717d640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T01:08:04.613 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3[52517]: 2024-09-21T01:08:04.344+0000 7f40f2f7b640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:08:04.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:08:04.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T01:08:04.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:08:04.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:04.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi148 2024-09-21T01:08:04.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:04.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:04.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-21T01:08:04.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:04.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:04.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:04 smithi148 ceph-mon[31000]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:08:04.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:04.689+0000 7f978caeb640 1 -- 172.21.15.157:0/3995356262 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9788063800 con 0x7f97700b6590 2024-09-21T01:08:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:08:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T01:08:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:08:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi148 2024-09-21T01:08:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:04.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:04.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-21T01:08:04.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:04.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:04.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:04.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:04 smithi181 ceph-mon[34811]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:08:05.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:05 smithi148 ceph-mon[31000]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:08:05.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:05 smithi148 ceph-mon[31000]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T01:08:05.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:05.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:05.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:05 smithi148 ceph-mon[31000]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:05.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:05.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:05.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:05.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:05 smithi157 ceph-mon[34140]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:08:05.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:05 smithi157 ceph-mon[34140]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T01:08:05.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:05.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:05.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:05 smithi157 ceph-mon[34140]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:05.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:05.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:05.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:05.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:05 smithi181 ceph-mon[34811]: from='osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:08:05.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:05 smithi181 ceph-mon[34811]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T01:08:05.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:05.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:05.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:05 smithi181 ceph-mon[34811]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:05.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:05.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:05.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:06.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:06 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:08:06.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:06 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:08:06.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:06 smithi148 ceph-mon[31000]: osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] boot 2024-09-21T01:08:06.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:06 smithi148 ceph-mon[31000]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T01:08:06.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:06.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:06 smithi148 ceph-mon[31000]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T01:08:06.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:06 smithi148 ceph-mon[31000]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:06.630 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:06 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:08:06.630 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:06 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:08:06.631 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:06 smithi157 ceph-mon[34140]: osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] boot 2024-09-21T01:08:06.631 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:06 smithi157 ceph-mon[34140]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T01:08:06.631 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:06.631 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:06 smithi157 ceph-mon[34140]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T01:08:06.631 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:06 smithi157 ceph-mon[34140]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:06.631 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:06 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:08:06.631 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:06 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:08:06.631 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:06 smithi181 ceph-mon[34811]: osd.3 [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] boot 2024-09-21T01:08:06.631 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:06 smithi181 ceph-mon[34811]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T01:08:06.631 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:08:06.632 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:06 smithi181 ceph-mon[34811]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T01:08:06.632 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:06 smithi181 ceph-mon[34811]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:07.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:07 smithi157 ceph-mon[34140]: from='client.? 172.21.15.157:0/561951774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65e3c06a-76f8-4b6d-8856-4e956f2117d2"} : dispatch 2024-09-21T01:08:08.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:07 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65e3c06a-76f8-4b6d-8856-4e956f2117d2"} : dispatch 2024-09-21T01:08:08.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:07 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65e3c06a-76f8-4b6d-8856-4e956f2117d2"}]': finished 2024-09-21T01:08:08.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:07 smithi157 ceph-mon[34140]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T01:08:08.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:07 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:08.095 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:07 smithi181 ceph-mon[34811]: from='client.? 172.21.15.157:0/561951774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65e3c06a-76f8-4b6d-8856-4e956f2117d2"} : dispatch 2024-09-21T01:08:08.095 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:07 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65e3c06a-76f8-4b6d-8856-4e956f2117d2"} : dispatch 2024-09-21T01:08:08.095 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:07 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65e3c06a-76f8-4b6d-8856-4e956f2117d2"}]': finished 2024-09-21T01:08:08.096 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:07 smithi181 ceph-mon[34811]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T01:08:08.096 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:07 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:08.096 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:07 smithi148 ceph-mon[31000]: from='client.? 172.21.15.157:0/561951774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65e3c06a-76f8-4b6d-8856-4e956f2117d2"} : dispatch 2024-09-21T01:08:08.096 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:07 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65e3c06a-76f8-4b6d-8856-4e956f2117d2"} : dispatch 2024-09-21T01:08:08.096 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:07 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65e3c06a-76f8-4b6d-8856-4e956f2117d2"}]': finished 2024-09-21T01:08:08.096 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:07 smithi148 ceph-mon[31000]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T01:08:08.096 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:07 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:08.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:08 smithi148 ceph-mon[31000]: from='client.? 172.21.15.157:0/279929785' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:08.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:08 smithi148 ceph-mon[31000]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:08.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:08 smithi181 ceph-mon[34811]: from='client.? 172.21.15.157:0/279929785' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:08.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:08 smithi181 ceph-mon[34811]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:08.745 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:08 smithi157 ceph-mon[34140]: from='client.? 172.21.15.157:0/279929785' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:08.746 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:08 smithi157 ceph-mon[34140]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:10.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:10 smithi148 ceph-mon[31000]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T01:08:10.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:10 smithi181 ceph-mon[34811]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T01:08:10.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:10 smithi157 ceph-mon[34140]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T01:08:12.444 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:12 smithi157 ceph-mon[34140]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T01:08:12.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:12 smithi148 ceph-mon[31000]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T01:08:12.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:12 smithi181 ceph-mon[34811]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T01:08:14.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:14 smithi148 ceph-mon[31000]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:08:14.670 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:14 smithi157 ceph-mon[34140]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:08:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:14 smithi181 ceph-mon[34811]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:08:15.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:08:15.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:15.683 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:08:15.683 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:15.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:08:15.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:16.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:16 smithi148 ceph-mon[31000]: Deploying daemon osd.4 on smithi157 2024-09-21T01:08:16.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:16 smithi148 ceph-mon[31000]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:08:16.694 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:16 smithi157 ceph-mon[34140]: Deploying daemon osd.4 on smithi157 2024-09-21T01:08:16.695 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:16 smithi157 ceph-mon[34140]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:08:16.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:16 smithi181 ceph-mon[34811]: Deploying daemon osd.4 on smithi157 2024-09-21T01:08:16.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:16 smithi181 ceph-mon[34811]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:08:18.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:18 smithi157 ceph-mon[34140]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T01:08:18.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:18 smithi148 ceph-mon[31000]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T01:08:18.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:18 smithi181 ceph-mon[34811]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T01:08:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:20 smithi148 ceph-mon[31000]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:08:20.644 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:20 smithi157 ceph-mon[34140]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:08:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:20 smithi181 ceph-mon[34811]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:08:21.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:21 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:21.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:21 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:21.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:21 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:21.871 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:21 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:21.871 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:21 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:21.871 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:21 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:21.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:21 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:21.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:21 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:21.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:21 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:22.804 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:22 smithi157 ceph-mon[34140]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:08:22.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:22 smithi148 ceph-mon[31000]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:08:22.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:22 smithi181 ceph-mon[34811]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:08:25.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.097+0000 7f97777fe640 1 -- 172.21.15.157:0/3995356262 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9788063800 con 0x7f97700b6590 2024-09-21T01:08:25.098 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 4 on host 'smithi157' 2024-09-21T01:08:25.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 -- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97700b6590 msgr2=0x7f97700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:25.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97700b6590 0x7f97700b8aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f977c005fd0 tx=0x7f977c00b390 comp rx=0 tx=0).stop 2024-09-21T01:08:25.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 -- 172.21.15.157:0/3995356262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f978806c680 msgr2=0x7f978819a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:25.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f978806c680 0x7f978819a020 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9778006010 tx=0x7f9778004340 comp rx=0 tx=0).stop 2024-09-21T01:08:25.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 -- 172.21.15.157:0/3995356262 shutdown_connections 2024-09-21T01:08:25.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f97700b6590 0x7f97700b8aa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97881094c0 0x7f978819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9788106920 0x7f978819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 --2- 172.21.15.157:0/3995356262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f978806c680 0x7f978819a020 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 -- 172.21.15.157:0/3995356262 >> 172.21.15.157:0/3995356262 conn(0x7f97880fe000 msgr2=0x7f9788104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:25.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 -- 172.21.15.157:0/3995356262 shutdown_connections 2024-09-21T01:08:25.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:08:25.099+0000 7f978caeb640 1 -- 172.21.15.157:0/3995356262 wait complete. 2024-09-21T01:08:25.409 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.410 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.410 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:25.410 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:25.410 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.410 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:25 smithi157 ceph-mon[34140]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:25.410 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:25.410 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.410 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:25 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:25.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:25.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:25 smithi181 ceph-mon[34811]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:25.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:25.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:25 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:25.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:25.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:25 smithi148 ceph-mon[31000]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:25.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:25.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:25 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:25.695 DEBUG:teuthology.orchestra.run.smithi157:osd.4> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T01:08:25.697 INFO:tasks.cephadm:Deploying osd.5 on smithi181 with /dev/vg_nvme/lv_3... 2024-09-21T01:08:25.697 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T01:08:25.951 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:08:26.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:26 smithi157 ceph-mon[34140]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:26.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:26 smithi148 ceph-mon[31000]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:26.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:26 smithi181 ceph-mon[34811]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:27.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:27 smithi181 ceph-mon[34811]: from='osd.4 [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:08:27.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:27 smithi181 ceph-mon[34811]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:08:28.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:27 smithi148 ceph-mon[31000]: from='osd.4 [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:08:28.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:27 smithi148 ceph-mon[31000]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:08:28.130 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:27 smithi157 ceph-mon[34140]: from='osd.4 [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:08:28.131 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:27 smithi157 ceph-mon[34140]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:08:28.131 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:08:27 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4[44493]: 2024-09-21T01:08:27.825+0000 7fc6a8682640 -1 osd.4 0 log_to_monitors true 2024-09-21T01:08:28.348 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:08:28.376 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_3 2024-09-21T01:08:28.640 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:08:28.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:08:28.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T01:08:28.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:28.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='osd.4 [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:08:28.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:08:28.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:28.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:28.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:28.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:28.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:28.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:28.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:28.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:28.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:28 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.093+0000 7fe680fb2640 1 -- 172.21.15.181:0/1377423182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe67c1094a0 msgr2=0x7fe67c10b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.093+0000 7fe680fb2640 1 --2- 172.21.15.181:0/1377423182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe67c1094a0 0x7fe67c10b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe674009ca0 tx=0x7fe67402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.093+0000 7fe680fb2640 1 -- 172.21.15.181:0/1377423182 shutdown_connections 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.093+0000 7fe680fb2640 1 --2- 172.21.15.181:0/1377423182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe67c1094a0 0x7fe67c10b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.093+0000 7fe680fb2640 1 --2- 172.21.15.181:0/1377423182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe67c106960 0x7fe67c108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.093+0000 7fe680fb2640 1 --2- 172.21.15.181:0/1377423182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c06c2c0 0x7fe67c106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.093+0000 7fe680fb2640 1 -- 172.21.15.181:0/1377423182 >> 172.21.15.181:0/1377423182 conn(0x7fe67c0fdfa0 msgr2=0x7fe67c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.093+0000 7fe680fb2640 1 -- 172.21.15.181:0/1377423182 shutdown_connections 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.093+0000 7fe680fb2640 1 -- 172.21.15.181:0/1377423182 wait complete. 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe680fb2640 1 Processor -- start 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe680fb2640 1 -- start start 2024-09-21T01:08:29.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe680fb2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe67c06c2c0 0x7fe67c199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe680fb2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe67c106960 0x7fe67c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe680fb2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1094a0 0x7fe67c19b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe680fb2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c10f390 con 0x7fe67c1094a0 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe680fb2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c10f210 con 0x7fe67c106960 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe680fb2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c10f510 con 0x7fe67c06c2c0 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe67a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe67c06c2c0 0x7fe67c199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe67a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe67c06c2c0 0x7fe67c199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45898/0 (socket says 172.21.15.181:45898) 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe67a59c640 1 -- 172.21.15.181:0/3555252343 learned_addr learned my addr 172.21.15.181:0/3555252343 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.094+0000 7fe673fff640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe67c106960 0x7fe67c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe67ad9d640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1094a0 0x7fe67c19b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe67a59c640 1 -- 172.21.15.181:0/3555252343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe67c106960 msgr2=0x7fe67c19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe67a59c640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe67c106960 0x7fe67c19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe67a59c640 1 -- 172.21.15.181:0/3555252343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1094a0 msgr2=0x7fe67c19b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:29.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe67a59c640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1094a0 0x7fe67c19b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:29.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe67a59c640 1 -- 172.21.15.181:0/3555252343 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c19b9b0 con 0x7fe67c06c2c0 2024-09-21T01:08:29.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe673fff640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe67c106960 0x7fe67c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:08:29.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe67a59c640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe67c06c2c0 0x7fe67c199f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00e9f0 tx=0x7fe66c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:29.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe6737fe640 1 -- 172.21.15.181:0/3555252343 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00cd80 con 0x7fe67c06c2c0 2024-09-21T01:08:29.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe680fb2640 1 -- 172.21.15.181:0/3555252343 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67c19bca0 con 0x7fe67c06c2c0 2024-09-21T01:08:29.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe680fb2640 1 -- 172.21.15.181:0/3555252343 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67c1023d0 con 0x7fe67c06c2c0 2024-09-21T01:08:29.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe6737fe640 1 -- 172.21.15.181:0/3555252343 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe66c0108e0 con 0x7fe67c06c2c0 2024-09-21T01:08:29.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.095+0000 7fe6737fe640 1 -- 172.21.15.181:0/3555252343 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c026060 con 0x7fe67c06c2c0 2024-09-21T01:08:29.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.096+0000 7fe680fb2640 1 -- 172.21.15.181:0/3555252343 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c0052c0 con 0x7fe67c06c2c0 2024-09-21T01:08:29.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.098+0000 7fe6737fe640 1 -- 172.21.15.181:0/3555252343 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7fe66c010430 con 0x7fe67c06c2c0 2024-09-21T01:08:29.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.099+0000 7fe6737fe640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe6680b6590 0x7fe6680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:29.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.099+0000 7fe6737fe640 1 -- 172.21.15.181:0/3555252343 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7fe66c0e62f0 con 0x7fe67c06c2c0 2024-09-21T01:08:29.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.099+0000 7fe673fff640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe6680b6590 0x7fe6680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:29.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.099+0000 7fe673fff640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe6680b6590 0x7fe6680b8aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe664009fc0 tx=0x7fe664005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:29.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.102+0000 7fe6737fe640 1 -- 172.21.15.181:0/3555252343 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe66c0b20f0 con 0x7fe67c06c2c0 2024-09-21T01:08:29.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:08:29.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='osd.4 [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:29.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:28 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:29.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:29.312+0000 7fe680fb2640 1 -- 172.21.15.181:0/3555252343 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe65c000bf0 con 0x7fe6680b6590 2024-09-21T01:08:29.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='osd.4 [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:29.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:28 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:29.897 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4[44493]: 2024-09-21T01:08:29.585+0000 7fc6a4604640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T01:08:29.897 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4[44493]: 2024-09-21T01:08:29.591+0000 7fc69c3fa640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:08:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:29 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi157 2024-09-21T01:08:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:29 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi157 to 8544M 2024-09-21T01:08:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:29 smithi181 ceph-mon[34811]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:08:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:29 smithi181 ceph-mon[34811]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T01:08:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:29.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:29.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:29.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:29.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:29.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:29 smithi181 ceph-mon[34811]: from='osd.4 ' entity='osd.4' 2024-09-21T01:08:30.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi157 2024-09-21T01:08:30.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi157 to 8544M 2024-09-21T01:08:30.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-mon[34140]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:08:30.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-mon[34140]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T01:08:30.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:30.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:30.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:30.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:30.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:30.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:29 smithi157 ceph-mon[34140]: from='osd.4 ' entity='osd.4' 2024-09-21T01:08:30.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:29 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi157 2024-09-21T01:08:30.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:29 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi157 to 8544M 2024-09-21T01:08:30.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:29 smithi148 ceph-mon[31000]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:08:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:29 smithi148 ceph-mon[31000]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T01:08:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:30.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:29 smithi148 ceph-mon[31000]: from='osd.4 ' entity='osd.4' 2024-09-21T01:08:31.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:30 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:08:31.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:30 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:08:31.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:30 smithi181 ceph-mon[34811]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:31.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:30 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:31.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:30 smithi181 ceph-mon[34811]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:31.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:30 smithi181 ceph-mon[34811]: osd.4 [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] boot 2024-09-21T01:08:31.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:30 smithi181 ceph-mon[34811]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T01:08:31.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:30 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:31.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:30 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:08:31.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:30 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:08:31.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:30 smithi157 ceph-mon[34140]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:31.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:30 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:31.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:30 smithi157 ceph-mon[34140]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:31.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:30 smithi157 ceph-mon[34140]: osd.4 [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] boot 2024-09-21T01:08:31.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:30 smithi157 ceph-mon[34140]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T01:08:31.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:30 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:30 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:08:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:30 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:08:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:30 smithi148 ceph-mon[31000]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:30 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:30 smithi148 ceph-mon[31000]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:08:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:30 smithi148 ceph-mon[31000]: osd.4 [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] boot 2024-09-21T01:08:31.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:30 smithi148 ceph-mon[31000]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T01:08:31.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:30 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:08:32.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:32 smithi148 ceph-mon[31000]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T01:08:32.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:32 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/918542040' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d"} : dispatch 2024-09-21T01:08:32.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:32 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d"} : dispatch 2024-09-21T01:08:32.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:32 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d"}]': finished 2024-09-21T01:08:32.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:32 smithi148 ceph-mon[31000]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T01:08:32.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:32 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:32.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:32 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/609481683' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:32.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:32 smithi148 ceph-mon[31000]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:32.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:32 smithi181 ceph-mon[34811]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T01:08:32.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:32 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/918542040' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d"} : dispatch 2024-09-21T01:08:32.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:32 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d"} : dispatch 2024-09-21T01:08:32.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:32 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d"}]': finished 2024-09-21T01:08:32.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:32 smithi181 ceph-mon[34811]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T01:08:32.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:32 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:32.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:32 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/609481683' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:32.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:32 smithi181 ceph-mon[34811]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:32.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:32 smithi157 ceph-mon[34140]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T01:08:32.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:32 smithi157 ceph-mon[34140]: from='client.? 172.21.15.181:0/918542040' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d"} : dispatch 2024-09-21T01:08:32.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:32 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d"} : dispatch 2024-09-21T01:08:32.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:32 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d"}]': finished 2024-09-21T01:08:32.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:32 smithi157 ceph-mon[34140]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T01:08:32.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:32 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:32.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:32 smithi157 ceph-mon[34140]: from='client.? 172.21.15.181:0/609481683' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:32.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:32 smithi157 ceph-mon[34140]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:34.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:34 smithi148 ceph-mon[31000]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:34 smithi181 ceph-mon[34811]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:34.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:34 smithi157 ceph-mon[34140]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:36.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:36 smithi148 ceph-mon[31000]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:36.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:36 smithi181 ceph-mon[34811]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:36.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:36 smithi157 ceph-mon[34140]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:38.431 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:38 smithi181 ceph-mon[34811]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:38.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:38 smithi148 ceph-mon[31000]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:38.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:38 smithi157 ceph-mon[34140]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:40.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:40 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:08:40.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:40 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:40.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:40 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:08:40.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:40 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:40.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:40 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:08:40.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:40 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:41.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:41 smithi181 ceph-mon[34811]: Deploying daemon osd.5 on smithi181 2024-09-21T01:08:41.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:41 smithi181 ceph-mon[34811]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:41.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:41 smithi157 ceph-mon[34140]: Deploying daemon osd.5 on smithi181 2024-09-21T01:08:41.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:41 smithi157 ceph-mon[34140]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:41.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:41 smithi148 ceph-mon[31000]: Deploying daemon osd.5 on smithi181 2024-09-21T01:08:41.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:41 smithi148 ceph-mon[31000]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:42.577 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:42 smithi181 ceph-mon[34811]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:42.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:42 smithi148 ceph-mon[31000]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:42.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:42 smithi157 ceph-mon[34140]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:44.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:44 smithi148 ceph-mon[31000]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:44.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:44 smithi181 ceph-mon[34811]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:44.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:44 smithi157 ceph-mon[34140]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:46.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:46 smithi148 ceph-mon[31000]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:46.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:46 smithi181 ceph-mon[34811]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:46.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:46 smithi157 ceph-mon[34140]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:47.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:47.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:47.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:47.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:47.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:47.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:47.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:47.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:47.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:48.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:48 smithi148 ceph-mon[31000]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:48.629 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:48 smithi181 ceph-mon[34811]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:48.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:48 smithi157 ceph-mon[34140]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:50.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:50.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:50.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:50.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:50.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:50.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:50.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:50.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:50.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:50.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:50.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:50.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:50.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:50.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:50.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:50.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.481+0000 7fe6737fe640 1 -- 172.21.15.181:0/3555252343 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe65c000bf0 con 0x7fe6680b6590 2024-09-21T01:08:50.482 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 5 on host 'smithi181' 2024-09-21T01:08:50.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 -- 172.21.15.181:0/3555252343 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe6680b6590 msgr2=0x7fe6680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:50.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe6680b6590 0x7fe6680b8aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe664009fc0 tx=0x7fe664005f90 comp rx=0 tx=0).stop 2024-09-21T01:08:50.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 -- 172.21.15.181:0/3555252343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe67c06c2c0 msgr2=0x7fe67c199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:50.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe67c06c2c0 0x7fe67c199f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00e9f0 tx=0x7fe66c00eeb0 comp rx=0 tx=0).stop 2024-09-21T01:08:50.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 -- 172.21.15.181:0/3555252343 shutdown_connections 2024-09-21T01:08:50.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe6680b6590 0x7fe6680b8aa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:50.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1094a0 0x7fe67c19b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:50.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe67c106960 0x7fe67c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:50.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 --2- 172.21.15.181:0/3555252343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe67c06c2c0 0x7fe67c199f80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:50.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 -- 172.21.15.181:0/3555252343 >> 172.21.15.181:0/3555252343 conn(0x7fe67c0fdfa0 msgr2=0x7fe67c104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:50.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 -- 172.21.15.181:0/3555252343 shutdown_connections 2024-09-21T01:08:50.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:08:50.483+0000 7fe680fb2640 1 -- 172.21.15.181:0/3555252343 wait complete. 2024-09-21T01:08:51.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:50 smithi181 ceph-mon[34811]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:51.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:51.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:51.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:51.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:50 smithi148 ceph-mon[31000]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:51.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:51.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:51.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:51.130 DEBUG:teuthology.orchestra.run.smithi181:osd.5> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T01:08:51.132 INFO:tasks.cephadm:Deploying osd.6 on smithi148 with /dev/vg_nvme/lv_2... 2024-09-21T01:08:51.132 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T01:08:51.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:50 smithi157 ceph-mon[34140]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:51.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:51.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:51.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:51.392 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:08:52.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:52 smithi181 ceph-mon[34811]: from='osd.5 [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:08:52.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:52 smithi181 ceph-mon[34811]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:08:52.480 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:08:52 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:08:52.192+0000 7f83dc7e6640 -1 osd.5 0 log_to_monitors true 2024-09-21T01:08:52.556 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:52 smithi148 ceph-mon[31000]: from='osd.5 [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:08:52.556 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:52 smithi148 ceph-mon[31000]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:08:52.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:52 smithi157 ceph-mon[34140]: from='osd.5 [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:08:52.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:52 smithi157 ceph-mon[34140]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:08:53.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:53 smithi181 ceph-mon[34811]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:08:53.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:53 smithi181 ceph-mon[34811]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T01:08:53.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:53 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:53.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:53 smithi181 ceph-mon[34811]: from='osd.5 [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:08:53.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:53 smithi181 ceph-mon[34811]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:08:53.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:53 smithi181 ceph-mon[34811]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:53.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:53 smithi148 ceph-mon[31000]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:08:53.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:53 smithi148 ceph-mon[31000]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T01:08:53.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:53 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:53.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:53 smithi148 ceph-mon[31000]: from='osd.5 [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:08:53.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:53 smithi148 ceph-mon[31000]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:08:53.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:53 smithi148 ceph-mon[31000]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:53.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:53 smithi157 ceph-mon[34140]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:08:53.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:53 smithi157 ceph-mon[34140]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T01:08:53.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:53 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:53.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:53 smithi157 ceph-mon[34140]: from='osd.5 [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:08:53.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:53 smithi157 ceph-mon[34140]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:08:53.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:53 smithi157 ceph-mon[34140]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:53.900 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:08:53.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_2 2024-09-21T01:08:54.176 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:08:54.480 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:08:54.177+0000 7f83d8768640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T01:08:54.480 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:08:54.340+0000 7f83d055e640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:08:54.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:08:54.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T01:08:54.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:54.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:54.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:54.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:54.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:54.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:54.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:54 smithi181 ceph-mon[34811]: from='osd.5 ' entity='osd.5' 2024-09-21T01:08:54.521 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:08:54.521 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T01:08:54.521 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:54.521 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:54.521 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.522 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.522 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:54.522 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:54.522 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.522 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:54.522 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:54.522 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.522 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:54 smithi148 ceph-mon[31000]: from='osd.5 ' entity='osd.5' 2024-09-21T01:08:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.612+0000 7f9fecaa3640 1 -- 172.21.15.148:0/137165123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fe8101b00 msgr2=0x7f9fe8101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.612+0000 7f9fecaa3640 1 --2- 172.21.15.148:0/137165123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fe8101b00 0x7f9fe8101f10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009ca0 tx=0x7f9fe002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:08:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.612+0000 7f9fecaa3640 1 -- 172.21.15.148:0/137165123 shutdown_connections 2024-09-21T01:08:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.612+0000 7f9fecaa3640 1 --2- 172.21.15.148:0/137165123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe8109500 0x7f9fe810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.612+0000 7f9fecaa3640 1 --2- 172.21.15.148:0/137165123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe8106ba0 0x7f9fe8108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.612+0000 7f9fecaa3640 1 --2- 172.21.15.148:0/137165123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fe8101b00 0x7f9fe8101f10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.612+0000 7f9fecaa3640 1 -- 172.21.15.148:0/137165123 >> 172.21.15.148:0/137165123 conn(0x7f9fe80fd770 msgr2=0x7f9fe80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.612+0000 7f9fecaa3640 1 -- 172.21.15.148:0/137165123 shutdown_connections 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.612+0000 7f9fecaa3640 1 -- 172.21.15.148:0/137165123 wait complete. 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.613+0000 7f9fecaa3640 1 Processor -- start 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.613+0000 7f9fecaa3640 1 -- start start 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.613+0000 7f9fecaa3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe8101b00 0x7f9fe8199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.613+0000 7f9fecaa3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe8106ba0 0x7f9fe819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.613+0000 7f9fecaa3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fe8109500 0x7f9fe819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.613+0000 7f9fecaa3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe810f380 con 0x7f9fe8109500 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.613+0000 7f9fecaa3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe810f200 con 0x7f9fe8106ba0 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.613+0000 7f9fecaa3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe810f500 con 0x7f9fe8101b00 2024-09-21T01:08:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe6d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fe8109500 0x7f9fe819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:54.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe6d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fe8109500 0x7f9fe819b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35868/0 (socket says 172.21.15.148:35868) 2024-09-21T01:08:54.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe6d9d640 1 -- 172.21.15.148:0/251777769 learned_addr learned my addr 172.21.15.148:0/251777769 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:08:54.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe659c640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe8101b00 0x7f9fe8199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:54.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe5d9b640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe8106ba0 0x7f9fe819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:54.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe6d9d640 1 -- 172.21.15.148:0/251777769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe8101b00 msgr2=0x7f9fe8199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:54.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe6d9d640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe8101b00 0x7f9fe8199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:54.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe6d9d640 1 -- 172.21.15.148:0/251777769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe8106ba0 msgr2=0x7f9fe819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe6d9d640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe8106ba0 0x7f9fe819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe6d9d640 1 -- 172.21.15.148:0/251777769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe819b9d0 con 0x7f9fe8109500 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fe6d9d640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fe8109500 0x7f9fe819b1b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800d750 tx=0x7f9fd800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fdf7fe640 1 -- 172.21.15.148:0/251777769 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8017070 con 0x7f9fe8109500 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fecaa3640 1 -- 172.21.15.148:0/251777769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe819bcc0 con 0x7f9fe8109500 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fdf7fe640 1 -- 172.21.15.148:0/251777769 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fd80054d0 con 0x7f9fe8109500 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fecaa3640 1 -- 172.21.15.148:0/251777769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe81a23c0 con 0x7f9fe8109500 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.614+0000 7f9fdf7fe640 1 -- 172.21.15.148:0/251777769 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8004c60 con 0x7f9fe8109500 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.616+0000 7f9fecaa3640 1 -- 172.21.15.148:0/251777769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe80ff290 con 0x7f9fe8109500 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.617+0000 7f9fdf7fe640 1 -- 172.21.15.148:0/251777769 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f9fd8004e00 con 0x7f9fe8109500 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.618+0000 7f9fdf7fe640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fd40b6510 0x7f9fd40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.618+0000 7f9fe659c640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fd40b6510 0x7f9fd40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:54.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.618+0000 7f9fdf7fe640 1 -- 172.21.15.148:0/251777769 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4286+0+0 (secure 0 0 0) 0x7f9fd80e5c40 con 0x7f9fe8109500 2024-09-21T01:08:54.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.619+0000 7f9fe659c640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fd40b6510 0x7f9fd40b8a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00094e0 tx=0x7f9fe0004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:54.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.624+0000 7f9fdf7fe640 1 -- 172.21.15.148:0/251777769 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9fd80b1870 con 0x7f9fe8109500 2024-09-21T01:08:54.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:08:54.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T01:08:54.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:54.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:54.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:54.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:54.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:54.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:54.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:08:54.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:54 smithi157 ceph-mon[34140]: from='osd.5 ' entity='osd.5' 2024-09-21T01:08:54.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:08:54.812+0000 7f9fecaa3640 1 -- 172.21.15.148:0/251777769 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9fe8063800 con 0x7f9fd40b6510 2024-09-21T01:08:55.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:08:55.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:08:55.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi181 2024-09-21T01:08:55.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi181 to 8544M 2024-09-21T01:08:55.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T01:08:55.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:55.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:55.441 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:55.441 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:55.441 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:55.441 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:55.441 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:08:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:08:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi181 2024-09-21T01:08:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi181 to 8544M 2024-09-21T01:08:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T01:08:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:55.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:55.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:55.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:55.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:55.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:55.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:55.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:08:55.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:08:55.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi181 2024-09-21T01:08:55.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi181 to 8544M 2024-09-21T01:08:55.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T01:08:55.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:55.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:55.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:55.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:55.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:55.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:55.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:56.560 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:56 smithi148 ceph-mon[31000]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:56.561 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:56 smithi148 ceph-mon[31000]: osd.5 [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] boot 2024-09-21T01:08:56.561 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:56 smithi148 ceph-mon[31000]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T01:08:56.561 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:56 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:56.561 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:56 smithi148 ceph-mon[31000]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T01:08:56.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:56 smithi181 ceph-mon[34811]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:56.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:56 smithi181 ceph-mon[34811]: osd.5 [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] boot 2024-09-21T01:08:56.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:56 smithi181 ceph-mon[34811]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T01:08:56.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:56 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:56.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:56 smithi181 ceph-mon[34811]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T01:08:56.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:56 smithi157 ceph-mon[34140]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:56.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:56 smithi157 ceph-mon[34140]: osd.5 [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] boot 2024-09-21T01:08:56.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:56 smithi157 ceph-mon[34140]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T01:08:56.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:56 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:08:56.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:56 smithi157 ceph-mon[34140]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T01:08:57.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:57 smithi148 ceph-mon[31000]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:57.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:57 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/647238833' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f1846682-e854-4fd3-9b8e-6a390dcdf5b5"} : dispatch 2024-09-21T01:08:57.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:57 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/647238833' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1846682-e854-4fd3-9b8e-6a390dcdf5b5"}]': finished 2024-09-21T01:08:57.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:57 smithi148 ceph-mon[31000]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T01:08:57.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:08:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:57 smithi181 ceph-mon[34811]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:57 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/647238833' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f1846682-e854-4fd3-9b8e-6a390dcdf5b5"} : dispatch 2024-09-21T01:08:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:57 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/647238833' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1846682-e854-4fd3-9b8e-6a390dcdf5b5"}]': finished 2024-09-21T01:08:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:57 smithi181 ceph-mon[34811]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T01:08:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:57 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:08:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:57 smithi157 ceph-mon[34140]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:08:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:57 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/647238833' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f1846682-e854-4fd3-9b8e-6a390dcdf5b5"} : dispatch 2024-09-21T01:08:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:57 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/647238833' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1846682-e854-4fd3-9b8e-6a390dcdf5b5"}]': finished 2024-09-21T01:08:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:57 smithi157 ceph-mon[34140]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T01:08:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:57 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:08:58.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:58 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1563655582' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:58.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:08:58 smithi148 ceph-mon[31000]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:08:58.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:58 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1563655582' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:58.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:08:58 smithi181 ceph-mon[34811]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:08:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:58 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1563655582' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:08:58 smithi157 ceph-mon[34140]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:00.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:00 smithi148 ceph-mon[31000]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:00 smithi181 ceph-mon[34811]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:00.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:00 smithi157 ceph-mon[34140]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:02.500 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:02 smithi148 ceph-mon[31000]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T01:09:02.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:02 smithi181 ceph-mon[34811]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T01:09:02.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:02 smithi157 ceph-mon[34140]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T01:09:04.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:04 smithi148 ceph-mon[31000]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:09:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:04 smithi181 ceph-mon[34811]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:09:04.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:04 smithi157 ceph-mon[34140]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:09:06.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T01:09:06.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:06.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T01:09:06.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:06.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T01:09:06.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:07.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:06 smithi148 ceph-mon[31000]: Deploying daemon osd.6 on smithi148 2024-09-21T01:09:07.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:06 smithi148 ceph-mon[31000]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:09:07.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:06 smithi181 ceph-mon[34811]: Deploying daemon osd.6 on smithi148 2024-09-21T01:09:07.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:06 smithi181 ceph-mon[34811]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:09:07.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:06 smithi157 ceph-mon[34140]: Deploying daemon osd.6 on smithi148 2024-09-21T01:09:07.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:06 smithi157 ceph-mon[34140]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:09:08.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:08 smithi148 ceph-mon[31000]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T01:09:08.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:08 smithi181 ceph-mon[34811]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T01:09:08.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:08 smithi157 ceph-mon[34140]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T01:09:10.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:10 smithi148 ceph-mon[31000]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:09:10.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:10 smithi181 ceph-mon[34811]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:09:10.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:10 smithi157 ceph-mon[34140]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:09:12.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:12 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:12.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:12 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:12.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:12 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:12.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:12 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:12.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:12 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:12.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:12 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:12.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:12 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:12.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:12 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:12.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:12 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:13.468 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:13 smithi148 ceph-mon[31000]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:09:13.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:13 smithi181 ceph-mon[34811]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:09:13.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:13 smithi157 ceph-mon[34140]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:09:14.552 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:14 smithi148 ceph-mon[31000]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:14 smithi181 ceph-mon[34811]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:14.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:14 smithi157 ceph-mon[34140]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:15.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.845+0000 7f9fdf7fe640 1 -- 172.21.15.148:0/251777769 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9fe8063800 con 0x7f9fd40b6510 2024-09-21T01:09:15.846 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 6 on host 'smithi148' 2024-09-21T01:09:15.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 -- 172.21.15.148:0/251777769 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fd40b6510 msgr2=0x7f9fd40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:15.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fd40b6510 0x7f9fd40b8a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00094e0 tx=0x7f9fe0004a40 comp rx=0 tx=0).stop 2024-09-21T01:09:15.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 -- 172.21.15.148:0/251777769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fe8109500 msgr2=0x7f9fe819b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:15.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fe8109500 0x7f9fe819b1b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800d750 tx=0x7f9fd800dc10 comp rx=0 tx=0).stop 2024-09-21T01:09:15.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 -- 172.21.15.148:0/251777769 shutdown_connections 2024-09-21T01:09:15.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fd40b6510 0x7f9fd40b8a20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:15.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fe8109500 0x7f9fe819b1b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:15.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fe8106ba0 0x7f9fe819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:15.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 --2- 172.21.15.148:0/251777769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe8101b00 0x7f9fe8199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:15.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 -- 172.21.15.148:0/251777769 >> 172.21.15.148:0/251777769 conn(0x7f9fe80fd770 msgr2=0x7f9fe8107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:09:15.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.847+0000 7f9fecaa3640 1 -- 172.21.15.148:0/251777769 shutdown_connections 2024-09-21T01:09:15.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:09:15.848+0000 7f9fecaa3640 1 -- 172.21.15.148:0/251777769 wait complete. 2024-09-21T01:09:16.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:16.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:16.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:16.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:16.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:16.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:16.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:16.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:16.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:16.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:16.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:16.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:16.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:16.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:16.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:16.542 DEBUG:teuthology.orchestra.run.smithi148:osd.6> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T01:09:16.544 INFO:tasks.cephadm:Deploying osd.7 on smithi157 with /dev/vg_nvme/lv_2... 2024-09-21T01:09:16.544 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T01:09:16.800 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:09:17.080 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:16 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:17.080 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:16 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:17.080 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:16 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:17.080 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:16 smithi148 ceph-mon[31000]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:17.138 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:16 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:17.138 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:16 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:17.139 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:16 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:17.139 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:16 smithi157 ceph-mon[34140]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:17.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:16 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:17.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:16 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:17.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:16 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:17.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:16 smithi181 ceph-mon[34811]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:18.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:18 smithi157 ceph-mon[34140]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:18.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:18 smithi148 ceph-mon[31000]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:18.613 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:09:18 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:09:18.404+0000 7f339cb22640 -1 osd.6 0 log_to_monitors true 2024-09-21T01:09:18.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:18 smithi181 ceph-mon[34811]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:19.278 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:09:19.304 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi157:vg_nvme/lv_2 2024-09-21T01:09:19.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:19 smithi157 ceph-mon[34140]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T01:09:19.559 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:09:19.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:19 smithi148 ceph-mon[31000]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T01:09:19.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:19 smithi181 ceph-mon[34811]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T01:09:20.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.041+0000 7f328bcd1640 1 -- 172.21.15.157:0/3448038808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284106ba0 msgr2=0x7f3284108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:20.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.041+0000 7f328bcd1640 1 --2- 172.21.15.157:0/3448038808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284106ba0 0x7f3284108fc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3278009900 tx=0x7f327802a410 comp rx=0 tx=0).stop 2024-09-21T01:09:20.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.041+0000 7f328bcd1640 1 -- 172.21.15.157:0/3448038808 shutdown_connections 2024-09-21T01:09:20.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.041+0000 7f328bcd1640 1 --2- 172.21.15.157:0/3448038808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3284109500 0x7f328410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:20.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.041+0000 7f328bcd1640 1 --2- 172.21.15.157:0/3448038808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284106ba0 0x7f3284108fc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:20.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.041+0000 7f328bcd1640 1 --2- 172.21.15.157:0/3448038808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3284101b00 0x7f3284101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:20.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.041+0000 7f328bcd1640 1 -- 172.21.15.157:0/3448038808 >> 172.21.15.157:0/3448038808 conn(0x7f32840fd770 msgr2=0x7f32840ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:09:20.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.041+0000 7f328bcd1640 1 -- 172.21.15.157:0/3448038808 shutdown_connections 2024-09-21T01:09:20.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.041+0000 7f328bcd1640 1 -- 172.21.15.157:0/3448038808 wait complete. 2024-09-21T01:09:20.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328bcd1640 1 Processor -- start 2024-09-21T01:09:20.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328bcd1640 1 -- start start 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328bcd1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3284101b00 0x7f3284199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328bcd1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3284106ba0 0x7f328419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328bcd1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284109500 0x7f328419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328bcd1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f328410f370 con 0x7f3284106ba0 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328bcd1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f328410f1f0 con 0x7f3284109500 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328bcd1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f328410f4f0 con 0x7f3284101b00 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328a26e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284109500 0x7f328419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328a26e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284109500 0x7f328419b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:35842/0 (socket says 172.21.15.157:35842) 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328a26e640 1 -- 172.21.15.157:0/2417504982 learned_addr learned my addr 172.21.15.157:0/2417504982 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f3289a6d640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3284101b00 0x7f3284199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.042+0000 7f328926c640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3284106ba0 0x7f328419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f328a26e640 1 -- 172.21.15.157:0/2417504982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3284101b00 msgr2=0x7f3284199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:20.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f328a26e640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3284101b00 0x7f3284199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:20.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f328a26e640 1 -- 172.21.15.157:0/2417504982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3284106ba0 msgr2=0x7f328419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:20.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f328a26e640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3284106ba0 0x7f328419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:20.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f328a26e640 1 -- 172.21.15.157:0/2417504982 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328419b9c0 con 0x7f3284109500 2024-09-21T01:09:20.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f328a26e640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284109500 0x7f328419b1a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f327400eaa0 tx=0x7f327400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:09:20.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f3282ffd640 1 -- 172.21.15.157:0/2417504982 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327400cdb0 con 0x7f3284109500 2024-09-21T01:09:20.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f328bcd1640 1 -- 172.21.15.157:0/2417504982 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328419bcb0 con 0x7f3284109500 2024-09-21T01:09:20.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f3282ffd640 1 -- 172.21.15.157:0/2417504982 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3274005020 con 0x7f3284109500 2024-09-21T01:09:20.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f328bcd1640 1 -- 172.21.15.157:0/2417504982 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32841a23b0 con 0x7f3284109500 2024-09-21T01:09:20.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.043+0000 7f3282ffd640 1 -- 172.21.15.157:0/2417504982 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32740116d0 con 0x7f3284109500 2024-09-21T01:09:20.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.044+0000 7f328bcd1640 1 -- 172.21.15.157:0/2417504982 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32840ff290 con 0x7f3284109500 2024-09-21T01:09:20.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.047+0000 7f3282ffd640 1 -- 172.21.15.157:0/2417504982 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f32740054a0 con 0x7f3284109500 2024-09-21T01:09:20.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.047+0000 7f3282ffd640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f326c0b6590 0x7f326c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:20.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.048+0000 7f3282ffd640 1 -- 172.21.15.157:0/2417504982 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4669+0+0 (secure 0 0 0) 0x7f32740e69c0 con 0x7f3284109500 2024-09-21T01:09:20.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.048+0000 7f3289a6d640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f326c0b6590 0x7f326c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:20.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.048+0000 7f3289a6d640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f326c0b6590 0x7f326c0b8aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f327c00bbe0 tx=0x7f327c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:09:20.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.051+0000 7f3282ffd640 1 -- 172.21.15.157:0/2417504982 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3274016030 con 0x7f3284109500 2024-09-21T01:09:20.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:20.241+0000 7f328bcd1640 1 -- 172.21.15.157:0/2417504982 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3284063800 con 0x7f326c0b6590 2024-09-21T01:09:20.586 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T01:09:20.586 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T01:09:20.586 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:09:20.586 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:20.586 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi148 2024-09-21T01:09:20.586 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.586 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.586 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:20 smithi157 ceph-mon[34140]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T01:09:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T01:09:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:09:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi148 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:20.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:20.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:20 smithi148 ceph-mon[31000]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T01:09:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T01:09:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi148 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:20.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:20.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:20.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:20.732 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:20 smithi181 ceph-mon[34811]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:21.601 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:21 smithi157 ceph-mon[34140]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:09:21.601 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:21 smithi157 ceph-mon[34140]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T01:09:21.601 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:21 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:21.601 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:21 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:21.601 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:21 smithi157 ceph-mon[34140]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' 2024-09-21T01:09:21.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:21 smithi148 ceph-mon[31000]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:09:21.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:21 smithi148 ceph-mon[31000]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T01:09:21.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:21 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:21.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:21 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:21.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:21 smithi148 ceph-mon[31000]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' 2024-09-21T01:09:21.614 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:09:21 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:09:21.260+0000 7f3398aa4640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T01:09:21.614 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:09:21 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:09:21.293+0000 7f339089a640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:09:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:21 smithi181 ceph-mon[34811]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:09:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:21 smithi181 ceph-mon[34811]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T01:09:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:21 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:21 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:21 smithi181 ceph-mon[34811]: from='osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486]' entity='osd.6' 2024-09-21T01:09:22.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:22 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:09:22.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:22 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:09:22.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:22.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:22 smithi148 ceph-mon[31000]: osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] boot 2024-09-21T01:09:22.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:22 smithi148 ceph-mon[31000]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T01:09:22.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:22.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:22 smithi148 ceph-mon[31000]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:22 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:09:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:22 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:09:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:22 smithi181 ceph-mon[34811]: osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] boot 2024-09-21T01:09:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:22 smithi181 ceph-mon[34811]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T01:09:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:22 smithi181 ceph-mon[34811]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:22.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:22 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:09:22.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:22 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:09:22.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:22 smithi157 ceph-mon[34140]: osd.6 [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] boot 2024-09-21T01:09:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:22 smithi157 ceph-mon[34140]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T01:09:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:09:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:22 smithi157 ceph-mon[34140]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:09:23.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:23 smithi157 ceph-mon[34140]: from='client.? 172.21.15.157:0/3233897557' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b053ed6-f9b4-4f89-ade9-4288c71f105f"} : dispatch 2024-09-21T01:09:23.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:23 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b053ed6-f9b4-4f89-ade9-4288c71f105f"} : dispatch 2024-09-21T01:09:23.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:23 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b053ed6-f9b4-4f89-ade9-4288c71f105f"}]': finished 2024-09-21T01:09:23.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:23 smithi157 ceph-mon[34140]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T01:09:23.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:23 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:23.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:23 smithi157 ceph-mon[34140]: from='client.? 172.21.15.157:0/1647883458' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:23 smithi148 ceph-mon[31000]: from='client.? 172.21.15.157:0/3233897557' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b053ed6-f9b4-4f89-ade9-4288c71f105f"} : dispatch 2024-09-21T01:09:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:23 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b053ed6-f9b4-4f89-ade9-4288c71f105f"} : dispatch 2024-09-21T01:09:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:23 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b053ed6-f9b4-4f89-ade9-4288c71f105f"}]': finished 2024-09-21T01:09:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:23 smithi148 ceph-mon[31000]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T01:09:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:23 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:23.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:23 smithi148 ceph-mon[31000]: from='client.? 172.21.15.157:0/1647883458' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:23 smithi181 ceph-mon[34811]: from='client.? 172.21.15.157:0/3233897557' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b053ed6-f9b4-4f89-ade9-4288c71f105f"} : dispatch 2024-09-21T01:09:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:23 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b053ed6-f9b4-4f89-ade9-4288c71f105f"} : dispatch 2024-09-21T01:09:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:23 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b053ed6-f9b4-4f89-ade9-4288c71f105f"}]': finished 2024-09-21T01:09:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:23 smithi181 ceph-mon[34811]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T01:09:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:23 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:23 smithi181 ceph-mon[34811]: from='client.? 172.21.15.157:0/1647883458' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:24.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:24 smithi181 ceph-mon[34811]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:24.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:24 smithi157 ceph-mon[34140]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:24.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:24 smithi148 ceph-mon[31000]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:26.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:26 smithi148 ceph-mon[31000]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:26.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:26 smithi181 ceph-mon[34811]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:26.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:26 smithi157 ceph-mon[34140]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:28.410 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:28 smithi157 ceph-mon[34140]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:28.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:28 smithi148 ceph-mon[31000]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:28.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:28 smithi181 ceph-mon[34811]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:30.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:30 smithi157 ceph-mon[34140]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:30.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:30 smithi148 ceph-mon[31000]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:30.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:30 smithi181 ceph-mon[34811]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:31.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:31 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T01:09:31.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:31 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:31.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:31 smithi157 ceph-mon[34140]: Deploying daemon osd.7 on smithi157 2024-09-21T01:09:31.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:31 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T01:09:31.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:31 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:31.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:31 smithi148 ceph-mon[31000]: Deploying daemon osd.7 on smithi157 2024-09-21T01:09:31.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:31 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T01:09:31.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:31 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:31.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:31 smithi181 ceph-mon[34811]: Deploying daemon osd.7 on smithi157 2024-09-21T01:09:32.484 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:32 smithi157 ceph-mon[34140]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:32.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:32 smithi148 ceph-mon[31000]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:32.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:32 smithi181 ceph-mon[34811]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:34.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:34 smithi148 ceph-mon[31000]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:34 smithi181 ceph-mon[34811]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:34.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:34 smithi157 ceph-mon[34140]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:36.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:36 smithi157 ceph-mon[34140]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:36.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:36 smithi148 ceph-mon[31000]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:36.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:36 smithi181 ceph-mon[34811]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:37.458 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:37 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:37.458 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:37 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:37.458 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:37 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:37.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:37 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:37.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:37 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:37.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:37 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:37 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:37 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:37 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:38.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:38 smithi148 ceph-mon[31000]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:38.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:38 smithi181 ceph-mon[34811]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:38.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:38 smithi157 ceph-mon[34140]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:40.348 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:40 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:40.348 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:40 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:40.348 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:40 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:40.348 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:40 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:40.348 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:40 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:40.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.389+0000 7f3282ffd640 1 -- 172.21.15.157:0/2417504982 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3284063800 con 0x7f326c0b6590 2024-09-21T01:09:40.391 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 7 on host 'smithi157' 2024-09-21T01:09:40.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 -- 172.21.15.157:0/2417504982 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f326c0b6590 msgr2=0x7f326c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:40.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f326c0b6590 0x7f326c0b8aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f327c00bbe0 tx=0x7f327c00b390 comp rx=0 tx=0).stop 2024-09-21T01:09:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 -- 172.21.15.157:0/2417504982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284109500 msgr2=0x7f328419b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284109500 0x7f328419b1a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f327400eaa0 tx=0x7f327400ef60 comp rx=0 tx=0).stop 2024-09-21T01:09:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 -- 172.21.15.157:0/2417504982 shutdown_connections 2024-09-21T01:09:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f326c0b6590 0x7f326c0b8aa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3284106ba0 0x7f328419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284109500 0x7f328419b1a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 --2- 172.21.15.157:0/2417504982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3284101b00 0x7f3284199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 -- 172.21.15.157:0/2417504982 >> 172.21.15.157:0/2417504982 conn(0x7f32840fd770 msgr2=0x7f3284107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:09:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 -- 172.21.15.157:0/2417504982 shutdown_connections 2024-09-21T01:09:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:09:40.391+0000 7f328bcd1640 1 -- 172.21.15.157:0/2417504982 wait complete. 2024-09-21T01:09:40.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:40 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:40.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:40 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:40.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:40 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:40.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:40 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:40.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:40 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:40.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:40 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:40.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:40 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:40.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:40 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:40.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:40 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:40.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:40 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:41.028 DEBUG:teuthology.orchestra.run.smithi157:osd.7> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T01:09:41.030 INFO:tasks.cephadm:Deploying osd.8 on smithi181 with /dev/vg_nvme/lv_2... 2024-09-21T01:09:41.031 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T01:09:41.287 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:09:41.407 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:41 smithi181 ceph-mon[34811]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:41.407 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:41.407 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:41.407 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:41.529 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:41 smithi157 ceph-mon[34140]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:41.529 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:41.529 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:41.529 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:41.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:41 smithi148 ceph-mon[31000]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:41.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:41.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:41.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:42.372 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:42 smithi157 ceph-mon[34140]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:42.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:42 smithi148 ceph-mon[31000]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:42.669 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:42 smithi181 ceph-mon[34811]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:43.339 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:09:43 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:09:43.077+0000 7f06b2062640 -1 osd.7 0 log_to_monitors true 2024-09-21T01:09:43.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:43 smithi148 ceph-mon[31000]: from='osd.7 [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:09:43.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:43 smithi148 ceph-mon[31000]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:09:43.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:43 smithi181 ceph-mon[34811]: from='osd.7 [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:09:43.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:43 smithi181 ceph-mon[34811]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:09:43.721 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:43 smithi157 ceph-mon[34140]: from='osd.7 [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:09:43.721 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:43 smithi157 ceph-mon[34140]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:09:43.842 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:09:43.869 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_2 2024-09-21T01:09:44.117 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:09:44.518 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='osd.7 [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi157 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi157 to 5696M 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:44.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:44 smithi181 ceph-mon[34811]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:44.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 -- 172.21.15.181:0/1100759959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd164105180 msgr2=0x7fd16410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 --2- 172.21.15.181:0/1100759959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd164105180 0x7fd16410bb20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009ca0 tx=0x7fd15c02a950 comp rx=0 tx=0).stop 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 -- 172.21.15.181:0/1100759959 shutdown_connections 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 --2- 172.21.15.181:0/1100759959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd164105180 0x7fd16410bb20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 --2- 172.21.15.181:0/1100759959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1641047e0 0x7fd164104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 --2- 172.21.15.181:0/1100759959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd164103750 0x7fd164103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 -- 172.21.15.181:0/1100759959 >> 172.21.15.181:0/1100759959 conn(0x7fd1640ff0c0 msgr2=0x7fd164101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 -- 172.21.15.181:0/1100759959 shutdown_connections 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 -- 172.21.15.181:0/1100759959 wait complete. 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 Processor -- start 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.611+0000 7fd16c0f8640 1 -- start start 2024-09-21T01:09:44.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd16c0f8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164103750 0x7fd164199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd16c0f8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1641047e0 0x7fd16419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd16c0f8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd164105180 0x7fd16419b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd16c0f8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd16410f3a0 con 0x7fd164105180 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd16c0f8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd16410f220 con 0x7fd164103750 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd16c0f8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd16410f520 con 0x7fd1641047e0 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd169693640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1641047e0 0x7fd16419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd169693640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1641047e0 0x7fd16419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:44814/0 (socket says 172.21.15.181:44814) 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd169693640 1 -- 172.21.15.181:0/2325059684 learned_addr learned my addr 172.21.15.181:0/2325059684 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd169e94640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164103750 0x7fd164199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd169693640 1 -- 172.21.15.181:0/2325059684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164103750 msgr2=0x7fd164199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd169693640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164103750 0x7fd164199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd16a695640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd164105180 0x7fd16419b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:44.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd169693640 1 -- 172.21.15.181:0/2325059684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd164105180 msgr2=0x7fd16419b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:44.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd169693640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd164105180 0x7fd16419b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:44.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd169693640 1 -- 172.21.15.181:0/2325059684 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16419b970 con 0x7fd1641047e0 2024-09-21T01:09:44.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd169693640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1641047e0 0x7fd16419a5b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd15400e9f0 tx=0x7fd15400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:09:44.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.612+0000 7fd15affd640 1 -- 172.21.15.181:0/2325059684 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15400cd80 con 0x7fd1641047e0 2024-09-21T01:09:44.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.613+0000 7fd15affd640 1 -- 172.21.15.181:0/2325059684 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1540054d0 con 0x7fd1641047e0 2024-09-21T01:09:44.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.613+0000 7fd16c0f8640 1 -- 172.21.15.181:0/2325059684 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16419bc60 con 0x7fd1641047e0 2024-09-21T01:09:44.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.613+0000 7fd15affd640 1 -- 172.21.15.181:0/2325059684 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154010690 con 0x7fd1641047e0 2024-09-21T01:09:44.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.613+0000 7fd16c0f8640 1 -- 172.21.15.181:0/2325059684 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1641a2360 con 0x7fd1641047e0 2024-09-21T01:09:44.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T01:09:44.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='osd.7 [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:09:44.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T01:09:44.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:44.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:09:44.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi157 2024-09-21T01:09:44.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.617 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:44.618 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:44.618 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:44.618 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi157 to 5696M 2024-09-21T01:09:44.618 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.618 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:44.618 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:44.618 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.618 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:44 smithi148 ceph-mon[31000]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:44.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.614+0000 7fd16c0f8640 1 -- 172.21.15.181:0/2325059684 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16410a910 con 0x7fd1641047e0 2024-09-21T01:09:44.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.615+0000 7fd15affd640 1 -- 172.21.15.181:0/2325059684 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7fd154004e30 con 0x7fd1641047e0 2024-09-21T01:09:44.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.616+0000 7fd15affd640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd1500b6510 0x7fd1500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:44.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.616+0000 7fd15affd640 1 -- 172.21.15.181:0/2325059684 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7fd1540e6d20 con 0x7fd1641047e0 2024-09-21T01:09:44.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.616+0000 7fd169e94640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd1500b6510 0x7fd1500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:44.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.617+0000 7fd169e94640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd1500b6510 0x7fd1500b8a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd160009bd0 tx=0x7fd160005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:09:44.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.619+0000 7fd15affd640 1 -- 172.21.15.181:0/2325059684 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd154056710 con 0x7fd1641047e0 2024-09-21T01:09:44.740 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:09:44.357+0000 7f06adfe4640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T01:09:44.740 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:09:44.372+0000 7f06a9de2640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:09:44.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T01:09:44.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='osd.7 [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:09:44.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T01:09:44.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:44.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:09:44.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi157 2024-09-21T01:09:44.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:44.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:44.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:44.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi157 to 5696M 2024-09-21T01:09:44.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:44.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:44.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:09:44.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:44 smithi157 ceph-mon[34140]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:09:44.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:09:44.810+0000 7fd16c0f8640 1 -- 172.21.15.181:0/2325059684 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd164063800 con 0x7fd1500b6510 2024-09-21T01:09:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:09:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T01:09:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:45.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: osd.7 [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] boot 2024-09-21T01:09:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T01:09:45.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:45.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:09:45.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T01:09:45.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:45.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: osd.7 [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] boot 2024-09-21T01:09:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T01:09:45.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:45.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:09:45.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T01:09:45.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:45.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:45.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:45.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:45.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:45.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:45.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: osd.7 [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] boot 2024-09-21T01:09:45.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T01:09:45.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:09:46.410 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:46 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:09:46.410 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:46 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:09:46.410 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:46 smithi181 ceph-mon[34811]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T01:09:46.410 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:46 smithi181 ceph-mon[34811]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:09:46.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:46 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:09:46.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:46 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:09:46.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:46 smithi148 ceph-mon[31000]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T01:09:46.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:46 smithi148 ceph-mon[31000]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:09:46.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:46 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:09:46.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:46 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:09:46.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:46 smithi157 ceph-mon[34140]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T01:09:46.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:46 smithi157 ceph-mon[34140]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:09:47.720 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:47 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/1122600052' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "98ad5627-aac2-47e2-a3c0-e09529875c0f"} : dispatch 2024-09-21T01:09:47.720 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:47 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "98ad5627-aac2-47e2-a3c0-e09529875c0f"} : dispatch 2024-09-21T01:09:47.720 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:47 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98ad5627-aac2-47e2-a3c0-e09529875c0f"}]': finished 2024-09-21T01:09:47.720 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:47 smithi181 ceph-mon[34811]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T01:09:47.721 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:09:47.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:47 smithi157 ceph-mon[34140]: from='client.? 172.21.15.181:0/1122600052' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "98ad5627-aac2-47e2-a3c0-e09529875c0f"} : dispatch 2024-09-21T01:09:47.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:47 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "98ad5627-aac2-47e2-a3c0-e09529875c0f"} : dispatch 2024-09-21T01:09:47.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:47 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98ad5627-aac2-47e2-a3c0-e09529875c0f"}]': finished 2024-09-21T01:09:47.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:47 smithi157 ceph-mon[34140]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T01:09:47.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:09:47.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:47 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/1122600052' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "98ad5627-aac2-47e2-a3c0-e09529875c0f"} : dispatch 2024-09-21T01:09:47.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:47 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "98ad5627-aac2-47e2-a3c0-e09529875c0f"} : dispatch 2024-09-21T01:09:47.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:47 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98ad5627-aac2-47e2-a3c0-e09529875c0f"}]': finished 2024-09-21T01:09:47.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:47 smithi148 ceph-mon[31000]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T01:09:47.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:09:48.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:48 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/3689673701' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:48.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:48 smithi181 ceph-mon[34811]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T01:09:48.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:48 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:09:48.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:48 smithi181 ceph-mon[34811]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:09:48.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:48 smithi157 ceph-mon[34140]: from='client.? 172.21.15.181:0/3689673701' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:48.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:48 smithi157 ceph-mon[34140]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T01:09:48.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:48 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:09:48.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:48 smithi157 ceph-mon[34140]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:09:48.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:48 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/3689673701' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:48.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:48 smithi148 ceph-mon[31000]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T01:09:48.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:48 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:09:48.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:48 smithi148 ceph-mon[31000]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:09:50.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:50 smithi148 ceph-mon[31000]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:09:50.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:50 smithi181 ceph-mon[34811]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:09:50.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:50 smithi157 ceph-mon[34140]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:09:52.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:52 smithi148 ceph-mon[31000]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-21T01:09:52.640 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:52 smithi181 ceph-mon[34811]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-21T01:09:52.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:52 smithi157 ceph-mon[34140]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-21T01:09:54.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:54 smithi181 ceph-mon[34811]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:09:54.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:54 smithi148 ceph-mon[31000]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:09:54.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:54 smithi157 ceph-mon[34140]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:09:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T01:09:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:55.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T01:09:55.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:55.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T01:09:55.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:56.758 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:56 smithi181 ceph-mon[34811]: Deploying daemon osd.8 on smithi181 2024-09-21T01:09:56.759 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:56 smithi181 ceph-mon[34811]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T01:09:56.764 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:56 smithi148 ceph-mon[31000]: Deploying daemon osd.8 on smithi181 2024-09-21T01:09:56.764 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:56 smithi148 ceph-mon[31000]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T01:09:56.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:56 smithi157 ceph-mon[34140]: Deploying daemon osd.8 on smithi181 2024-09-21T01:09:56.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:56 smithi157 ceph-mon[34140]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T01:09:58.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:09:58 smithi148 ceph-mon[31000]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:09:58.625 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:09:58 smithi181 ceph-mon[34811]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:09:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:09:58 smithi157 ceph-mon[34140]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:10:00.128 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:00 smithi181 ceph-mon[34811]: overall HEALTH_OK 2024-09-21T01:10:00.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:00 smithi148 ceph-mon[31000]: overall HEALTH_OK 2024-09-21T01:10:00.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:00 smithi157 ceph-mon[34140]: overall HEALTH_OK 2024-09-21T01:10:01.181 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:01 smithi181 ceph-mon[34811]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:01.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:01 smithi148 ceph-mon[31000]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:01.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:01 smithi157 ceph-mon[34140]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:02.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:02.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:02.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:02.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:02.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:02.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:02.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:02.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:02.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:03.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:03 smithi148 ceph-mon[31000]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:03.421 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:03 smithi181 ceph-mon[34811]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:03.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:03 smithi157 ceph-mon[34140]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:05.111 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:05.111 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:05.111 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:05.111 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:05.111 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:05.111 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:05 smithi181 ceph-mon[34811]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:10:05.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.154+0000 7fd15affd640 1 -- 172.21.15.181:0/2325059684 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd164063800 con 0x7fd1500b6510 2024-09-21T01:10:05.155 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 8 on host 'smithi181' 2024-09-21T01:10:05.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.156+0000 7fd16c0f8640 1 -- 172.21.15.181:0/2325059684 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd1500b6510 msgr2=0x7fd1500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:05.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.156+0000 7fd16c0f8640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd1500b6510 0x7fd1500b8a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd160009bd0 tx=0x7fd160005f90 comp rx=0 tx=0).stop 2024-09-21T01:10:05.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.156+0000 7fd16c0f8640 1 -- 172.21.15.181:0/2325059684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1641047e0 msgr2=0x7fd16419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:05.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.156+0000 7fd16c0f8640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1641047e0 0x7fd16419a5b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd15400e9f0 tx=0x7fd15400edf0 comp rx=0 tx=0).stop 2024-09-21T01:10:05.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.157+0000 7fd16c0f8640 1 -- 172.21.15.181:0/2325059684 shutdown_connections 2024-09-21T01:10:05.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.157+0000 7fd16c0f8640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd1500b6510 0x7fd1500b8a20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:05.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.157+0000 7fd16c0f8640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd164105180 0x7fd16419b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:05.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.157+0000 7fd16c0f8640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1641047e0 0x7fd16419a5b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:05.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.157+0000 7fd16c0f8640 1 --2- 172.21.15.181:0/2325059684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd164103750 0x7fd164199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:05.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.157+0000 7fd16c0f8640 1 -- 172.21.15.181:0/2325059684 >> 172.21.15.181:0/2325059684 conn(0x7fd1640ff0c0 msgr2=0x7fd164107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:10:05.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.157+0000 7fd16c0f8640 1 -- 172.21.15.181:0/2325059684 shutdown_connections 2024-09-21T01:10:05.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:05.157+0000 7fd16c0f8640 1 -- 172.21.15.181:0/2325059684 wait complete. 2024-09-21T01:10:05.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:05.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:05.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:05.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:05.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:05.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:05 smithi148 ceph-mon[31000]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:10:05.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:05.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:05.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:05.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:05.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:05.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:05 smithi157 ceph-mon[34140]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:10:05.791 DEBUG:teuthology.orchestra.run.smithi181:osd.8> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T01:10:05.794 INFO:tasks.cephadm:Deploying osd.9 on smithi148 with /dev/vg_nvme/lv_1... 2024-09-21T01:10:05.794 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T01:10:06.055 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:10:06.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:06.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:06.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:06 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:06.351 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:06.351 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:06.351 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:06 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:06.392 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:06.392 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:06.392 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:06 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:06.980 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:10:06 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:10:06.913+0000 7fe9527ef640 -1 osd.8 0 log_to_monitors true 2024-09-21T01:10:07.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:07 smithi181 ceph-mon[34811]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:10:07.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:07 smithi181 ceph-mon[34811]: from='osd.8 [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:10:07.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:07 smithi181 ceph-mon[34811]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:10:07.282 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:07 smithi148 ceph-mon[31000]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:10:07.282 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:07 smithi148 ceph-mon[31000]: from='osd.8 [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:10:07.282 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:07 smithi148 ceph-mon[31000]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:10:07.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:07 smithi157 ceph-mon[34140]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:10:07.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:07 smithi157 ceph-mon[34140]: from='osd.8 [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:10:07.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:07 smithi157 ceph-mon[34140]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:10:08.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:08 smithi148 ceph-mon[31000]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T01:10:08.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:08 smithi148 ceph-mon[31000]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T01:10:08.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:08 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:08.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:08 smithi148 ceph-mon[31000]: from='osd.8 [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:10:08.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:08 smithi148 ceph-mon[31000]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:10:08.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:08 smithi181 ceph-mon[34811]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T01:10:08.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:08 smithi181 ceph-mon[34811]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T01:10:08.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:08 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:08.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:08 smithi181 ceph-mon[34811]: from='osd.8 [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:10:08.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:08 smithi181 ceph-mon[34811]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:10:08.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:08 smithi157 ceph-mon[34140]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T01:10:08.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:08 smithi157 ceph-mon[34140]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T01:10:08.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:08 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:08.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:08 smithi157 ceph-mon[34140]: from='osd.8 [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:10:08.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:08 smithi157 ceph-mon[34140]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:10:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:10:08.559 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_1 2024-09-21T01:10:08.818 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:10:09.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:10:09.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T01:10:09.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:09.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:09.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:10:09.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:09.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:09.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:09.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:09.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:09.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:09 smithi148 ceph-mon[31000]: from='osd.8 ' entity='osd.8' 2024-09-21T01:10:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.285+0000 7fb48ab4c640 1 -- 172.21.15.148:0/3579104053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb484102c90 msgr2=0x7fb484105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.285+0000 7fb48ab4c640 1 --2- 172.21.15.148:0/3579104053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb484102c90 0x7fb484105110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb478009900 tx=0x7fb47802a410 comp rx=0 tx=0).stop 2024-09-21T01:10:09.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.285+0000 7fb48ab4c640 1 -- 172.21.15.148:0/3579104053 shutdown_connections 2024-09-21T01:10:09.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.285+0000 7fb48ab4c640 1 --2- 172.21.15.148:0/3579104053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb484108370 0x7fb48410a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:09.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.285+0000 7fb48ab4c640 1 --2- 172.21.15.148:0/3579104053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb484105750 0x7fb484107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:09.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.285+0000 7fb48ab4c640 1 --2- 172.21.15.148:0/3579104053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb484102c90 0x7fb484105110 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:09.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.285+0000 7fb48ab4c640 1 -- 172.21.15.148:0/3579104053 >> 172.21.15.148:0/3579104053 conn(0x7fb4840fd770 msgr2=0x7fb4840ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:10:09.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.285+0000 7fb48ab4c640 1 -- 172.21.15.148:0/3579104053 shutdown_connections 2024-09-21T01:10:09.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.285+0000 7fb48ab4c640 1 -- 172.21.15.148:0/3579104053 wait complete. 2024-09-21T01:10:09.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.286+0000 7fb48ab4c640 1 Processor -- start 2024-09-21T01:10:09.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.286+0000 7fb48ab4c640 1 -- start start 2024-09-21T01:10:09.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.286+0000 7fb48ab4c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb484102c90 0x7fb484102250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:09.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.286+0000 7fb48ab4c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb484105750 0x7fb48419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:09.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.286+0000 7fb48ab4c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb484108370 0x7fb4841a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:09.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.286+0000 7fb48ab4c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb48410e270 con 0x7fb484102c90 2024-09-21T01:10:09.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.286+0000 7fb48ab4c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb48410e0f0 con 0x7fb484105750 2024-09-21T01:10:09.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.286+0000 7fb48ab4c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb48410e3f0 con 0x7fb484108370 2024-09-21T01:10:09.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.286+0000 7fb4888e8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb484102c90 0x7fb484102250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb4888e8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb484102c90 0x7fb484102250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51924/0 (socket says 172.21.15.148:51924) 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb4888e8640 1 -- 172.21.15.148:0/100779541 learned_addr learned my addr 172.21.15.148:0/100779541 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb483fff640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb484105750 0x7fb48419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb4890e9640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb484108370 0x7fb4841a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb4888e8640 1 -- 172.21.15.148:0/100779541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb484108370 msgr2=0x7fb4841a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb4888e8640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb484108370 0x7fb4841a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb4888e8640 1 -- 172.21.15.148:0/100779541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb484105750 msgr2=0x7fb48419ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb4888e8640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb484105750 0x7fb48419ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb4888e8640 1 -- 172.21.15.148:0/100779541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4841a1a60 con 0x7fb484102c90 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb483fff640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb484105750 0x7fb48419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb4888e8640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb484102c90 0x7fb484102250 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb478006010 tx=0x7fb478031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:10:09.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb481ffb640 1 -- 172.21.15.148:0/100779541 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47803f030 con 0x7fb484102c90 2024-09-21T01:10:09.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb481ffb640 1 -- 172.21.15.148:0/100779541 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb478003aa0 con 0x7fb484102c90 2024-09-21T01:10:09.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb48ab4c640 1 -- 172.21.15.148:0/100779541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb484198a80 con 0x7fb484102c90 2024-09-21T01:10:09.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.287+0000 7fb481ffb640 1 -- 172.21.15.148:0/100779541 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb478035070 con 0x7fb484102c90 2024-09-21T01:10:09.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.288+0000 7fb48ab4c640 1 -- 172.21.15.148:0/100779541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb484198f60 con 0x7fb484102c90 2024-09-21T01:10:09.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.289+0000 7fb48ab4c640 1 -- 172.21.15.148:0/100779541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4840ff290 con 0x7fb484102c90 2024-09-21T01:10:09.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.290+0000 7fb481ffb640 1 -- 172.21.15.148:0/100779541 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7fb478042030 con 0x7fb484102c90 2024-09-21T01:10:09.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.291+0000 7fb481ffb640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4740b6510 0x7fb4740b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:09.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.291+0000 7fb483fff640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4740b6510 0x7fb4740b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:09.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.291+0000 7fb481ffb640 1 -- 172.21.15.148:0/100779541 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5862+0+0 (secure 0 0 0) 0x7fb478107580 con 0x7fb484102c90 2024-09-21T01:10:09.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.292+0000 7fb483fff640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4740b6510 0x7fb4740b8a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb470009fc0 tx=0x7fb470005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:10:09.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.295+0000 7fb481ffb640 1 -- 172.21.15.148:0/100779541 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4780d2b80 con 0x7fb484102c90 2024-09-21T01:10:09.480 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:10:08 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:10:08.985+0000 7fe94e771640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T01:10:09.480 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:10:09.024+0000 7fe946567640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:10:09.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:10:09.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T01:10:09.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:09.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:09.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:10:09.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:09.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:09.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:09.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:09.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:09.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.483 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:09 smithi181 ceph-mon[34811]: from='osd.8 ' entity='osd.8' 2024-09-21T01:10:09.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:10:09.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T01:10:09.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:09.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:09.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:10:09.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:09.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:09.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:09.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:09.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:09.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:09.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:09 smithi157 ceph-mon[34140]: from='osd.8 ' entity='osd.8' 2024-09-21T01:10:09.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:09.505+0000 7fb48ab4c640 1 -- 172.21.15.148:0/100779541 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb484063800 con 0x7fb4740b6510 2024-09-21T01:10:10.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:10:10.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:10:10.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi181 2024-09-21T01:10:10.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi181 to 5696M 2024-09-21T01:10:10.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:10.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: osd.8 [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] boot 2024-09-21T01:10:10.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T01:10:10.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:10.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:10.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:10.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:10 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:10.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:10:10.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:10:10.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi181 2024-09-21T01:10:10.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi181 to 5696M 2024-09-21T01:10:10.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:10.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: osd.8 [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] boot 2024-09-21T01:10:10.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T01:10:10.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:10.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:10.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:10.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:10 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:10.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:10:10.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:10:10.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi181 2024-09-21T01:10:10.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi181 to 5696M 2024-09-21T01:10:10.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:10.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: osd.8 [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] boot 2024-09-21T01:10:10.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T01:10:10.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:10:10.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:10.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:10.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:10 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:11.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:11 smithi148 ceph-mon[31000]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:11.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:11 smithi148 ceph-mon[31000]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T01:10:11.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:11 smithi148 ceph-mon[31000]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:11.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:11 smithi181 ceph-mon[34811]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:11.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:11 smithi181 ceph-mon[34811]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T01:10:11.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:11 smithi181 ceph-mon[34811]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:11.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:11 smithi157 ceph-mon[34140]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:11.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:11 smithi157 ceph-mon[34140]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T01:10:11.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:11 smithi157 ceph-mon[34140]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:12.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:12 smithi148 ceph-mon[31000]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T01:10:12.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:12 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/799671806' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "491086e1-cbc8-4904-bfeb-81cfa2b27b4e"} : dispatch 2024-09-21T01:10:12.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:12 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/799671806' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "491086e1-cbc8-4904-bfeb-81cfa2b27b4e"}]': finished 2024-09-21T01:10:12.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:12 smithi148 ceph-mon[31000]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T01:10:12.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:12 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:12.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:12 smithi181 ceph-mon[34811]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T01:10:12.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:12 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/799671806' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "491086e1-cbc8-4904-bfeb-81cfa2b27b4e"} : dispatch 2024-09-21T01:10:12.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:12 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/799671806' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "491086e1-cbc8-4904-bfeb-81cfa2b27b4e"}]': finished 2024-09-21T01:10:12.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:12 smithi181 ceph-mon[34811]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T01:10:12.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:12 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:12.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:12 smithi157 ceph-mon[34140]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T01:10:12.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:12 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/799671806' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "491086e1-cbc8-4904-bfeb-81cfa2b27b4e"} : dispatch 2024-09-21T01:10:12.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:12 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/799671806' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "491086e1-cbc8-4904-bfeb-81cfa2b27b4e"}]': finished 2024-09-21T01:10:12.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:12 smithi157 ceph-mon[34140]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T01:10:12.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:12 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:13.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:13 smithi148 ceph-mon[31000]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:13.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:13 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1177477477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:13.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:13 smithi181 ceph-mon[34811]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:13.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:13 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1177477477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:13.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:13 smithi157 ceph-mon[34140]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:13.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:13 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1177477477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:14.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:14 smithi148 ceph-mon[31000]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:14 smithi181 ceph-mon[34811]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:14.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:14 smithi157 ceph-mon[34140]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:16.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:16 smithi148 ceph-mon[31000]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T01:10:16.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:16 smithi181 ceph-mon[34811]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T01:10:16.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:16 smithi157 ceph-mon[34140]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T01:10:18.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:18 smithi157 ceph-mon[34140]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:10:18.597 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:18 smithi148 ceph-mon[31000]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:10:18.651 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:18 smithi181 ceph-mon[34811]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:10:20.576 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T01:10:20.576 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T01:10:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:20.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T01:10:20.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:21.605 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:21 smithi148 ceph-mon[31000]: Deploying daemon osd.9 on smithi148 2024-09-21T01:10:21.605 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:21 smithi148 ceph-mon[31000]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T01:10:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:21 smithi181 ceph-mon[34811]: Deploying daemon osd.9 on smithi148 2024-09-21T01:10:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:21 smithi181 ceph-mon[34811]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T01:10:21.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:21 smithi157 ceph-mon[34140]: Deploying daemon osd.9 on smithi148 2024-09-21T01:10:21.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:21 smithi157 ceph-mon[34140]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T01:10:22.605 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:22 smithi148 ceph-mon[31000]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T01:10:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:22 smithi181 ceph-mon[34811]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T01:10:22.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:22 smithi157 ceph-mon[34140]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T01:10:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:24 smithi148 ceph-mon[31000]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:24.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:24 smithi181 ceph-mon[34811]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:24.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:24 smithi157 ceph-mon[34140]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:26.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:26 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:26.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:26 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:26.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:26 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:26.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:26 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:26.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:26 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:26.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:26 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:26.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:26 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:26.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:26 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:26.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:26 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:27.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:27 smithi148 ceph-mon[31000]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:27.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:27 smithi181 ceph-mon[34811]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:27.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:27 smithi157 ceph-mon[34140]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:10:28.545 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:28 smithi148 ceph-mon[31000]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:28.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:28 smithi181 ceph-mon[34811]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:28.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:28 smithi157 ceph-mon[34140]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:29.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.540+0000 7fb481ffb640 1 -- 172.21.15.148:0/100779541 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb484063800 con 0x7fb4740b6510 2024-09-21T01:10:29.542 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 9 on host 'smithi148' 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 -- 172.21.15.148:0/100779541 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4740b6510 msgr2=0x7fb4740b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4740b6510 0x7fb4740b8a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb470009fc0 tx=0x7fb470005f90 comp rx=0 tx=0).stop 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 -- 172.21.15.148:0/100779541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb484102c90 msgr2=0x7fb484102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb484102c90 0x7fb484102250 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb478006010 tx=0x7fb478031a50 comp rx=0 tx=0).stop 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 -- 172.21.15.148:0/100779541 shutdown_connections 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4740b6510 0x7fb4740b8a20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb484108370 0x7fb4841a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb484105750 0x7fb48419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 --2- 172.21.15.148:0/100779541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb484102c90 0x7fb484102250 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 -- 172.21.15.148:0/100779541 >> 172.21.15.148:0/100779541 conn(0x7fb4840fd770 msgr2=0x7fb484103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 -- 172.21.15.148:0/100779541 shutdown_connections 2024-09-21T01:10:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:10:29.543+0000 7fb48ab4c640 1 -- 172.21.15.148:0/100779541 wait complete. 2024-09-21T01:10:29.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:29.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:29.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:29.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:29 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:29 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:29.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:29.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:29.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:29.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:29 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:30.230 DEBUG:teuthology.orchestra.run.smithi148:osd.9> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T01:10:30.232 INFO:tasks.cephadm:Deploying osd.10 on smithi157 with /dev/vg_nvme/lv_1... 2024-09-21T01:10:30.232 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T01:10:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:10:30.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:30 smithi148 ceph-mon[31000]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:30.907 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:30 smithi157 ceph-mon[34140]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:30.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:30 smithi181 ceph-mon[34811]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:32.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:32 smithi181 ceph-mon[34811]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T01:10:32.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:32 smithi157 ceph-mon[34140]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T01:10:32.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:32 smithi148 ceph-mon[31000]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T01:10:32.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:10:32 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:10:32.148+0000 7f21c82bd640 -1 osd.9 0 log_to_monitors true 2024-09-21T01:10:32.955 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-21T01:10:32.983 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi157:vg_nvme/lv_1 2024-09-21T01:10:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:10:33.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T01:10:33.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:10:33.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T01:10:33.615 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:33 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:33.640 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T01:10:33.640 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T01:10:33.640 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:10:33.640 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:33.640 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:33.640 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.640 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.640 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:33.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:33.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:10:33.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T01:10:33.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:33 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:33.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T01:10:33.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T01:10:33.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T01:10:33.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:33.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:33.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:33.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:33.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:33.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:33.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T01:10:33.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T01:10:33.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:33 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:33.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.733+0000 7ff7889a9640 1 -- 172.21.15.157:0/3685886769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78406b920 msgr2=0x7ff7841063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:33.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.733+0000 7ff7889a9640 1 --2- 172.21.15.157:0/3685886769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78406b920 0x7ff7841063f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff774009900 tx=0x7ff77402a410 comp rx=0 tx=0).stop 2024-09-21T01:10:33.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.733+0000 7ff7889a9640 1 -- 172.21.15.157:0/3685886769 shutdown_connections 2024-09-21T01:10:33.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.733+0000 7ff7889a9640 1 --2- 172.21.15.157:0/3685886769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff784106930 0x7ff784108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:33.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.733+0000 7ff7889a9640 1 --2- 172.21.15.157:0/3685886769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff784109470 0x7ff78410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:33.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.733+0000 7ff7889a9640 1 --2- 172.21.15.157:0/3685886769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff78406b920 0x7ff7841063f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:33.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.733+0000 7ff7889a9640 1 -- 172.21.15.157:0/3685886769 >> 172.21.15.157:0/3685886769 conn(0x7ff7840fdfb0 msgr2=0x7ff784100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:10:33.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.733+0000 7ff7889a9640 1 -- 172.21.15.157:0/3685886769 shutdown_connections 2024-09-21T01:10:33.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.733+0000 7ff7889a9640 1 -- 172.21.15.157:0/3685886769 wait complete. 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.734+0000 7ff7889a9640 1 Processor -- start 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.734+0000 7ff7889a9640 1 -- start start 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.734+0000 7ff7889a9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78406b920 0x7ff784199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.734+0000 7ff7889a9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff784106930 0x7ff78419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff7889a9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff784109470 0x7ff78419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff7889a9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff78410f350 con 0x7ff78406b920 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff7889a9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff78410f1d0 con 0x7ff784106930 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff7889a9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff78410f4d0 con 0x7ff784109470 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff781d9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff784106930 0x7ff78419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff781d9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff784106930 0x7ff78419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56920/0 (socket says 172.21.15.157:56920) 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff781d9b640 1 -- 172.21.15.157:0/3001836494 learned_addr learned my addr 172.21.15.157:0/3001836494 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff78259c640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78406b920 0x7ff784199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:33.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff782d9d640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff784109470 0x7ff78419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff78259c640 1 -- 172.21.15.157:0/3001836494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff784109470 msgr2=0x7ff78419b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff78259c640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff784109470 0x7ff78419b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff78259c640 1 -- 172.21.15.157:0/3001836494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff784106930 msgr2=0x7ff78419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff78259c640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff784106930 0x7ff78419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff78259c640 1 -- 172.21.15.157:0/3001836494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78419b950 con 0x7ff78406b920 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff781d9b640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff784106930 0x7ff78419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff782d9d640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff784109470 0x7ff78419b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff78259c640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78406b920 0x7ff784199fb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff774006010 tx=0x7ff774004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff7737fe640 1 -- 172.21.15.157:0/3001836494 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77403f070 con 0x7ff78406b920 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.735+0000 7ff7737fe640 1 -- 172.21.15.157:0/3001836494 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff774003ca0 con 0x7ff78406b920 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.736+0000 7ff7889a9640 1 -- 172.21.15.157:0/3001836494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78419bbe0 con 0x7ff78406b920 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.736+0000 7ff7737fe640 1 -- 172.21.15.157:0/3001836494 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774035070 con 0x7ff78406b920 2024-09-21T01:10:33.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.736+0000 7ff7889a9640 1 -- 172.21.15.157:0/3001836494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7841a2200 con 0x7ff78406b920 2024-09-21T01:10:33.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.736+0000 7ff7889a9640 1 -- 172.21.15.157:0/3001836494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff784106d40 con 0x7ff78406b920 2024-09-21T01:10:33.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.738+0000 7ff7737fe640 1 -- 172.21.15.157:0/3001836494 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7ff77403b4f0 con 0x7ff78406b920 2024-09-21T01:10:33.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.739+0000 7ff7737fe640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff76c0b6510 0x7ff76c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:33.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.739+0000 7ff7737fe640 1 -- 172.21.15.157:0/3001836494 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5981+0+0 (secure 0 0 0) 0x7ff7741074f0 con 0x7ff78406b920 2024-09-21T01:10:33.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.739+0000 7ff781d9b640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff76c0b6510 0x7ff76c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:33.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.739+0000 7ff781d9b640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff76c0b6510 0x7ff76c0b8a20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff778011550 tx=0x7ff778005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:10:33.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.742+0000 7ff7737fe640 1 -- 172.21.15.157:0/3001836494 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7740ce6a0 con 0x7ff78406b920 2024-09-21T01:10:33.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:33.929+0000 7ff7889a9640 1 -- 172.21.15.157:0/3001836494 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff784063800 con 0x7ff76c0b6510 2024-09-21T01:10:34.363 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:10:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:10:34.109+0000 7f21c423f640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T01:10:34.363 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:10:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:10:34.188+0000 7f21bc035640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:10:34.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:34 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi148 2024-09-21T01:10:34.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:34 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-21T01:10:34.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:34.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:34.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:34.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:34.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:34 smithi148 ceph-mon[31000]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' 2024-09-21T01:10:34.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:34 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:34.567 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:34 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi148 2024-09-21T01:10:34.567 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:34 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-21T01:10:34.567 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:34 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:34.567 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:34 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:34.567 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:34 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:34.567 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:34 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:34.567 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:34 smithi157 ceph-mon[34140]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' 2024-09-21T01:10:34.567 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:34 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:34 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi148 2024-09-21T01:10:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:34 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-21T01:10:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:34 smithi181 ceph-mon[34811]: from='osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085]' entity='osd.9' 2024-09-21T01:10:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:34 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:35.566 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:35 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:10:35.566 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:35 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:10:35.566 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:35 smithi157 ceph-mon[34140]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:35.566 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:35 smithi157 ceph-mon[34140]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:35.566 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:35 smithi157 ceph-mon[34140]: osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] boot 2024-09-21T01:10:35.566 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:35 smithi157 ceph-mon[34140]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T01:10:35.566 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:35 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:10:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:35 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:10:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:35 smithi148 ceph-mon[31000]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:35 smithi148 ceph-mon[31000]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:35 smithi148 ceph-mon[31000]: osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] boot 2024-09-21T01:10:35.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:35 smithi148 ceph-mon[31000]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T01:10:35.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:35 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:10:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:35 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:10:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:35 smithi181 ceph-mon[34811]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:35 smithi181 ceph-mon[34811]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:10:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:35 smithi181 ceph-mon[34811]: osd.9 [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] boot 2024-09-21T01:10:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:35 smithi181 ceph-mon[34811]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T01:10:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:10:37.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:37 smithi157 ceph-mon[34140]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T01:10:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:37 smithi157 ceph-mon[34140]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:37 smithi157 ceph-mon[34140]: from='client.? 172.21.15.157:0/2515362930' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9e9086f-2176-415b-ae99-ad3fbf5e3698"} : dispatch 2024-09-21T01:10:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:37 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9e9086f-2176-415b-ae99-ad3fbf5e3698"} : dispatch 2024-09-21T01:10:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:37 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9e9086f-2176-415b-ae99-ad3fbf5e3698"}]': finished 2024-09-21T01:10:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:37 smithi157 ceph-mon[34140]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T01:10:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:37 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:37 smithi157 ceph-mon[34140]: from='client.? 172.21.15.157:0/562039591' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:37.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:37 smithi181 ceph-mon[34811]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T01:10:37.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:37 smithi181 ceph-mon[34811]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:37.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:37 smithi181 ceph-mon[34811]: from='client.? 172.21.15.157:0/2515362930' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9e9086f-2176-415b-ae99-ad3fbf5e3698"} : dispatch 2024-09-21T01:10:37.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:37 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9e9086f-2176-415b-ae99-ad3fbf5e3698"} : dispatch 2024-09-21T01:10:37.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:37 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9e9086f-2176-415b-ae99-ad3fbf5e3698"}]': finished 2024-09-21T01:10:37.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:37 smithi181 ceph-mon[34811]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T01:10:37.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:37 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:37.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:37 smithi181 ceph-mon[34811]: from='client.? 172.21.15.157:0/562039591' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:37.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:37 smithi148 ceph-mon[31000]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T01:10:37.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:37 smithi148 ceph-mon[31000]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:37.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:37 smithi148 ceph-mon[31000]: from='client.? 172.21.15.157:0/2515362930' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9e9086f-2176-415b-ae99-ad3fbf5e3698"} : dispatch 2024-09-21T01:10:37.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:37 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9e9086f-2176-415b-ae99-ad3fbf5e3698"} : dispatch 2024-09-21T01:10:37.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:37 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9e9086f-2176-415b-ae99-ad3fbf5e3698"}]': finished 2024-09-21T01:10:37.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:37 smithi148 ceph-mon[31000]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T01:10:37.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:37 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:37.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:37 smithi148 ceph-mon[31000]: from='client.? 172.21.15.157:0/562039591' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:38.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:38 smithi148 ceph-mon[31000]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:38.712 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:38 smithi181 ceph-mon[34811]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:38.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:38 smithi157 ceph-mon[34140]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:40.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:40 smithi148 ceph-mon[31000]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:40.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:40 smithi181 ceph-mon[34811]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:40.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:40 smithi157 ceph-mon[34140]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:42.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:42 smithi148 ceph-mon[31000]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:42.624 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:42 smithi157 ceph-mon[34140]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:42.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:42 smithi181 ceph-mon[34811]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:44.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:44 smithi148 ceph-mon[31000]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:44.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:44 smithi181 ceph-mon[34811]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:44.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:44 smithi157 ceph-mon[34140]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:45.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T01:10:45.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:45 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:45.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:45 smithi157 ceph-mon[34140]: Deploying daemon osd.10 on smithi157 2024-09-21T01:10:45.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T01:10:45.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:45 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:45.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:45 smithi148 ceph-mon[31000]: Deploying daemon osd.10 on smithi157 2024-09-21T01:10:45.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T01:10:45.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:45 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:45.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:45 smithi181 ceph-mon[34811]: Deploying daemon osd.10 on smithi157 2024-09-21T01:10:46.428 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:46 smithi157 ceph-mon[34140]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:46.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:46 smithi148 ceph-mon[31000]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:46.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:46 smithi181 ceph-mon[34811]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:48.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:48 smithi181 ceph-mon[34811]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:48.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:48 smithi157 ceph-mon[34140]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:48.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:48 smithi148 ceph-mon[31000]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:50.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:50 smithi148 ceph-mon[31000]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:50.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:50 smithi181 ceph-mon[34811]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:50.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:50 smithi157 ceph-mon[34140]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:51.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:51 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:51.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:51 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:51.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:51 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:51.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:51 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:51.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:51 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:51.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:51 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:51.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:51 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:51.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:51 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:51.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:51 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:52.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:52 smithi148 ceph-mon[31000]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:52.631 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:52 smithi157 ceph-mon[34140]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:52.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:52 smithi181 ceph-mon[34811]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:53.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.701+0000 7ff7737fe640 1 -- 172.21.15.157:0/3001836494 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff784063800 con 0x7ff76c0b6510 2024-09-21T01:10:53.702 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 10 on host 'smithi157' 2024-09-21T01:10:53.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.703+0000 7ff7889a9640 1 -- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff76c0b6510 msgr2=0x7ff76c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.703+0000 7ff7889a9640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff76c0b6510 0x7ff76c0b8a20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff778011550 tx=0x7ff778005f90 comp rx=0 tx=0).stop 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.703+0000 7ff7889a9640 1 -- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78406b920 msgr2=0x7ff784199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.703+0000 7ff7889a9640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78406b920 0x7ff784199fb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff774006010 tx=0x7ff774004270 comp rx=0 tx=0).stop 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.703+0000 7ff7889a9640 1 -- 172.21.15.157:0/3001836494 shutdown_connections 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.703+0000 7ff7889a9640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff76c0b6510 0x7ff76c0b8a20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.703+0000 7ff7889a9640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff784109470 0x7ff78419b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.703+0000 7ff7889a9640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff784106930 0x7ff78419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.703+0000 7ff7889a9640 1 --2- 172.21.15.157:0/3001836494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff78406b920 0x7ff784199fb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.704+0000 7ff7889a9640 1 -- 172.21.15.157:0/3001836494 >> 172.21.15.157:0/3001836494 conn(0x7ff7840fdfb0 msgr2=0x7ff784104dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.704+0000 7ff7889a9640 1 -- 172.21.15.157:0/3001836494 shutdown_connections 2024-09-21T01:10:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-21T01:10:53.704+0000 7ff7889a9640 1 -- 172.21.15.157:0/3001836494 wait complete. 2024-09-21T01:10:54.410 DEBUG:teuthology.orchestra.run.smithi157:osd.10> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T01:10:54.412 INFO:tasks.cephadm:Deploying osd.11 on smithi181 with /dev/vg_nvme/lv_1... 2024-09-21T01:10:54.413 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T01:10:54.680 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:10:54.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:54.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:54.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:54 smithi181 ceph-mon[34811]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:54.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:54.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:54.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:54.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:54.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:54 smithi157 ceph-mon[34140]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:54.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:54.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:54 smithi148 ceph-mon[31000]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:56.465 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:56 smithi157 ceph-mon[34140]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:56.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:56 smithi148 ceph-mon[31000]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:56.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:56 smithi181 ceph-mon[34811]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:56.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:10:56 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:10:56.463+0000 7fc02fc5c640 -1 osd.10 0 log_to_monitors true 2024-09-21T01:10:57.191 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T01:10:57.217 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_1 2024-09-21T01:10:57.470 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:10:57.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:57 smithi157 ceph-mon[34140]: from='osd.10 [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:10:57.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:57 smithi157 ceph-mon[34140]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:10:57.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:57 smithi181 ceph-mon[34811]: from='osd.10 [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:10:57.494 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:57 smithi181 ceph-mon[34811]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:10:57.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:57 smithi148 ceph-mon[31000]: from='osd.10 [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:10:57.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:57 smithi148 ceph-mon[31000]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:10:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.027+0000 7faac92fa640 1 -- 172.21.15.181:0/1170718619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faac4105750 msgr2=0x7faac4107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.027+0000 7faac92fa640 1 --2- 172.21.15.181:0/1170718619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faac4105750 0x7faac4107c30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faaac009900 tx=0x7faaac02a410 comp rx=0 tx=0).stop 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.027+0000 7faac92fa640 1 -- 172.21.15.181:0/1170718619 shutdown_connections 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.027+0000 7faac92fa640 1 --2- 172.21.15.181:0/1170718619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac4108370 0x7faac410a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.027+0000 7faac92fa640 1 --2- 172.21.15.181:0/1170718619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faac4105750 0x7faac4107c30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.027+0000 7faac92fa640 1 --2- 172.21.15.181:0/1170718619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac4102cf0 0x7faac4105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.027+0000 7faac92fa640 1 -- 172.21.15.181:0/1170718619 >> 172.21.15.181:0/1170718619 conn(0x7faac40fd770 msgr2=0x7faac40ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.027+0000 7faac92fa640 1 -- 172.21.15.181:0/1170718619 shutdown_connections 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.027+0000 7faac92fa640 1 -- 172.21.15.181:0/1170718619 wait complete. 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.028+0000 7faac92fa640 1 Processor -- start 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.028+0000 7faac92fa640 1 -- start start 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.028+0000 7faac92fa640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac4102cf0 0x7faac4104950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.028+0000 7faac92fa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faac4105750 0x7faac4103220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.028+0000 7faac92fa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac4108370 0x7faac4103760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.028+0000 7faac92fa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faac410e280 con 0x7faac4108370 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.028+0000 7faac92fa640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faac410e100 con 0x7faac4102cf0 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.028+0000 7faac92fa640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faac410e400 con 0x7faac4105750 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.028+0000 7faabbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faac4105750 0x7faac4103220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faabbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faac4105750 0x7faac4103220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36100/0 (socket says 172.21.15.181:36100) 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faabbfff640 1 -- 172.21.15.181:0/3813044940 learned_addr learned my addr 172.21.15.181:0/3813044940 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faac37fe640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac4108370 0x7faac4103760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faac2ffd640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac4102cf0 0x7faac4104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faabbfff640 1 -- 172.21.15.181:0/3813044940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac4102cf0 msgr2=0x7faac4104950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faabbfff640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac4102cf0 0x7faac4104950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faabbfff640 1 -- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac4108370 msgr2=0x7faac4103760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faabbfff640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac4108370 0x7faac4103760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faabbfff640 1 -- 172.21.15.181:0/3813044940 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac4103e60 con 0x7faac4105750 2024-09-21T01:10:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faac37fe640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac4108370 0x7faac4103760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:10:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faabbfff640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faac4105750 0x7faac4103220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faaac006010 tx=0x7faaac031a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:10:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faac0ff9640 1 -- 172.21.15.181:0/3813044940 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac03f030 con 0x7faac4105750 2024-09-21T01:10:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faac0ff9640 1 -- 172.21.15.181:0/3813044940 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaac003aa0 con 0x7faac4105750 2024-09-21T01:10:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.029+0000 7faac92fa640 1 -- 172.21.15.181:0/3813044940 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac41a4060 con 0x7faac4105750 2024-09-21T01:10:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.030+0000 7faac0ff9640 1 -- 172.21.15.181:0/3813044940 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac035070 con 0x7faac4105750 2024-09-21T01:10:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.030+0000 7faac92fa640 1 -- 172.21.15.181:0/3813044940 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac41a4450 con 0x7faac4105750 2024-09-21T01:10:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.031+0000 7faac92fa640 1 -- 172.21.15.181:0/3813044940 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac4105c20 con 0x7faac4105750 2024-09-21T01:10:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.033+0000 7faac0ff9640 1 -- 172.21.15.181:0/3813044940 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7faaac042030 con 0x7faac4105750 2024-09-21T01:10:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.033+0000 7faac0ff9640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faab00b6590 0x7faab00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.034+0000 7faac0ff9640 1 -- 172.21.15.181:0/3813044940 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6398+0+0 (secure 0 0 0) 0x7faaac107730 con 0x7faac4105750 2024-09-21T01:10:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.034+0000 7faac2ffd640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faab00b6590 0x7faab00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.034+0000 7faac2ffd640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faab00b6590 0x7faab00b8aa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faab40058c0 tx=0x7faab400a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:10:58.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.041+0000 7faac0ff9640 1 -- 172.21.15.181:0/3813044940 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faaac0d2b20 con 0x7faac4105750 2024-09-21T01:10:58.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:10:58.233+0000 7faac92fa640 1 -- 172.21.15.181:0/3813044940 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7faac40feb90 con 0x7faab00b6590 2024-09-21T01:10:58.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T01:10:58.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='osd.10 [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:10:58.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T01:10:58.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:58.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:10:58.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi157 2024-09-21T01:10:58.365 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi157 to 4272M 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:58.366 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:58.367 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.367 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:58.367 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:58.367 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:58.367 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:58.367 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:58 smithi148 ceph-mon[31000]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:58.616 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='osd.10 [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi157 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi157 to 4272M 2024-09-21T01:10:58.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:58.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:58 smithi181 ceph-mon[34811]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T01:10:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='osd.10 [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]} : dispatch 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi157 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi157 to 4272M 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:58.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:58.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:58.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:10:58.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:58.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:58.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:58.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:58.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:58 smithi157 ceph-mon[34140]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:10:59.363 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:10:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:10:59.057+0000 7fc02bbde640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T01:10:59.363 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:10:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:10:59.070+0000 7fc0239d4640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:10:59.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:59 smithi148 ceph-mon[31000]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:10:59.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:59 smithi148 ceph-mon[31000]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T01:10:59.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:59 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:59.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:59 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:59.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:10:59 smithi148 ceph-mon[31000]: from='osd.10 ' entity='osd.10' 2024-09-21T01:10:59.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:59 smithi181 ceph-mon[34811]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:10:59.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:59 smithi181 ceph-mon[34811]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T01:10:59.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:59 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:59.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:59 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:59.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:10:59 smithi181 ceph-mon[34811]: from='osd.10 ' entity='osd.10' 2024-09-21T01:10:59.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:59 smithi157 ceph-mon[34140]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-21T01:10:59.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:59 smithi157 ceph-mon[34140]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T01:10:59.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:59 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:59.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:59 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:10:59.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:10:59 smithi157 ceph-mon[34140]: from='osd.10 ' entity='osd.10' 2024-09-21T01:11:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:00 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:11:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:00 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:11:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:11:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:00 smithi181 ceph-mon[34811]: osd.10 [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] boot 2024-09-21T01:11:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:00 smithi181 ceph-mon[34811]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T01:11:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:11:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:00 smithi181 ceph-mon[34811]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:11:00.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:00 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:11:00.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:00 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:11:00.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:11:00.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:00 smithi157 ceph-mon[34140]: osd.10 [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] boot 2024-09-21T01:11:00.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:00 smithi157 ceph-mon[34140]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T01:11:00.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:11:00.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:00 smithi157 ceph-mon[34140]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:11:00.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:00 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:11:00.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:00 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:11:00.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:11:00.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:00 smithi148 ceph-mon[31000]: osd.10 [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] boot 2024-09-21T01:11:00.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:00 smithi148 ceph-mon[31000]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T01:11:00.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:11:00.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:00 smithi148 ceph-mon[31000]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:11:01.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:01 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/2309432122' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4bcfec34-f542-4554-8fb2-d05eb39e1948"} : dispatch 2024-09-21T01:11:01.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:01 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4bcfec34-f542-4554-8fb2-d05eb39e1948"} : dispatch 2024-09-21T01:11:01.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:01 smithi181 ceph-mon[34811]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bcfec34-f542-4554-8fb2-d05eb39e1948"}]': finished 2024-09-21T01:11:01.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:01 smithi181 ceph-mon[34811]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T01:11:01.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:01 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:01.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:01 smithi181 ceph-mon[34811]: from='client.? 172.21.15.181:0/143327725' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:11:01.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:01 smithi157 ceph-mon[34140]: from='client.? 172.21.15.181:0/2309432122' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4bcfec34-f542-4554-8fb2-d05eb39e1948"} : dispatch 2024-09-21T01:11:01.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:01 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4bcfec34-f542-4554-8fb2-d05eb39e1948"} : dispatch 2024-09-21T01:11:01.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:01 smithi157 ceph-mon[34140]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bcfec34-f542-4554-8fb2-d05eb39e1948"}]': finished 2024-09-21T01:11:01.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:01 smithi157 ceph-mon[34140]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T01:11:01.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:01 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:01.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:01 smithi157 ceph-mon[34140]: from='client.? 172.21.15.181:0/143327725' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:11:01.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:01 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/2309432122' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4bcfec34-f542-4554-8fb2-d05eb39e1948"} : dispatch 2024-09-21T01:11:01.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:01 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4bcfec34-f542-4554-8fb2-d05eb39e1948"} : dispatch 2024-09-21T01:11:01.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:01 smithi148 ceph-mon[31000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bcfec34-f542-4554-8fb2-d05eb39e1948"}]': finished 2024-09-21T01:11:01.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:01 smithi148 ceph-mon[31000]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T01:11:01.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:01 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:01.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:01 smithi148 ceph-mon[31000]: from='client.? 172.21.15.181:0/143327725' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:11:02.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:02 smithi148 ceph-mon[31000]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T01:11:02.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:02.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:02 smithi148 ceph-mon[31000]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:02.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:02 smithi181 ceph-mon[34811]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T01:11:02.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:02.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:02 smithi181 ceph-mon[34811]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:02.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:02 smithi157 ceph-mon[34140]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T01:11:02.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:02.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:02 smithi157 ceph-mon[34140]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:04 smithi148 ceph-mon[31000]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:04 smithi181 ceph-mon[34811]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:04.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:04 smithi157 ceph-mon[34140]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:06.406 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:06 smithi181 ceph-mon[34811]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T01:11:06.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:06 smithi148 ceph-mon[31000]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T01:11:06.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:06 smithi157 ceph-mon[34140]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T01:11:08.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:08 smithi181 ceph-mon[34811]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:11:08.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:08 smithi148 ceph-mon[31000]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:11:08.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:08 smithi157 ceph-mon[34140]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:11:09.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T01:11:09.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:09.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T01:11:09.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:09.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T01:11:09.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:10.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:10 smithi148 ceph-mon[31000]: Deploying daemon osd.11 on smithi181 2024-09-21T01:11:10.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:10 smithi148 ceph-mon[31000]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T01:11:10.635 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:10 smithi181 ceph-mon[34811]: Deploying daemon osd.11 on smithi181 2024-09-21T01:11:10.635 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:10 smithi181 ceph-mon[34811]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T01:11:10.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:10 smithi157 ceph-mon[34140]: Deploying daemon osd.11 on smithi181 2024-09-21T01:11:10.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:10 smithi157 ceph-mon[34140]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T01:11:13.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:13 smithi148 ceph-mon[31000]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T01:11:13.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:13 smithi181 ceph-mon[34811]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T01:11:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:13 smithi157 ceph-mon[34140]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T01:11:15.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:15 smithi148 ceph-mon[31000]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:15.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:15.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:15.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:15 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:15.673 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:15 smithi181 ceph-mon[34811]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:15.673 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:15.673 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:15.673 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:15 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:15.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:15 smithi157 ceph-mon[34140]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:15.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:15.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:15.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:15 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:17.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:17 smithi148 ceph-mon[31000]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:17.660 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:17 smithi181 ceph-mon[34811]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:17.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:17 smithi157 ceph-mon[34140]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:18.311 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 11 on host 'smithi181' 2024-09-21T01:11:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.310+0000 7faac0ff9640 1 -- 172.21.15.181:0/3813044940 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7faac40feb90 con 0x7faab00b6590 2024-09-21T01:11:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 -- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faab00b6590 msgr2=0x7faab00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faab00b6590 0x7faab00b8aa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faab40058c0 tx=0x7faab400a250 comp rx=0 tx=0).stop 2024-09-21T01:11:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 -- 172.21.15.181:0/3813044940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faac4105750 msgr2=0x7faac4103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faac4105750 0x7faac4103220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faaac006010 tx=0x7faaac031a50 comp rx=0 tx=0).stop 2024-09-21T01:11:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 -- 172.21.15.181:0/3813044940 shutdown_connections 2024-09-21T01:11:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faab00b6590 0x7faab00b8aa0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faac4108370 0x7faac4103760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faac4105750 0x7faac4103220 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 --2- 172.21.15.181:0/3813044940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faac4102cf0 0x7faac4104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 -- 172.21.15.181:0/3813044940 >> 172.21.15.181:0/3813044940 conn(0x7faac40fd770 msgr2=0x7faac4107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 -- 172.21.15.181:0/3813044940 shutdown_connections 2024-09-21T01:11:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:18.312+0000 7faac92fa640 1 -- 172.21.15.181:0/3813044940 wait complete. 2024-09-21T01:11:18.927 DEBUG:teuthology.orchestra.run.smithi181:osd.11> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T01:11:18.929 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T01:11:18.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T01:11:19.196 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:19.568 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:19 smithi148 ceph-mon[31000]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:19.568 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.568 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.568 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.568 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:19 smithi181 ceph-mon[34811]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:19.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.661+0000 7f3d37ec7640 1 -- 172.21.15.148:0/3014889286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d30109470 msgr2=0x7f3d3010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.661+0000 7f3d37ec7640 1 --2- 172.21.15.148:0/3014889286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d30109470 0x7f3d3010b980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009be0 tx=0x7f3d2802a6c0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.661+0000 7f3d37ec7640 1 -- 172.21.15.148:0/3014889286 shutdown_connections 2024-09-21T01:11:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.661+0000 7f3d37ec7640 1 --2- 172.21.15.148:0/3014889286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d30109470 0x7f3d3010b980 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.661+0000 7f3d37ec7640 1 --2- 172.21.15.148:0/3014889286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d30106930 0x7f3d30108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.661+0000 7f3d37ec7640 1 --2- 172.21.15.148:0/3014889286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d3006b920 0x7f3d301063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.661+0000 7f3d37ec7640 1 -- 172.21.15.148:0/3014889286 >> 172.21.15.148:0/3014889286 conn(0x7f3d300fdfb0 msgr2=0x7f3d30100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.661+0000 7f3d37ec7640 1 -- 172.21.15.148:0/3014889286 shutdown_connections 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.661+0000 7f3d37ec7640 1 -- 172.21.15.148:0/3014889286 wait complete. 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d37ec7640 1 Processor -- start 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d37ec7640 1 -- start start 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d37ec7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3006b920 0x7f3d30103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d37ec7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d30106930 0x7f3d301022f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d37ec7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d30109470 0x7f3d30102830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d37ec7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3010f380 con 0x7f3d3006b920 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d37ec7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3010f200 con 0x7f3d30106930 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d37ec7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3010f500 con 0x7f3d30109470 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d35c63640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3006b920 0x7f3d30103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d35c63640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3006b920 0x7f3d30103a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48748/0 (socket says 172.21.15.148:48748) 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.662+0000 7f3d35c63640 1 -- 172.21.15.148:0/2187695570 learned_addr learned my addr 172.21.15.148:0/2187695570 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d35462640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d30106930 0x7f3d301022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d36464640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d30109470 0x7f3d30102830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d35c63640 1 -- 172.21.15.148:0/2187695570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d30109470 msgr2=0x7f3d30102830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d35c63640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d30109470 0x7f3d30102830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d35c63640 1 -- 172.21.15.148:0/2187695570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d30106930 msgr2=0x7f3d301022f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d35c63640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d30106930 0x7f3d301022f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d35c63640 1 -- 172.21.15.148:0/2187695570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d30102f30 con 0x7f3d3006b920 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d35462640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d30106930 0x7f3d301022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d35c63640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3006b920 0x7f3d30103a20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000e9f0 tx=0x7f3d2000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d26ffd640 1 -- 172.21.15.148:0/2187695570 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000cd80 con 0x7f3d3006b920 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d26ffd640 1 -- 172.21.15.148:0/2187695570 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d200054d0 con 0x7f3d3006b920 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d37ec7640 1 -- 172.21.15.148:0/2187695570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d301a3fe0 con 0x7f3d3006b920 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d26ffd640 1 -- 172.21.15.148:0/2187695570 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20010690 con 0x7f3d3006b920 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.663+0000 7f3d37ec7640 1 -- 172.21.15.148:0/2187695570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d301a4380 con 0x7f3d3006b920 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.664+0000 7f3d37ec7640 1 -- 172.21.15.148:0/2187695570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d30106d40 con 0x7f3d3006b920 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.666+0000 7f3d26ffd640 1 -- 172.21.15.148:0/2187695570 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f3d20004e30 con 0x7f3d3006b920 2024-09-21T01:11:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.667+0000 7f3d26ffd640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3d1c0b6510 0x7f3d1c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:19.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.667+0000 7f3d35462640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3d1c0b6510 0x7f3d1c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:19.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.667+0000 7f3d26ffd640 1 -- 172.21.15.148:0/2187695570 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6809+0+0 (secure 0 0 0) 0x7f3d200e74c0 con 0x7f3d3006b920 2024-09-21T01:11:19.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.667+0000 7f3d35462640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3d1c0b6510 0x7f3d1c0b8a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c005fd0 tx=0x7f3d2c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:19.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.670+0000 7f3d26ffd640 1 -- 172.21.15.148:0/2187695570 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d20056710 con 0x7f3d3006b920 2024-09-21T01:11:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:19 smithi157 ceph-mon[34140]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:19.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.857+0000 7f3d37ec7640 1 -- 172.21.15.148:0/2187695570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3d30063fc0 con 0x7f3d3006b920 2024-09-21T01:11:19.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.857+0000 7f3d26ffd640 1 -- 172.21.15.148:0/2187695570 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f3d200ae310 con 0x7f3d3006b920 2024-09-21T01:11:19.858 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:19.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.859+0000 7f3d37ec7640 1 -- 172.21.15.148:0/2187695570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3d1c0b6510 msgr2=0x7f3d1c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:19.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.859+0000 7f3d37ec7640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3d1c0b6510 0x7f3d1c0b8a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c005fd0 tx=0x7f3d2c009260 comp rx=0 tx=0).stop 2024-09-21T01:11:19.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.859+0000 7f3d37ec7640 1 -- 172.21.15.148:0/2187695570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3006b920 msgr2=0x7f3d30103a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:19.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.859+0000 7f3d37ec7640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3006b920 0x7f3d30103a20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000e9f0 tx=0x7f3d2000edf0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.860+0000 7f3d37ec7640 1 -- 172.21.15.148:0/2187695570 shutdown_connections 2024-09-21T01:11:19.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.860+0000 7f3d37ec7640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3d1c0b6510 0x7f3d1c0b8a20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.860+0000 7f3d37ec7640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d30109470 0x7f3d30102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.860+0000 7f3d37ec7640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d30106930 0x7f3d301022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.860+0000 7f3d37ec7640 1 --2- 172.21.15.148:0/2187695570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3006b920 0x7f3d30103a20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:19.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.860+0000 7f3d37ec7640 1 -- 172.21.15.148:0/2187695570 >> 172.21.15.148:0/2187695570 conn(0x7f3d300fdfb0 msgr2=0x7f3d30104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:19.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.860+0000 7f3d37ec7640 1 -- 172.21.15.148:0/2187695570 shutdown_connections 2024-09-21T01:11:19.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:19.860+0000 7f3d37ec7640 1 -- 172.21.15.148:0/2187695570 wait complete. 2024-09-21T01:11:20.586 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:20 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2187695570' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:11:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:20 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2187695570' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:11:20.650 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726881060,"num_in_osds":12,"osd_in_since":1726881060,"num_remapped_pgs":0} 2024-09-21T01:11:20.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:20 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2187695570' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:11:21.230 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:11:20 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:11:20.840+0000 7f5c7d73d640 -1 osd.11 0 log_to_monitors true 2024-09-21T01:11:21.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:21 smithi148 ceph-mon[31000]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:21.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:21 smithi148 ceph-mon[31000]: from='osd.11 [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:11:21.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:21 smithi148 ceph-mon[31000]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:11:21.651 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T01:11:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:21 smithi181 ceph-mon[34811]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:21 smithi181 ceph-mon[34811]: from='osd.11 [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:11:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:21 smithi181 ceph-mon[34811]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:11:21.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:21 smithi157 ceph-mon[34140]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:21.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:21 smithi157 ceph-mon[34140]: from='osd.11 [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:11:21.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:21 smithi157 ceph-mon[34140]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:11:21.911 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.385+0000 7fc61370b640 1 -- 172.21.15.148:0/3875907774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc60c106900 msgr2=0x7fc60c108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.385+0000 7fc61370b640 1 --2- 172.21.15.148:0/3875907774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc60c106900 0x7fc60c108d60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc600009900 tx=0x7fc60002a410 comp rx=0 tx=0).stop 2024-09-21T01:11:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.385+0000 7fc61370b640 1 -- 172.21.15.148:0/3875907774 shutdown_connections 2024-09-21T01:11:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.385+0000 7fc61370b640 1 --2- 172.21.15.148:0/3875907774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc60c106900 0x7fc60c108d60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.385+0000 7fc61370b640 1 --2- 172.21.15.148:0/3875907774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc60c1094a0 0x7fc60c10b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.385+0000 7fc61370b640 1 --2- 172.21.15.148:0/3875907774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc60c06c340 0x7fc60c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.385+0000 7fc61370b640 1 -- 172.21.15.148:0/3875907774 >> 172.21.15.148:0/3875907774 conn(0x7fc60c0fdfe0 msgr2=0x7fc60c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.385+0000 7fc61370b640 1 -- 172.21.15.148:0/3875907774 shutdown_connections 2024-09-21T01:11:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.385+0000 7fc61370b640 1 -- 172.21.15.148:0/3875907774 wait complete. 2024-09-21T01:11:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc61370b640 1 Processor -- start 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc61370b640 1 -- start start 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc61370b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc60c06c340 0x7fc60c199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc61370b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc60c106900 0x7fc60c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc61370b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc60c1094a0 0x7fc60c19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc61370b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c10f390 con 0x7fc60c06c340 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc61370b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c10f210 con 0x7fc60c1094a0 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc61370b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c10f510 con 0x7fc60c106900 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc6114a7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc60c06c340 0x7fc60c199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc6114a7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc60c06c340 0x7fc60c199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48758/0 (socket says 172.21.15.148:48758) 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc6114a7640 1 -- 172.21.15.148:0/487096028 learned_addr learned my addr 172.21.15.148:0/487096028 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc610ca6640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc60c106900 0x7fc60c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.386+0000 7fc611ca8640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc60c1094a0 0x7fc60c19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc6114a7640 1 -- 172.21.15.148:0/487096028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc60c106900 msgr2=0x7fc60c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc6114a7640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc60c106900 0x7fc60c19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc6114a7640 1 -- 172.21.15.148:0/487096028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc60c1094a0 msgr2=0x7fc60c19b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc6114a7640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc60c1094a0 0x7fc60c19b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc6114a7640 1 -- 172.21.15.148:0/487096028 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c19b9f0 con 0x7fc60c06c340 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc6114a7640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc60c06c340 0x7fc60c199fc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00eab0 tx=0x7fc5fc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc60a7fc640 1 -- 172.21.15.148:0/487096028 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00ce40 con 0x7fc60c06c340 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc61370b640 1 -- 172.21.15.148:0/487096028 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60c19bce0 con 0x7fc60c06c340 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc60a7fc640 1 -- 172.21.15.148:0/487096028 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5fc011920 con 0x7fc60c06c340 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc60a7fc640 1 -- 172.21.15.148:0/487096028 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc010a30 con 0x7fc60c06c340 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.387+0000 7fc61370b640 1 -- 172.21.15.148:0/487096028 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60c1a23e0 con 0x7fc60c06c340 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.388+0000 7fc61370b640 1 -- 172.21.15.148:0/487096028 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60c0ffb00 con 0x7fc60c06c340 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.389+0000 7fc60a7fc640 1 -- 172.21.15.148:0/487096028 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7fc5fc010bd0 con 0x7fc60c06c340 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.390+0000 7fc60a7fc640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc5f40b6510 0x7fc5f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.390+0000 7fc610ca6640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc5f40b6510 0x7fc5f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.390+0000 7fc60a7fc640 1 -- 172.21.15.148:0/487096028 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6847+0+0 (secure 0 0 0) 0x7fc5fc0e72b0 con 0x7fc60c06c340 2024-09-21T01:11:22.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.391+0000 7fc610ca6640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc5f40b6510 0x7fc5f40b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc600000c00 tx=0x7fc600031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:22.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.394+0000 7fc60a7fc640 1 -- 172.21.15.148:0/487096028 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc5fc016030 con 0x7fc60c06c340 2024-09-21T01:11:22.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.571+0000 7fc61370b640 1 -- 172.21.15.148:0/487096028 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc60c063fc0 con 0x7fc60c06c340 2024-09-21T01:11:22.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.572+0000 7fc60a7fc640 1 -- 172.21.15.148:0/487096028 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7fc5fc0ae100 con 0x7fc60c06c340 2024-09-21T01:11:22.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T01:11:22.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='osd.11 [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:11:22.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T01:11:22.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:22.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:11:22.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: Detected new or changed devices on smithi181 2024-09-21T01:11:22.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: Adjusting osd_memory_target on smithi181 to 4272M 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:22.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:22 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:22.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.574+0000 7fc61370b640 1 -- 172.21.15.148:0/487096028 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc5f40b6510 msgr2=0x7fc5f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:22.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.574+0000 7fc61370b640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc5f40b6510 0x7fc5f40b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc600000c00 tx=0x7fc600031400 comp rx=0 tx=0).stop 2024-09-21T01:11:22.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.574+0000 7fc61370b640 1 -- 172.21.15.148:0/487096028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc60c06c340 msgr2=0x7fc60c199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.574+0000 7fc61370b640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc60c06c340 0x7fc60c199fc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00eab0 tx=0x7fc5fc00ef70 comp rx=0 tx=0).stop 2024-09-21T01:11:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.574+0000 7fc61370b640 1 -- 172.21.15.148:0/487096028 shutdown_connections 2024-09-21T01:11:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.574+0000 7fc61370b640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc5f40b6510 0x7fc5f40b8a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.575+0000 7fc61370b640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc60c1094a0 0x7fc60c19b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.575+0000 7fc61370b640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc60c106900 0x7fc60c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.575+0000 7fc61370b640 1 --2- 172.21.15.148:0/487096028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc60c06c340 0x7fc60c199fc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.575+0000 7fc61370b640 1 -- 172.21.15.148:0/487096028 >> 172.21.15.148:0/487096028 conn(0x7fc60c0fdfe0 msgr2=0x7fc60c104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.575+0000 7fc61370b640 1 -- 172.21.15.148:0/487096028 shutdown_connections 2024-09-21T01:11:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:22.575+0000 7fc61370b640 1 -- 172.21.15.148:0/487096028 wait complete. 2024-09-21T01:11:22.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:11:22.323+0000 7f5c796bf640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T01:11:22.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:11:22.340+0000 7f5c754bd640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:11:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T01:11:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='osd.11 [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:11:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T01:11:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:11:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: Detected new or changed devices on smithi181 2024-09-21T01:11:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: Adjusting osd_memory_target on smithi181 to 4272M 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:22.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:22 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T01:11:22.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='osd.11 [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: Detected new or changed devices on smithi181 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: Adjusting osd_memory_target on smithi181 to 4272M 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:22.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:22.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:22.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:22.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:22.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:22.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:22 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:23.342 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726881060,"num_in_osds":12,"osd_in_since":1726881060,"num_remapped_pgs":0} 2024-09-21T01:11:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:23 smithi148 ceph-mon[31000]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:23 smithi148 ceph-mon[31000]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:11:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:23 smithi148 ceph-mon[31000]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T01:11:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:23 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:23 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:23.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:23 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/487096028' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:11:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:23 smithi181 ceph-mon[34811]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:23 smithi181 ceph-mon[34811]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:11:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:23 smithi181 ceph-mon[34811]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T01:11:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:23 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:23 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:23.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:23 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/487096028' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:11:23.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:23 smithi157 ceph-mon[34140]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:23.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:23 smithi157 ceph-mon[34140]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T01:11:23.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:23 smithi157 ceph-mon[34140]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T01:11:23.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:23 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:23.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:23 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:23.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:23 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/487096028' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:11:24.343 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T01:11:24.596 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:24 smithi148 ceph-mon[31000]: purged_snaps scrub starts 2024-09-21T01:11:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:24 smithi148 ceph-mon[31000]: purged_snaps scrub ok 2024-09-21T01:11:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:24 smithi148 ceph-mon[31000]: osd.11 [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] boot 2024-09-21T01:11:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:24 smithi148 ceph-mon[31000]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T01:11:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:24 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:24.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:24 smithi181 ceph-mon[34811]: purged_snaps scrub starts 2024-09-21T01:11:24.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:24 smithi181 ceph-mon[34811]: purged_snaps scrub ok 2024-09-21T01:11:24.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:24 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:24.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:24 smithi181 ceph-mon[34811]: osd.11 [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] boot 2024-09-21T01:11:24.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:24 smithi181 ceph-mon[34811]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T01:11:24.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:24 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:24.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:24 smithi157 ceph-mon[34140]: purged_snaps scrub starts 2024-09-21T01:11:24.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:24 smithi157 ceph-mon[34140]: purged_snaps scrub ok 2024-09-21T01:11:24.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:24 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:24.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:24 smithi157 ceph-mon[34140]: osd.11 [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] boot 2024-09-21T01:11:24.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:24 smithi157 ceph-mon[34140]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T01:11:24.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:24 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:11:25.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.081+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3741665455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6adc101b00 msgr2=0x7f6adc101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:25.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.081+0000 7f6ae40b6640 1 --2- 172.21.15.148:0/3741665455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6adc101b00 0x7f6adc101f10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009ca0 tx=0x7f6acc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:11:25.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.081+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3741665455 shutdown_connections 2024-09-21T01:11:25.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.081+0000 7f6ae40b6640 1 --2- 172.21.15.148:0/3741665455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc109470 0x7f6adc10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:25.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.081+0000 7f6ae40b6640 1 --2- 172.21.15.148:0/3741665455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6adc102530 0x7f6adc108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:25.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.081+0000 7f6ae40b6640 1 --2- 172.21.15.148:0/3741665455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6adc101b00 0x7f6adc101f10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:25.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.081+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3741665455 >> 172.21.15.148:0/3741665455 conn(0x7f6adc0fd770 msgr2=0x7f6adc0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.081+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3741665455 shutdown_connections 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.081+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3741665455 wait complete. 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae40b6640 1 Processor -- start 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae40b6640 1 -- start start 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae40b6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6adc101b00 0x7f6adc19a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae40b6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6adc102530 0x7f6adc19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae40b6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc109470 0x7f6adc19b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae40b6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc10f3d0 con 0x7f6adc102530 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae40b6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc10f250 con 0x7f6adc109470 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae40b6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc10f550 con 0x7f6adc101b00 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae1651640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6adc102530 0x7f6adc19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae1651640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6adc102530 0x7f6adc19a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48770/0 (socket says 172.21.15.148:48770) 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae1651640 1 -- 172.21.15.148:0/3396493315 learned_addr learned my addr 172.21.15.148:0/3396493315 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae1e52640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6adc101b00 0x7f6adc19a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae2653640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc109470 0x7f6adc19b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae1651640 1 -- 172.21.15.148:0/3396493315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6adc101b00 msgr2=0x7f6adc19a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae1651640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6adc101b00 0x7f6adc19a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae1651640 1 -- 172.21.15.148:0/3396493315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc109470 msgr2=0x7f6adc19b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae1651640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc109470 0x7f6adc19b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.082+0000 7f6ae1651640 1 -- 172.21.15.148:0/3396493315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc19ba50 con 0x7f6adc102530 2024-09-21T01:11:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.083+0000 7f6ae1651640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6adc102530 0x7f6adc19a690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000b4a0 tx=0x7f6ad000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:25.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.083+0000 7f6adaffd640 1 -- 172.21.15.148:0/3396493315 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0014070 con 0x7f6adc102530 2024-09-21T01:11:25.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.083+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3396493315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6adc19bd40 con 0x7f6adc102530 2024-09-21T01:11:25.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.083+0000 7f6adaffd640 1 -- 172.21.15.148:0/3396493315 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad0010ac0 con 0x7f6adc102530 2024-09-21T01:11:25.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.083+0000 7f6adaffd640 1 -- 172.21.15.148:0/3396493315 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0017c30 con 0x7f6adc102530 2024-09-21T01:11:25.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.083+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3396493315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6adc1a2440 con 0x7f6adc102530 2024-09-21T01:11:25.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.084+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3396493315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6adc0ff290 con 0x7f6adc102530 2024-09-21T01:11:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.085+0000 7f6adaffd640 1 -- 172.21.15.148:0/3396493315 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f6ad0017070 con 0x7f6adc102530 2024-09-21T01:11:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.086+0000 7f6adaffd640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6ac40b6510 0x7f6ac40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.086+0000 7f6ae1e52640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6ac40b6510 0x7f6ac40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.086+0000 7f6adaffd640 1 -- 172.21.15.148:0/3396493315 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f6ad00e6480 con 0x7f6adc102530 2024-09-21T01:11:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.087+0000 7f6ae1e52640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6ac40b6510 0x7f6ac40b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6acc000f80 tx=0x7f6acc009420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:25.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.089+0000 7f6adaffd640 1 -- 172.21.15.148:0/3396493315 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ad00b1590 con 0x7f6adc102530 2024-09-21T01:11:25.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.270+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3396493315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6adc063fc0 con 0x7f6adc102530 2024-09-21T01:11:25.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.270+0000 7f6adaffd640 1 -- 172.21.15.148:0/3396493315 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f6ad00b64d0 con 0x7f6adc102530 2024-09-21T01:11:25.271 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3396493315 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6ac40b6510 msgr2=0x7f6ac40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6ac40b6510 0x7f6ac40b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6acc000f80 tx=0x7f6acc009420 comp rx=0 tx=0).stop 2024-09-21T01:11:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3396493315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6adc102530 msgr2=0x7f6adc19a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6adc102530 0x7f6adc19a690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000b4a0 tx=0x7f6ad000b960 comp rx=0 tx=0).stop 2024-09-21T01:11:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3396493315 shutdown_connections 2024-09-21T01:11:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6ac40b6510 0x7f6ac40b8a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:25.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6adc102530 0x7f6adc19a690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:25.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc109470 0x7f6adc19b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:25.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 --2- 172.21.15.148:0/3396493315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6adc101b00 0x7f6adc19a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:25.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3396493315 >> 172.21.15.148:0/3396493315 conn(0x7f6adc0fd770 msgr2=0x7f6adc1076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:25.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3396493315 shutdown_connections 2024-09-21T01:11:25.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:25.273+0000 7f6ae40b6640 1 -- 172.21.15.148:0/3396493315 wait complete. 2024-09-21T01:11:25.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:25 smithi148 ceph-mon[31000]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:25.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:25 smithi148 ceph-mon[31000]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T01:11:25.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:25 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3396493315' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:11:25.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:25 smithi181 ceph-mon[34811]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:25.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:25 smithi181 ceph-mon[34811]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T01:11:25.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:25 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3396493315' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:11:25.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:25 smithi157 ceph-mon[34140]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:11:25.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:25 smithi157 ceph-mon[34140]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T01:11:25.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:25 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3396493315' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:11:25.988 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":69,"num_osds":12,"num_up_osds":12,"osd_up_since":1726881083,"num_in_osds":12,"osd_in_since":1726881060,"num_remapped_pgs":0} 2024-09-21T01:11:25.988 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:11:26.234 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.756+0000 7f10fb11d640 1 -- 172.21.15.148:0/3807094256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10f4108d00 msgr2=0x7f10f410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.756+0000 7f10fb11d640 1 --2- 172.21.15.148:0/3807094256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10f4108d00 0x7f10f410f530 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009ca0 tx=0x7f10ec02a8e0 comp rx=0 tx=0).stop 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.756+0000 7f10fb11d640 1 -- 172.21.15.148:0/3807094256 shutdown_connections 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.756+0000 7f10fb11d640 1 --2- 172.21.15.148:0/3807094256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10f4108d00 0x7f10f410f530 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.756+0000 7f10fb11d640 1 --2- 172.21.15.148:0/3807094256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10f41083b0 0x7f10f41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.756+0000 7f10fb11d640 1 --2- 172.21.15.148:0/3807094256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10f4102ac0 0x7f10f4102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.756+0000 7f10fb11d640 1 -- 172.21.15.148:0/3807094256 >> 172.21.15.148:0/3807094256 conn(0x7f10f4079790 msgr2=0x7f10f4079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.756+0000 7f10fb11d640 1 -- 172.21.15.148:0/3807094256 shutdown_connections 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.756+0000 7f10fb11d640 1 -- 172.21.15.148:0/3807094256 wait complete. 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10fb11d640 1 Processor -- start 2024-09-21T01:11:26.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10fb11d640 1 -- start start 2024-09-21T01:11:26.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10fb11d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10f4102ac0 0x7f10f419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:26.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10fb11d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10f41083b0 0x7f10f419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:26.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10fb11d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10f4108d00 0x7f10f419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:26.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10fb11d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4112a00 con 0x7f10f4102ac0 2024-09-21T01:11:26.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10fb11d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4112880 con 0x7f10f4108d00 2024-09-21T01:11:26.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10fb11d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4112b80 con 0x7f10f41083b0 2024-09-21T01:11:26.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10f8eb9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10f4102ac0 0x7f10f419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:26.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10f8eb9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10f4102ac0 0x7f10f419a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41602/0 (socket says 172.21.15.148:41602) 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.757+0000 7f10f8eb9640 1 -- 172.21.15.148:0/2954265542 learned_addr learned my addr 172.21.15.148:0/2954265542 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f96ba640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10f4108d00 0x7f10f419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f8eb9640 1 -- 172.21.15.148:0/2954265542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10f41083b0 msgr2=0x7f10f419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f3fff640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10f41083b0 0x7f10f419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f8eb9640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10f41083b0 0x7f10f419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f8eb9640 1 -- 172.21.15.148:0/2954265542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10f4108d00 msgr2=0x7f10f419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f8eb9640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10f4108d00 0x7f10f419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f8eb9640 1 -- 172.21.15.148:0/2954265542 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f41a04f0 con 0x7f10f4102ac0 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f96ba640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10f4108d00 0x7f10f419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f8eb9640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10f4102ac0 0x7f10f419a580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f10e400d950 tx=0x7f10e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f1ffb640 1 -- 172.21.15.148:0/2954265542 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4017070 con 0x7f10f4102ac0 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10fb11d640 1 -- 172.21.15.148:0/2954265542 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f41a07e0 con 0x7f10f4102ac0 2024-09-21T01:11:26.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f1ffb640 1 -- 172.21.15.148:0/2954265542 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e4009c30 con 0x7f10f4102ac0 2024-09-21T01:11:26.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10f1ffb640 1 -- 172.21.15.148:0/2954265542 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e400f620 con 0x7f10f4102ac0 2024-09-21T01:11:26.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.758+0000 7f10fb11d640 1 -- 172.21.15.148:0/2954265542 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f41a6f40 con 0x7f10f4102ac0 2024-09-21T01:11:26.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.759+0000 7f10fb11d640 1 -- 172.21.15.148:0/2954265542 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f4102ed0 con 0x7f10f4102ac0 2024-09-21T01:11:26.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.761+0000 7f10f1ffb640 1 -- 172.21.15.148:0/2954265542 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f10e4010460 con 0x7f10f4102ac0 2024-09-21T01:11:26.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.761+0000 7f10f1ffb640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f10e00b6510 0x7f10e00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:26.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.762+0000 7f10f3fff640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f10e00b6510 0x7f10e00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:26.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.762+0000 7f10f1ffb640 1 -- 172.21.15.148:0/2954265542 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f10e40e6b90 con 0x7f10f4102ac0 2024-09-21T01:11:26.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.762+0000 7f10f3fff640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f10e00b6510 0x7f10e00b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f10f4079cb0 tx=0x7f10dc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:26.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.766+0000 7f10f1ffb640 1 -- 172.21.15.148:0/2954265542 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10e40ad8c0 con 0x7f10f4102ac0 2024-09-21T01:11:26.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.945+0000 7f10fb11d640 1 -- 172.21.15.148:0/2954265542 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10f41a72c0 con 0x7f10f4102ac0 2024-09-21T01:11:26.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.946+0000 7f10f1ffb640 1 -- 172.21.15.148:0/2954265542 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18575 (secure 0 0 0) 0x7f10e4009de0 con 0x7f10f4102ac0 2024-09-21T01:11:26.947 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:26.947 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":69,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:11:24.332800+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:11:26.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.948+0000 7f10fb11d640 1 -- 172.21.15.148:0/2954265542 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f10e00b6510 msgr2=0x7f10e00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:26.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.948+0000 7f10fb11d640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f10e00b6510 0x7f10e00b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f10f4079cb0 tx=0x7f10dc008040 comp rx=0 tx=0).stop 2024-09-21T01:11:26.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.948+0000 7f10fb11d640 1 -- 172.21.15.148:0/2954265542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10f4102ac0 msgr2=0x7f10f419a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:26.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.948+0000 7f10fb11d640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10f4102ac0 0x7f10f419a580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f10e400d950 tx=0x7f10e400de10 comp rx=0 tx=0).stop 2024-09-21T01:11:26.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.948+0000 7f10fb11d640 1 -- 172.21.15.148:0/2954265542 shutdown_connections 2024-09-21T01:11:26.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.948+0000 7f10fb11d640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f10e00b6510 0x7f10e00b8a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:26.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.948+0000 7f10fb11d640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10f4108d00 0x7f10f419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:26.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.948+0000 7f10fb11d640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10f41083b0 0x7f10f419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:26.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.948+0000 7f10fb11d640 1 --2- 172.21.15.148:0/2954265542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10f4102ac0 0x7f10f419a580 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:26.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.948+0000 7f10fb11d640 1 -- 172.21.15.148:0/2954265542 >> 172.21.15.148:0/2954265542 conn(0x7f10f4079790 msgr2=0x7f10f4101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:26.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.949+0000 7f10fb11d640 1 -- 172.21.15.148:0/2954265542 shutdown_connections 2024-09-21T01:11:26.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:26.949+0000 7f10fb11d640 1 -- 172.21.15.148:0/2954265542 wait complete. 2024-09-21T01:11:27.553 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:27 smithi148 ceph-mon[31000]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:27.553 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:27 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2954265542' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:11:27.582 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T01:07:42.541158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T01:11:27.582 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T01:11:27.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:27 smithi181 ceph-mon[34811]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:27.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:27 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2954265542' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:11:27.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:27 smithi157 ceph-mon[34140]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:27.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:27 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2954265542' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:11:27.823 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:28.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.283+0000 7f1c9d579640 1 -- 172.21.15.148:0/3770963774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c98105380 msgr2=0x7f1c9810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:28.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.283+0000 7f1c9d579640 1 --2- 172.21.15.148:0/3770963774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c98105380 0x7f1c9810d8d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009900 tx=0x7f1c8c02a410 comp rx=0 tx=0).stop 2024-09-21T01:11:28.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.283+0000 7f1c9d579640 1 -- 172.21.15.148:0/3770963774 shutdown_connections 2024-09-21T01:11:28.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.283+0000 7f1c9d579640 1 --2- 172.21.15.148:0/3770963774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c98105380 0x7f1c9810d8d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.283+0000 7f1c9d579640 1 --2- 172.21.15.148:0/3770963774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9810de60 0x7f1c98110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.283+0000 7f1c9d579640 1 --2- 172.21.15.148:0/3770963774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c98104a30 0x7f1c98104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.283+0000 7f1c9d579640 1 -- 172.21.15.148:0/3770963774 >> 172.21.15.148:0/3770963774 conn(0x7f1c98079790 msgr2=0x7f1c98079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:28.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.283+0000 7f1c9d579640 1 -- 172.21.15.148:0/3770963774 shutdown_connections 2024-09-21T01:11:28.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.283+0000 7f1c9d579640 1 -- 172.21.15.148:0/3770963774 wait complete. 2024-09-21T01:11:28.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c9d579640 1 Processor -- start 2024-09-21T01:11:28.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c9d579640 1 -- start start 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c9d579640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c98104a30 0x7f1c9819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c9d579640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c98105380 0x7f1c9819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c9d579640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9810de60 0x7f1c9819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c9d579640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98113aa0 con 0x7f1c98104a30 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c9d579640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98113920 con 0x7f1c98105380 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c9d579640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98113c20 con 0x7f1c9810de60 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c96ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c98104a30 0x7f1c9819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c96ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c98104a30 0x7f1c9819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41622/0 (socket says 172.21.15.148:41622) 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.284+0000 7f1c96ffd640 1 -- 172.21.15.148:0/3683943165 learned_addr learned my addr 172.21.15.148:0/3683943165 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c977fe640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9810de60 0x7f1c9819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c967fc640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c98105380 0x7f1c9819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c96ffd640 1 -- 172.21.15.148:0/3683943165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9810de60 msgr2=0x7f1c9819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c96ffd640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9810de60 0x7f1c9819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c96ffd640 1 -- 172.21.15.148:0/3683943165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c98105380 msgr2=0x7f1c9819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:28.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c96ffd640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c98105380 0x7f1c9819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c96ffd640 1 -- 172.21.15.148:0/3683943165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c981a0420 con 0x7f1c98104a30 2024-09-21T01:11:28.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c967fc640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c98105380 0x7f1c9819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:11:28.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c96ffd640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c98104a30 0x7f1c9819a4b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800e9f0 tx=0x7f1c8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:28.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c7ffff640 1 -- 172.21.15.148:0/3683943165 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8800cd80 con 0x7f1c98104a30 2024-09-21T01:11:28.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c7ffff640 1 -- 172.21.15.148:0/3683943165 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c880108e0 con 0x7f1c98104a30 2024-09-21T01:11:28.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c9d579640 1 -- 172.21.15.148:0/3683943165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c981a0710 con 0x7f1c98104a30 2024-09-21T01:11:28.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c7ffff640 1 -- 172.21.15.148:0/3683943165 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c88018980 con 0x7f1c98104a30 2024-09-21T01:11:28.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.285+0000 7f1c9d579640 1 -- 172.21.15.148:0/3683943165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c981a6e70 con 0x7f1c98104a30 2024-09-21T01:11:28.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.286+0000 7f1c9d579640 1 -- 172.21.15.148:0/3683943165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c98104e40 con 0x7f1c98104a30 2024-09-21T01:11:28.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.289+0000 7f1c7ffff640 1 -- 172.21.15.148:0/3683943165 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f1c88010430 con 0x7f1c98104a30 2024-09-21T01:11:28.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.289+0000 7f1c7ffff640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1c800b6510 0x7f1c800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:28.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.289+0000 7f1c967fc640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1c800b6510 0x7f1c800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:28.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.289+0000 7f1c7ffff640 1 -- 172.21.15.148:0/3683943165 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f1c880e76d0 con 0x7f1c98104a30 2024-09-21T01:11:28.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.290+0000 7f1c967fc640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1c800b6510 0x7f1c800b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009230 tx=0x7f1c8c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:28.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.293+0000 7f1c7ffff640 1 -- 172.21.15.148:0/3683943165 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c880ae400 con 0x7f1c98104a30 2024-09-21T01:11:28.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.471+0000 7f1c9d579640 1 -- 172.21.15.148:0/3683943165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c9802e640 con 0x7f1c98104a30 2024-09-21T01:11:28.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.471+0000 7f1c7ffff640 1 -- 172.21.15.148:0/3683943165 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7f1c880b27e0 con 0x7f1c98104a30 2024-09-21T01:11:28.472 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-09-21T01:11:28.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.473+0000 7f1c9d579640 1 -- 172.21.15.148:0/3683943165 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1c800b6510 msgr2=0x7f1c800b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:28.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.473+0000 7f1c9d579640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1c800b6510 0x7f1c800b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009230 tx=0x7f1c8c000bc0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.473+0000 7f1c9d579640 1 -- 172.21.15.148:0/3683943165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c98104a30 msgr2=0x7f1c9819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:28.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.473+0000 7f1c9d579640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c98104a30 0x7f1c9819a4b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800e9f0 tx=0x7f1c8800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.473+0000 7f1c9d579640 1 -- 172.21.15.148:0/3683943165 shutdown_connections 2024-09-21T01:11:28.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.473+0000 7f1c9d579640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1c800b6510 0x7f1c800b8a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.473+0000 7f1c9d579640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c9810de60 0x7f1c9819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.473+0000 7f1c9d579640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c98105380 0x7f1c9819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.473+0000 7f1c9d579640 1 --2- 172.21.15.148:0/3683943165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c98104a30 0x7f1c9819a4b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:28.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.473+0000 7f1c9d579640 1 -- 172.21.15.148:0/3683943165 >> 172.21.15.148:0/3683943165 conn(0x7f1c98079790 msgr2=0x7f1c980ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:28.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.474+0000 7f1c9d579640 1 -- 172.21.15.148:0/3683943165 shutdown_connections 2024-09-21T01:11:28.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:28.474+0000 7f1c9d579640 1 -- 172.21.15.148:0/3683943165 wait complete. 2024-09-21T01:11:29.048 INFO:tasks.cephadm:Adding mds.a on smithi148 2024-09-21T01:11:29.048 INFO:tasks.cephadm:Adding mds.d on smithi148 2024-09-21T01:11:29.048 INFO:tasks.cephadm:Adding mds.g on smithi148 2024-09-21T01:11:29.048 INFO:tasks.cephadm:Adding mds.j on smithi148 2024-09-21T01:11:29.048 INFO:tasks.cephadm:Adding mds.b on smithi157 2024-09-21T01:11:29.048 INFO:tasks.cephadm:Adding mds.e on smithi157 2024-09-21T01:11:29.048 INFO:tasks.cephadm:Adding mds.h on smithi157 2024-09-21T01:11:29.049 INFO:tasks.cephadm:Adding mds.k on smithi157 2024-09-21T01:11:29.049 INFO:tasks.cephadm:Adding mds.c on smithi181 2024-09-21T01:11:29.049 INFO:tasks.cephadm:Adding mds.f on smithi181 2024-09-21T01:11:29.049 INFO:tasks.cephadm:Adding mds.i on smithi181 2024-09-21T01:11:29.049 INFO:tasks.cephadm:Adding mds.l on smithi181 2024-09-21T01:11:29.049 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l' 2024-09-21T01:11:29.309 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:11:29.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:29 smithi148 ceph-mon[31000]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:29.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:29 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3683943165' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:11:29.666 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:29 smithi181 ceph-mon[34811]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:29.666 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:29 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3683943165' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:11:29.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:29 smithi157 ceph-mon[34140]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:29.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:29 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3683943165' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:11:29.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.761+0000 7f6cdd545640 1 -- 172.21.15.181:0/1603459010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd8102640 msgr2=0x7f6cd8102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:29.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.761+0000 7f6cdd545640 1 --2- 172.21.15.181:0/1603459010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd8102640 0x7f6cd8102ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009900 tx=0x7f6cc802a480 comp rx=0 tx=0).stop 2024-09-21T01:11:29.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.761+0000 7f6cdd545640 1 -- 172.21.15.181:0/1603459010 shutdown_connections 2024-09-21T01:11:29.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.761+0000 7f6cdd545640 1 --2- 172.21.15.181:0/1603459010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd81036d0 0x7f6cd8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:29.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.761+0000 7f6cdd545640 1 --2- 172.21.15.181:0/1603459010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd8104070 0x7f6cd810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:29.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.761+0000 7f6cdd545640 1 --2- 172.21.15.181:0/1603459010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd8102640 0x7f6cd8102ab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:29.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.761+0000 7f6cdd545640 1 -- 172.21.15.181:0/1603459010 >> 172.21.15.181:0/1603459010 conn(0x7f6cd80fdfb0 msgr2=0x7f6cd8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:29.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.761+0000 7f6cdd545640 1 -- 172.21.15.181:0/1603459010 shutdown_connections 2024-09-21T01:11:29.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.761+0000 7f6cdd545640 1 -- 172.21.15.181:0/1603459010 wait complete. 2024-09-21T01:11:29.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cdd545640 1 Processor -- start 2024-09-21T01:11:29.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cdd545640 1 -- start start 2024-09-21T01:11:29.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cdd545640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd8102640 0x7f6cd8106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cdd545640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd81036d0 0x7f6cd8104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cdd545640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd8104070 0x7f6cd8105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cdd545640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd810e280 con 0x7f6cd8104070 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cdd545640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd810e100 con 0x7f6cd81036d0 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cdd545640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd810e400 con 0x7f6cd8102640 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cd6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd8102640 0x7f6cd8106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cd6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd8102640 0x7f6cd8106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:43486/0 (socket says 172.21.15.181:43486) 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.762+0000 7f6cd6ffd640 1 -- 172.21.15.181:0/2598211042 learned_addr learned my addr 172.21.15.181:0/2598211042 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6cd67fc640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd81036d0 0x7f6cd8104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6cd77fe640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd8104070 0x7f6cd8105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6cd6ffd640 1 -- 172.21.15.181:0/2598211042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd81036d0 msgr2=0x7f6cd8104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6cd6ffd640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd81036d0 0x7f6cd8104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:29.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6cd6ffd640 1 -- 172.21.15.181:0/2598211042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd8104070 msgr2=0x7f6cd8105040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:29.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6cd6ffd640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd8104070 0x7f6cd8105040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:29.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6cd6ffd640 1 -- 172.21.15.181:0/2598211042 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd8105740 con 0x7f6cd8102640 2024-09-21T01:11:29.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6cd6ffd640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd8102640 0x7f6cd8106230 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8006010 tx=0x7f6cc8004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:29.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6ccffff640 1 -- 172.21.15.181:0/2598211042 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc803f030 con 0x7f6cd8102640 2024-09-21T01:11:29.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6cdd545640 1 -- 172.21.15.181:0/2598211042 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd81a4060 con 0x7f6cd8102640 2024-09-21T01:11:29.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6ccffff640 1 -- 172.21.15.181:0/2598211042 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cc8003cb0 con 0x7f6cd8102640 2024-09-21T01:11:29.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6ccffff640 1 -- 172.21.15.181:0/2598211042 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8035070 con 0x7f6cd8102640 2024-09-21T01:11:29.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.763+0000 7f6cdd545640 1 -- 172.21.15.181:0/2598211042 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd81a4400 con 0x7f6cd8102640 2024-09-21T01:11:29.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.764+0000 7f6cdd545640 1 -- 172.21.15.181:0/2598211042 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd81a4720 con 0x7f6cd8102640 2024-09-21T01:11:29.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.767+0000 7f6ccffff640 1 -- 172.21.15.181:0/2598211042 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f6cc8042030 con 0x7f6cd8102640 2024-09-21T01:11:29.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.768+0000 7f6ccffff640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cc40b6510 0x7f6cc40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:29.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.768+0000 7f6ccffff640 1 -- 172.21.15.181:0/2598211042 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f6cc8107bc0 con 0x7f6cd8102640 2024-09-21T01:11:29.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.768+0000 7f6cd67fc640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cc40b6510 0x7f6cc40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:29.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.769+0000 7f6cd67fc640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cc40b6510 0x7f6cc40b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00058c0 tx=0x7f6cc000a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.771+0000 7f6ccffff640 1 -- 172.21.15.181:0/2598211042 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6cc80ce8f0 con 0x7f6cd8102640 2024-09-21T01:11:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.967+0000 7f6cdd545640 1 -- 172.21.15.181:0/2598211042 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}) -- 0x7f6cd8100080 con 0x7f6cc40b6510 2024-09-21T01:11:29.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.976+0000 7f6ccffff640 1 -- 172.21.15.181:0/2598211042 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f6cd8100080 con 0x7f6cc40b6510 2024-09-21T01:11:29.977 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mds.all update... 2024-09-21T01:11:29.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.979+0000 7f6cdd545640 1 -- 172.21.15.181:0/2598211042 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cc40b6510 msgr2=0x7f6cc40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.979+0000 7f6cdd545640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cc40b6510 0x7f6cc40b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00058c0 tx=0x7f6cc000a250 comp rx=0 tx=0).stop 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.979+0000 7f6cdd545640 1 -- 172.21.15.181:0/2598211042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd8102640 msgr2=0x7f6cd8106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.979+0000 7f6cdd545640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd8102640 0x7f6cd8106230 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8006010 tx=0x7f6cc8004340 comp rx=0 tx=0).stop 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.979+0000 7f6cdd545640 1 -- 172.21.15.181:0/2598211042 shutdown_connections 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.979+0000 7f6cdd545640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cc40b6510 0x7f6cc40b8a20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.979+0000 7f6cdd545640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cd8104070 0x7f6cd8105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.979+0000 7f6cdd545640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd81036d0 0x7f6cd8104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.979+0000 7f6cdd545640 1 --2- 172.21.15.181:0/2598211042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cd8102640 0x7f6cd8106230 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.979+0000 7f6cdd545640 1 -- 172.21.15.181:0/2598211042 >> 172.21.15.181:0/2598211042 conn(0x7f6cd80fdfb0 msgr2=0x7f6cd80ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.980+0000 7f6cdd545640 1 -- 172.21.15.181:0/2598211042 shutdown_connections 2024-09-21T01:11:29.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T01:11:29.980+0000 7f6cdd545640 1 -- 172.21.15.181:0/2598211042 wait complete. 2024-09-21T01:11:30.668 DEBUG:teuthology.orchestra.run.smithi148:mds.a> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T01:11:30.671 DEBUG:teuthology.orchestra.run.smithi148:mds.d> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T01:11:30.714 DEBUG:teuthology.orchestra.run.smithi148:mds.g> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T01:11:30.757 DEBUG:teuthology.orchestra.run.smithi148:mds.j> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T01:11:30.800 DEBUG:teuthology.orchestra.run.smithi157:mds.b> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T01:11:30.803 DEBUG:teuthology.orchestra.run.smithi157:mds.e> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T01:11:30.845 DEBUG:teuthology.orchestra.run.smithi157:mds.h> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T01:11:30.888 DEBUG:teuthology.orchestra.run.smithi157:mds.k> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T01:11:30.931 DEBUG:teuthology.orchestra.run.smithi181:mds.c> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T01:11:30.933 DEBUG:teuthology.orchestra.run.smithi181:mds.f> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T01:11:30.976 DEBUG:teuthology.orchestra.run.smithi181:mds.i> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T01:11:31.019 DEBUG:teuthology.orchestra.run.smithi181:mds.l> sudo journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T01:11:31.062 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T01:11:31.063 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:11:31.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:30 smithi181 ceph-mon[34811]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:31.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:30 smithi181 ceph-mon[34811]: Saving service mds.all spec with placement smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T01:11:31.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:30 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:31.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:30 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:31.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:30 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:31.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:30 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:31.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:30 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:31.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:30 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:31.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:30 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:31.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:30 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:31.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:30 smithi157 ceph-mon[34140]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:31.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:30 smithi157 ceph-mon[34140]: Saving service mds.all spec with placement smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T01:11:31.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:30 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:31.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:30 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:31.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:30 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:31.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:30 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:31.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:30 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:31.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:30 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:31.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:30 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:31.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:30 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:30 smithi148 ceph-mon[31000]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:30 smithi148 ceph-mon[31000]: Saving service mds.all spec with placement smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T01:11:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:30 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:30 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:30 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:31.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:30 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:31.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:30 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:31.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:30 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:31.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:30 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:31.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:30 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:31.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.785+0000 7f3a731af640 1 -- 172.21.15.148:0/1878997038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6c1083b0 msgr2=0x7f3a6c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.785+0000 7f3a731af640 1 --2- 172.21.15.148:0/1878997038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c1087c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009900 tx=0x7f3a5402a410 comp rx=0 tx=0).stop 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.785+0000 7f3a731af640 1 -- 172.21.15.148:0/1878997038 shutdown_connections 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.785+0000 7f3a731af640 1 --2- 172.21.15.148:0/1878997038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c1087c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.785+0000 7f3a731af640 1 --2- 172.21.15.148:0/1878997038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a6c108d00 0x7f3a6c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.785+0000 7f3a731af640 1 --2- 172.21.15.148:0/1878997038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a6c102a70 0x7f3a6c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.785+0000 7f3a731af640 1 -- 172.21.15.148:0/1878997038 >> 172.21.15.148:0/1878997038 conn(0x7f3a6c079710 msgr2=0x7f3a6c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.785+0000 7f3a731af640 1 -- 172.21.15.148:0/1878997038 shutdown_connections 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.785+0000 7f3a731af640 1 -- 172.21.15.148:0/1878997038 wait complete. 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a731af640 1 Processor -- start 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a731af640 1 -- start start 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a731af640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6c102a70 0x7f3a6c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a731af640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a731af640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a6c108d00 0x7f3a6c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a731af640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1129c0 con 0x7f3a6c102a70 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a731af640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112840 con 0x7f3a6c108d00 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a731af640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112b40 con 0x7f3a6c1083b0 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a70f4b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6c102a70 0x7f3a6c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a70f4b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6c102a70 0x7f3a6c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41628/0 (socket says 172.21.15.148:41628) 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.786+0000 7f3a70f4b640 1 -- 172.21.15.148:0/1851649688 learned_addr learned my addr 172.21.15.148:0/1851649688 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a6bfff640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a7174c640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a6c108d00 0x7f3a6c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a70f4b640 1 -- 172.21.15.148:0/1851649688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a6c1083b0 msgr2=0x7f3a6c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a70f4b640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a70f4b640 1 -- 172.21.15.148:0/1851649688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a6c108d00 msgr2=0x7f3a6c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a70f4b640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a6c108d00 0x7f3a6c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a70f4b640 1 -- 172.21.15.148:0/1851649688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c1a03f0 con 0x7f3a6c102a70 2024-09-21T01:11:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a70f4b640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6c102a70 0x7f3a6c19a480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c890 tx=0x7f3a5c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:31.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a69ffb640 1 -- 172.21.15.148:0/1851649688 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c004220 con 0x7f3a6c102a70 2024-09-21T01:11:31.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a69ffb640 1 -- 172.21.15.148:0/1851649688 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a5c0043c0 con 0x7f3a6c102a70 2024-09-21T01:11:31.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a69ffb640 1 -- 172.21.15.148:0/1851649688 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c004a00 con 0x7f3a6c102a70 2024-09-21T01:11:31.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.787+0000 7f3a731af640 1 -- 172.21.15.148:0/1851649688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6c1a06e0 con 0x7f3a6c102a70 2024-09-21T01:11:31.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.788+0000 7f3a731af640 1 -- 172.21.15.148:0/1851649688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6c1a6e40 con 0x7f3a6c102a70 2024-09-21T01:11:31.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.789+0000 7f3a731af640 1 -- 172.21.15.148:0/1851649688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6c103cf0 con 0x7f3a6c102a70 2024-09-21T01:11:31.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.790+0000 7f3a69ffb640 1 -- 172.21.15.148:0/1851649688 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f3a5c0079b0 con 0x7f3a6c102a70 2024-09-21T01:11:31.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.791+0000 7f3a69ffb640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a580b6510 0x7f3a580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:31.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.791+0000 7f3a6bfff640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a580b6510 0x7f3a580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:31.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.791+0000 7f3a69ffb640 1 -- 172.21.15.148:0/1851649688 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f3a5c0e6b40 con 0x7f3a6c102a70 2024-09-21T01:11:31.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.791+0000 7f3a6bfff640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a580b6510 0x7f3a580b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009230 tx=0x7f3a54031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:31.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:31.795+0000 7f3a69ffb640 1 -- 172.21.15.148:0/1851649688 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a5c014030 con 0x7f3a6c102a70 2024-09-21T01:11:32.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.013+0000 7f3a731af640 1 -- 172.21.15.148:0/1851649688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a6c102e80 con 0x7f3a6c102a70 2024-09-21T01:11:32.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.013+0000 7f3a69ffb640 1 -- 172.21.15.148:0/1851649688 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f3a5c0b1c50 con 0x7f3a6c102a70 2024-09-21T01:11:32.014 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:32.014 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"btime":"2024-09-21T01:04:06:062011+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T01:11:32.014 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 1 2024-09-21T01:11:32.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.015+0000 7f3a731af640 1 -- 172.21.15.148:0/1851649688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a580b6510 msgr2=0x7f3a580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:32.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.015+0000 7f3a731af640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a580b6510 0x7f3a580b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009230 tx=0x7f3a54031400 comp rx=0 tx=0).stop 2024-09-21T01:11:32.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.015+0000 7f3a731af640 1 -- 172.21.15.148:0/1851649688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6c102a70 msgr2=0x7f3a6c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:32.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.015+0000 7f3a731af640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6c102a70 0x7f3a6c19a480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c890 tx=0x7f3a5c00cd50 comp rx=0 tx=0).stop 2024-09-21T01:11:32.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.015+0000 7f3a731af640 1 -- 172.21.15.148:0/1851649688 shutdown_connections 2024-09-21T01:11:32.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.015+0000 7f3a731af640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a580b6510 0x7f3a580b8a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:32.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.015+0000 7f3a731af640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a6c108d00 0x7f3a6c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:32.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.015+0000 7f3a731af640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:32.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.015+0000 7f3a731af640 1 --2- 172.21.15.148:0/1851649688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a6c102a70 0x7f3a6c19a480 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:32.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.016+0000 7f3a731af640 1 -- 172.21.15.148:0/1851649688 >> 172.21.15.148:0/1851649688 conn(0x7f3a6c079710 msgr2=0x7f3a6c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:32.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.016+0000 7f3a731af640 1 -- 172.21.15.148:0/1851649688 shutdown_connections 2024-09-21T01:11:32.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:32.016+0000 7f3a731af640 1 -- 172.21.15.148:0/1851649688 wait complete. 2024-09-21T01:11:32.077 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:31 smithi181 ceph-mon[34811]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:32.077 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:31 smithi181 ceph-mon[34811]: Deploying daemon mds.l on smithi181 2024-09-21T01:11:32.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:31 smithi157 ceph-mon[34140]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:32.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:31 smithi157 ceph-mon[34140]: Deploying daemon mds.l on smithi181 2024-09-21T01:11:32.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:31 smithi148 ceph-mon[31000]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:32.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:31 smithi148 ceph-mon[31000]: Deploying daemon mds.l on smithi181 2024-09-21T01:11:32.473 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:11:32 smithi181 systemd[1]: Starting Ceph mds.l for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:11:32.730 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:11:32 smithi181 podman[63113]: 2024-09-21 01:11:32.375329517 +0000 UTC m=+0.015464453 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:32.730 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:11:32 smithi181 podman[63113]: 2024-09-21 01:11:32.486820448 +0000 UTC m=+0.126955379 container create cdaf53a052f0601d5ff7bce0e5781bf02686f28b17c4aeac37d0099f8906af01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-l, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T01:11:32.730 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:11:32 smithi181 podman[63113]: 2024-09-21 01:11:32.681205788 +0000 UTC m=+0.321340722 container init cdaf53a052f0601d5ff7bce0e5781bf02686f28b17c4aeac37d0099f8906af01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-l, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T01:11:32.730 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:11:32 smithi181 podman[63113]: 2024-09-21 01:11:32.684234824 +0000 UTC m=+0.324369757 container start cdaf53a052f0601d5ff7bce0e5781bf02686f28b17c4aeac37d0099f8906af01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T01:11:32.730 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mds[63132]: -- 172.21.15.181:0/141933259 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ba69ca1c20 con 0x55ba6de49180 2024-09-21T01:11:32.730 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-l[63128]: starting mds.l at 2024-09-21T01:11:33.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1851649688' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:33.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.181:6832/791050985,v1:172.21.15.181:6833/791050985] up:boot 2024-09-21T01:11:33.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mon[34811]: fsmap 1 up:standby 2024-09-21T01:11:33.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:11:33.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:33.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:33.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:33.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:33.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:33.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:32 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:33.231 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:11:32 smithi181 bash[63113]: cdaf53a052f0601d5ff7bce0e5781bf02686f28b17c4aeac37d0099f8906af01 2024-09-21T01:11:33.231 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:11:32 smithi181 systemd[1]: Started Ceph mds.l for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:11:33.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:32 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1851649688' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:33.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:32 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.181:6832/791050985,v1:172.21.15.181:6833/791050985] up:boot 2024-09-21T01:11:33.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:32 smithi157 ceph-mon[34140]: fsmap 1 up:standby 2024-09-21T01:11:33.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:32 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:11:33.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:32 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:33.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:32 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:33.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:32 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:33.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:32 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:33.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:32 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:33.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:32 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:33.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:32 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1851649688' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:33.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:32 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.181:6832/791050985,v1:172.21.15.181:6833/791050985] up:boot 2024-09-21T01:11:33.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:32 smithi148 ceph-mon[31000]: fsmap 1 up:standby 2024-09-21T01:11:33.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:32 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:11:33.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:32 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:33.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:32 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:33.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:32 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:33.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:32 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:33.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:32 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:33.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:32 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:34.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:33 smithi157 ceph-mon[34140]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:34.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:33 smithi157 ceph-mon[34140]: Deploying daemon mds.k on smithi157 2024-09-21T01:11:34.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:33 smithi148 ceph-mon[31000]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:34.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:33 smithi148 ceph-mon[31000]: Deploying daemon mds.k on smithi157 2024-09-21T01:11:34.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:33 smithi181 ceph-mon[34811]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:34.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:33 smithi181 ceph-mon[34811]: Deploying daemon mds.k on smithi157 2024-09-21T01:11:34.714 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:11:34.970 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:34.991 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:11:34 smithi157 podman[61725]: 2024-09-21 01:11:34.911425786 +0000 UTC m=+0.129291128 container create 78d7bf1036324fe05f0c89bc72bae40aa5854a155542a8c6eca9a5348252a3ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-k, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:11:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.480+0000 7f756a8d8640 1 -- 172.21.15.148:0/3340944235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75641031e0 msgr2=0x7f75641035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.480+0000 7f756a8d8640 1 --2- 172.21.15.148:0/3340944235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75641031e0 0x7f75641035f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7554009900 tx=0x7f755402a410 comp rx=0 tx=0).stop 2024-09-21T01:11:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.480+0000 7f756a8d8640 1 -- 172.21.15.148:0/3340944235 shutdown_connections 2024-09-21T01:11:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.480+0000 7f756a8d8640 1 --2- 172.21.15.148:0/3340944235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7564105b00 0x7f756410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.480+0000 7f756a8d8640 1 --2- 172.21.15.148:0/3340944235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75641051b0 0x7f75641055c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:35.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.480+0000 7f756a8d8640 1 --2- 172.21.15.148:0/3340944235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75641031e0 0x7f75641035f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:35.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.480+0000 7f756a8d8640 1 -- 172.21.15.148:0/3340944235 >> 172.21.15.148:0/3340944235 conn(0x7f7564077cc0 msgr2=0x7f7564078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:35.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.480+0000 7f756a8d8640 1 -- 172.21.15.148:0/3340944235 shutdown_connections 2024-09-21T01:11:35.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.480+0000 7f756a8d8640 1 -- 172.21.15.148:0/3340944235 wait complete. 2024-09-21T01:11:35.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.480+0000 7f756a8d8640 1 Processor -- start 2024-09-21T01:11:35.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f756a8d8640 1 -- start start 2024-09-21T01:11:35.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f756a8d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75641031e0 0x7f756419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:35.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f756a8d8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75641051b0 0x7f756419b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:35.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f756a8d8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7564105b00 0x7f756419be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:35.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f756a8d8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f75641129f0 con 0x7f7564105b00 2024-09-21T01:11:35.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f756a8d8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7564112870 con 0x7f75641051b0 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f756a8d8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7564112b70 con 0x7f75641031e0 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f7568e75640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7564105b00 0x7f756419be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f7568e75640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7564105b00 0x7f756419be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41648/0 (socket says 172.21.15.148:41648) 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f7568e75640 1 -- 172.21.15.148:0/1693793316 learned_addr learned my addr 172.21.15.148:0/1693793316 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f75637fe640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75641051b0 0x7f756419b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.481+0000 7f7563fff640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75641031e0 0x7f756419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f7568e75640 1 -- 172.21.15.148:0/1693793316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75641031e0 msgr2=0x7f756419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f7568e75640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75641031e0 0x7f756419b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f7568e75640 1 -- 172.21.15.148:0/1693793316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75641051b0 msgr2=0x7f756419b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f7568e75640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75641051b0 0x7f756419b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:35.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f7568e75640 1 -- 172.21.15.148:0/1693793316 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75641a6690 con 0x7f7564105b00 2024-09-21T01:11:35.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f7568e75640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7564105b00 0x7f756419be00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f755c00eb10 tx=0x7f755c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:35.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f75617fa640 1 -- 172.21.15.148:0/1693793316 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c004b20 con 0x7f7564105b00 2024-09-21T01:11:35.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f75617fa640 1 -- 172.21.15.148:0/1693793316 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f755c004cc0 con 0x7f7564105b00 2024-09-21T01:11:35.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f756a8d8640 1 -- 172.21.15.148:0/1693793316 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75641a6980 con 0x7f7564105b00 2024-09-21T01:11:35.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f75617fa640 1 -- 172.21.15.148:0/1693793316 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c010670 con 0x7f7564105b00 2024-09-21T01:11:35.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.482+0000 7f756a8d8640 1 -- 172.21.15.148:0/1693793316 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75641a6e70 con 0x7f7564105b00 2024-09-21T01:11:35.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.483+0000 7f756a8d8640 1 -- 172.21.15.148:0/1693793316 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75641035f0 con 0x7f7564105b00 2024-09-21T01:11:35.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.485+0000 7f75617fa640 1 -- 172.21.15.148:0/1693793316 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f755c005000 con 0x7f7564105b00 2024-09-21T01:11:35.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.485+0000 7f75617fa640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f75500b6510 0x7f75500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:35.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.486+0000 7f7563fff640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f75500b6510 0x7f75500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:35.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.486+0000 7f75617fa640 1 -- 172.21.15.148:0/1693793316 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f755c0e7760 con 0x7f7564105b00 2024-09-21T01:11:35.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.486+0000 7f7563fff640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f75500b6510 0x7f75500b8a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7554009230 tx=0x7f7554009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:35.490 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:11:35 smithi157 podman[61725]: 2024-09-21 01:11:35.172436639 +0000 UTC m=+0.390301937 container init 78d7bf1036324fe05f0c89bc72bae40aa5854a155542a8c6eca9a5348252a3ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:11:35.490 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:11:35 smithi157 podman[61725]: 2024-09-21 01:11:35.175230265 +0000 UTC m=+0.393095565 container start 78d7bf1036324fe05f0c89bc72bae40aa5854a155542a8c6eca9a5348252a3ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T01:11:35.491 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:11:35 smithi157 ceph-mds[61743]: -- 172.21.15.157:0/2828819277 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5624b6891860 con 0x5624baa39600 2024-09-21T01:11:35.491 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:11:35 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-k[61739]: starting mds.k at 2024-09-21T01:11:35.491 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:11:35 smithi157 bash[61725]: 78d7bf1036324fe05f0c89bc72bae40aa5854a155542a8c6eca9a5348252a3ef 2024-09-21T01:11:35.491 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:11:35 smithi157 systemd[1]: Started Ceph mds.k for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:11:35.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.493+0000 7f75617fa640 1 -- 172.21.15.148:0/1693793316 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f755c0ae520 con 0x7f7564105b00 2024-09-21T01:11:35.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.727+0000 7f756a8d8640 1 -- 172.21.15.148:0/1693793316 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75641022b0 con 0x7f7564105b00 2024-09-21T01:11:35.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.728+0000 7f75617fa640 1 -- 172.21.15.148:0/1693793316 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f75641022b0 con 0x7f7564105b00 2024-09-21T01:11:35.729 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:35.729 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":2,"btime":"2024-09-21T01:11:32:723133+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T01:11:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 2 2024-09-21T01:11:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.730+0000 7f756a8d8640 1 -- 172.21.15.148:0/1693793316 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f75500b6510 msgr2=0x7f75500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.730+0000 7f756a8d8640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f75500b6510 0x7f75500b8a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7554009230 tx=0x7f7554009680 comp rx=0 tx=0).stop 2024-09-21T01:11:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.730+0000 7f756a8d8640 1 -- 172.21.15.148:0/1693793316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7564105b00 msgr2=0x7f756419be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.730+0000 7f756a8d8640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7564105b00 0x7f756419be00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f755c00eb10 tx=0x7f755c00c2d0 comp rx=0 tx=0).stop 2024-09-21T01:11:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.730+0000 7f756a8d8640 1 -- 172.21.15.148:0/1693793316 shutdown_connections 2024-09-21T01:11:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.730+0000 7f756a8d8640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f75500b6510 0x7f75500b8a20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.730+0000 7f756a8d8640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7564105b00 0x7f756419be00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.730+0000 7f756a8d8640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75641051b0 0x7f756419b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.730+0000 7f756a8d8640 1 --2- 172.21.15.148:0/1693793316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75641031e0 0x7f756419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.730+0000 7f756a8d8640 1 -- 172.21.15.148:0/1693793316 >> 172.21.15.148:0/1693793316 conn(0x7f7564077cc0 msgr2=0x7f75641064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.731+0000 7f756a8d8640 1 -- 172.21.15.148:0/1693793316 shutdown_connections 2024-09-21T01:11:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:35.731+0000 7f756a8d8640 1 -- 172.21.15.148:0/1693793316 wait complete. 2024-09-21T01:11:36.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:35 smithi148 ceph-mon[31000]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:36.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:36.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:36.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:36.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:36.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:36.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:35 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:36.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:35 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1693793316' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:36.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:35 smithi181 ceph-mon[34811]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:36.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:36.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:36.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:36.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:36.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:36.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:35 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:36.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:35 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1693793316' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:36.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:35 smithi157 ceph-mon[34140]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:36.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:36.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:36.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:36.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:36.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:36.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:35 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:36.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:35 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1693793316' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:37.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:36 smithi157 ceph-mon[34140]: Deploying daemon mds.j on smithi148 2024-09-21T01:11:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:36 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.157:6832/1970203304,v1:172.21.15.157:6833/1970203304] up:boot 2024-09-21T01:11:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:36 smithi157 ceph-mon[34140]: fsmap 2 up:standby 2024-09-21T01:11:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:36 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:11:37.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:36 smithi157 ceph-mon[34140]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:37.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:36 smithi148 ceph-mon[31000]: Deploying daemon mds.j on smithi148 2024-09-21T01:11:37.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:36 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.157:6832/1970203304,v1:172.21.15.157:6833/1970203304] up:boot 2024-09-21T01:11:37.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:36 smithi148 ceph-mon[31000]: fsmap 2 up:standby 2024-09-21T01:11:37.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:36 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:11:37.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:36 smithi148 ceph-mon[31000]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:37.381 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:36 smithi181 ceph-mon[34811]: Deploying daemon mds.j on smithi148 2024-09-21T01:11:37.381 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:36 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.157:6832/1970203304,v1:172.21.15.157:6833/1970203304] up:boot 2024-09-21T01:11:37.381 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:36 smithi181 ceph-mon[34811]: fsmap 2 up:standby 2024-09-21T01:11:37.381 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:36 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:11:37.382 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:36 smithi181 ceph-mon[34811]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:38.113 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:11:37 smithi148 systemd[1]: Starting Ceph mds.j for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:11:38.404 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:38 smithi148 ceph-mon[31000]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:38.405 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:11:38 smithi148 podman[71011]: 2024-09-21 01:11:38.035016622 +0000 UTC m=+0.016161839 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:38.405 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:11:38 smithi148 podman[71011]: 2024-09-21 01:11:38.177080735 +0000 UTC m=+0.158225981 container create 57470ec5d4781c770ed1a051f149dcc10fed7ff79c5e099672d33e9ee729c56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:11:38.405 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:11:38 smithi148 podman[71011]: 2024-09-21 01:11:38.404752032 +0000 UTC m=+0.385897246 container init 57470ec5d4781c770ed1a051f149dcc10fed7ff79c5e099672d33e9ee729c56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T01:11:38.592 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:11:38.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:38 smithi181 ceph-mon[34811]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:38.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:38 smithi157 ceph-mon[34140]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:38.856 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:38.863 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:11:38 smithi148 podman[71011]: 2024-09-21 01:11:38.407850435 +0000 UTC m=+0.388995645 container start 57470ec5d4781c770ed1a051f149dcc10fed7ff79c5e099672d33e9ee729c56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:11:38.863 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:11:38 smithi148 ceph-mds[71030]: -- 172.21.15.148:0/176962940 <== mon.0 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b9e43e3860 con 0x55b9e858b600 2024-09-21T01:11:38.863 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:11:38 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-j[71026]: starting mds.j at 2024-09-21T01:11:38.864 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:11:38 smithi148 bash[71011]: 57470ec5d4781c770ed1a051f149dcc10fed7ff79c5e099672d33e9ee729c56b 2024-09-21T01:11:38.864 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:11:38 smithi148 systemd[1]: Started Ceph mds.j for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:11:39.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:39.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:39.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:39.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:39.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:39.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:39.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:39 smithi148 ceph-mon[31000]: Deploying daemon mds.d on smithi148 2024-09-21T01:11:39.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:39 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.148:6834/4022731495,v1:172.21.15.148:6835/4022731495] up:boot 2024-09-21T01:11:39.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:39 smithi148 ceph-mon[31000]: fsmap 3 up:standby 2024-09-21T01:11:39.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T01:11:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:39 smithi181 ceph-mon[34811]: Deploying daemon mds.d on smithi148 2024-09-21T01:11:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:39 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.148:6834/4022731495,v1:172.21.15.148:6835/4022731495] up:boot 2024-09-21T01:11:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:39 smithi181 ceph-mon[34811]: fsmap 3 up:standby 2024-09-21T01:11:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T01:11:39.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:39.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:39.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:39.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:39.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:39.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:39.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:39 smithi157 ceph-mon[34140]: Deploying daemon mds.d on smithi148 2024-09-21T01:11:39.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:39 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.148:6834/4022731495,v1:172.21.15.148:6835/4022731495] up:boot 2024-09-21T01:11:39.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:39 smithi157 ceph-mon[34140]: fsmap 3 up:standby 2024-09-21T01:11:39.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T01:11:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.493+0000 7f990942c640 1 -- 172.21.15.148:0/818257754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904101fc0 msgr2=0x7f99041023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.493+0000 7f990942c640 1 --2- 172.21.15.148:0/818257754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904101fc0 0x7f99041023d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009900 tx=0x7f98f402a410 comp rx=0 tx=0).stop 2024-09-21T01:11:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.493+0000 7f990942c640 1 -- 172.21.15.148:0/818257754 shutdown_connections 2024-09-21T01:11:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.493+0000 7f990942c640 1 --2- 172.21.15.148:0/818257754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9904109e50 0x7f9904110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.493+0000 7f990942c640 1 --2- 172.21.15.148:0/818257754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9904109500 0x7f9904109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.493+0000 7f990942c640 1 --2- 172.21.15.148:0/818257754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904101fc0 0x7f99041023d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.493+0000 7f990942c640 1 -- 172.21.15.148:0/818257754 >> 172.21.15.148:0/818257754 conn(0x7f9904079f90 msgr2=0x7f990407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:40.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.493+0000 7f990942c640 1 -- 172.21.15.148:0/818257754 shutdown_connections 2024-09-21T01:11:40.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.493+0000 7f990942c640 1 -- 172.21.15.148:0/818257754 wait complete. 2024-09-21T01:11:40.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f990942c640 1 Processor -- start 2024-09-21T01:11:40.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f990942c640 1 -- start start 2024-09-21T01:11:40.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f990942c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904101fc0 0x7f990419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:40.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f990942c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9904109500 0x7f990419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:40.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f990942c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9904109e50 0x7f990419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:40.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f990942c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9904113b10 con 0x7f9904101fc0 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f990942c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9904113990 con 0x7f9904109e50 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f990942c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9904113c90 con 0x7f9904109500 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f9902ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904101fc0 0x7f990419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f9902ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904101fc0 0x7f990419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34720/0 (socket says 172.21.15.148:34720) 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.494+0000 7f9902ffd640 1 -- 172.21.15.148:0/202183268 learned_addr learned my addr 172.21.15.148:0/202183268 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f99027fc640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9904109500 0x7f990419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f99037fe640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9904109e50 0x7f990419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f9902ffd640 1 -- 172.21.15.148:0/202183268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9904109500 msgr2=0x7f990419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f9902ffd640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9904109500 0x7f990419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f9902ffd640 1 -- 172.21.15.148:0/202183268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9904109e50 msgr2=0x7f990419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f9902ffd640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9904109e50 0x7f990419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f9902ffd640 1 -- 172.21.15.148:0/202183268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99041a0470 con 0x7f9904101fc0 2024-09-21T01:11:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f99027fc640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9904109500 0x7f990419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:11:40.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f9902ffd640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904101fc0 0x7f990419a500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005940 tx=0x7f98f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:40.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f98ebfff640 1 -- 172.21.15.148:0/202183268 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f403f030 con 0x7f9904101fc0 2024-09-21T01:11:40.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f990942c640 1 -- 172.21.15.148:0/202183268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99041a0700 con 0x7f9904101fc0 2024-09-21T01:11:40.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f990942c640 1 -- 172.21.15.148:0/202183268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9904102e40 con 0x7f9904101fc0 2024-09-21T01:11:40.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.495+0000 7f98ebfff640 1 -- 172.21.15.148:0/202183268 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98f4003cb0 con 0x7f9904101fc0 2024-09-21T01:11:40.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.496+0000 7f98ebfff640 1 -- 172.21.15.148:0/202183268 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4049060 con 0x7f9904101fc0 2024-09-21T01:11:40.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.497+0000 7f990942c640 1 -- 172.21.15.148:0/202183268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f990406b910 con 0x7f9904101fc0 2024-09-21T01:11:40.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.498+0000 7f98ebfff640 1 -- 172.21.15.148:0/202183268 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f98f4042030 con 0x7f9904101fc0 2024-09-21T01:11:40.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.499+0000 7f98ebfff640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f98ec0b6510 0x7f98ec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:40.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.499+0000 7f99027fc640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f98ec0b6510 0x7f98ec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:40.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.499+0000 7f98ebfff640 1 -- 172.21.15.148:0/202183268 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f98f4107120 con 0x7f9904101fc0 2024-09-21T01:11:40.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.499+0000 7f99027fc640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f98ec0b6510 0x7f98ec0b8a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98f8005d00 tx=0x7f98f8005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:40.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.507+0000 7f98ebfff640 1 -- 172.21.15.148:0/202183268 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f98f40cde50 con 0x7f9904101fc0 2024-09-21T01:11:40.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.740+0000 7f990942c640 1 -- 172.21.15.148:0/202183268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f990410bc80 con 0x7f9904101fc0 2024-09-21T01:11:40.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.740+0000 7f98ebfff640 1 -- 172.21.15.148:0/202183268 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f98f40d2230 con 0x7f9904101fc0 2024-09-21T01:11:40.741 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:40.742 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":4,"btime":"2024-09-21T01:11:39:361098+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T01:11:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 4 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 -- 172.21.15.148:0/202183268 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f98ec0b6510 msgr2=0x7f98ec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f98ec0b6510 0x7f98ec0b8a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98f8005d00 tx=0x7f98f8005c70 comp rx=0 tx=0).stop 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 -- 172.21.15.148:0/202183268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904101fc0 msgr2=0x7f990419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904101fc0 0x7f990419a500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005940 tx=0x7f98f40042f0 comp rx=0 tx=0).stop 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 -- 172.21.15.148:0/202183268 shutdown_connections 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f98ec0b6510 0x7f98ec0b8a20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9904109e50 0x7f990419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9904109500 0x7f990419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 --2- 172.21.15.148:0/202183268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9904101fc0 0x7f990419a500 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 -- 172.21.15.148:0/202183268 >> 172.21.15.148:0/202183268 conn(0x7f9904079f90 msgr2=0x7f9904107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 -- 172.21.15.148:0/202183268 shutdown_connections 2024-09-21T01:11:40.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:40.743+0000 7f990942c640 1 -- 172.21.15.148:0/202183268 wait complete. 2024-09-21T01:11:40.754 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:40 smithi148 ceph-mon[31000]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:40.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:40 smithi181 ceph-mon[34811]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:40.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:40 smithi157 ceph-mon[34140]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:41.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:41 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/202183268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:41.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:41.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:41.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:41.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:41.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:41.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:41 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:41.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:41 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/202183268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:41.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:41.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:41.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:41.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:41.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:41.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:41 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:41.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:41 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/202183268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:41.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:41.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:41.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:41.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:41.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:41.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:41 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:42.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:42 smithi148 ceph-mon[31000]: Deploying daemon mds.e on smithi157 2024-09-21T01:11:42.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:42 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.148:6836/540984210,v1:172.21.15.148:6837/540984210] up:boot 2024-09-21T01:11:42.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:42 smithi148 ceph-mon[31000]: fsmap 4 up:standby 2024-09-21T01:11:42.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:42 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T01:11:42.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:42 smithi148 ceph-mon[31000]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:42.948 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:42 smithi157 ceph-mon[34140]: Deploying daemon mds.e on smithi157 2024-09-21T01:11:42.948 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:42 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.148:6836/540984210,v1:172.21.15.148:6837/540984210] up:boot 2024-09-21T01:11:42.948 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:42 smithi157 ceph-mon[34140]: fsmap 4 up:standby 2024-09-21T01:11:42.948 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:42 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T01:11:42.948 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:42 smithi157 ceph-mon[34140]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:42.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:42 smithi181 ceph-mon[34811]: Deploying daemon mds.e on smithi157 2024-09-21T01:11:42.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:42 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.148:6836/540984210,v1:172.21.15.148:6837/540984210] up:boot 2024-09-21T01:11:42.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:42 smithi181 ceph-mon[34811]: fsmap 4 up:standby 2024-09-21T01:11:42.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:42 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T01:11:42.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:42 smithi181 ceph-mon[34811]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:43.240 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:11:43 smithi157 systemd[1]: Starting Ceph mds.e for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:11:43.620 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:11:43 smithi157 podman[62003]: 2024-09-21 01:11:43.271981074 +0000 UTC m=+0.016281169 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:43.672 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:11:43 smithi157 podman[62003]: 2024-09-21 01:11:43.397967641 +0000 UTC m=+0.142267730 container create 2e6363a72bc6adf6b8c8387e529aed8a174f4eb896193df1d8e95a96d1f02c2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:11:43.672 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:11:43 smithi157 podman[62003]: 2024-09-21 01:11:43.616914532 +0000 UTC m=+0.361214614 container init 2e6363a72bc6adf6b8c8387e529aed8a174f4eb896193df1d8e95a96d1f02c2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:11:43.672 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:11:43 smithi157 podman[62003]: 2024-09-21 01:11:43.620419495 +0000 UTC m=+0.364719577 container start 2e6363a72bc6adf6b8c8387e529aed8a174f4eb896193df1d8e95a96d1f02c2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T01:11:43.830 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:11:43.990 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:11:43 smithi157 ceph-mds[62022]: -- 172.21.15.157:0/2281417558 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564f5569f860 con 0x564f59847180 2024-09-21T01:11:43.990 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:11:43 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e[62018]: starting mds.e at 2024-09-21T01:11:43.990 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:11:43 smithi157 bash[62003]: 2e6363a72bc6adf6b8c8387e529aed8a174f4eb896193df1d8e95a96d1f02c2c 2024-09-21T01:11:43.991 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:11:43 smithi157 systemd[1]: Started Ceph mds.e for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:11:44.088 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:44.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.744+0000 7fd40bfdf640 1 -- 172.21.15.148:0/886550946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4041094d0 msgr2=0x7fd4041098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:44.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.744+0000 7fd40bfdf640 1 --2- 172.21.15.148:0/886550946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4041094d0 0x7fd4041098e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009900 tx=0x7fd3f402a410 comp rx=0 tx=0).stop 2024-09-21T01:11:44.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.744+0000 7fd40bfdf640 1 -- 172.21.15.148:0/886550946 shutdown_connections 2024-09-21T01:11:44.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.744+0000 7fd40bfdf640 1 --2- 172.21.15.148:0/886550946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4041094d0 0x7fd4041098e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:44.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.744+0000 7fd40bfdf640 1 --2- 172.21.15.148:0/886550946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd404109e20 0x7fd404110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:44.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.744+0000 7fd40bfdf640 1 --2- 172.21.15.148:0/886550946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd404103b90 0x7fd404103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:44.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.744+0000 7fd40bfdf640 1 -- 172.21.15.148:0/886550946 >> 172.21.15.148:0/886550946 conn(0x7fd4040ff600 msgr2=0x7fd404101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:44.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.744+0000 7fd40bfdf640 1 -- 172.21.15.148:0/886550946 shutdown_connections 2024-09-21T01:11:44.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.745+0000 7fd40bfdf640 1 -- 172.21.15.148:0/886550946 wait complete. 2024-09-21T01:11:44.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.745+0000 7fd40bfdf640 1 Processor -- start 2024-09-21T01:11:44.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.745+0000 7fd40bfdf640 1 -- start start 2024-09-21T01:11:44.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.745+0000 7fd40bfdf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd404103b90 0x7fd40419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40bfdf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4041094d0 0x7fd40419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40bfdf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd404109e20 0x7fd40419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40bfdf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd404113ae0 con 0x7fd404109e20 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40bfdf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd404113960 con 0x7fd4041094d0 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40bfdf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd404113c60 con 0x7fd404103b90 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40a57c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd404109e20 0x7fd40419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40a57c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd404109e20 0x7fd40419fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34764/0 (socket says 172.21.15.148:34764) 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40a57c640 1 -- 172.21.15.148:0/3042157324 learned_addr learned my addr 172.21.15.148:0/3042157324 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40957a640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4041094d0 0x7fd40419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd409d7b640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd404103b90 0x7fd40419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40a57c640 1 -- 172.21.15.148:0/3042157324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd404103b90 msgr2=0x7fd40419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:44.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40a57c640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd404103b90 0x7fd40419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40a57c640 1 -- 172.21.15.148:0/3042157324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4041094d0 msgr2=0x7fd40419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40a57c640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4041094d0 0x7fd40419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40a57c640 1 -- 172.21.15.148:0/3042157324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4041a03e0 con 0x7fd404109e20 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40957a640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4041094d0 0x7fd40419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40a57c640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd404109e20 0x7fd40419fd70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00cce0 tx=0x7fd3fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd3faffd640 1 -- 172.21.15.148:0/3042157324 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00f450 con 0x7fd404109e20 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd3faffd640 1 -- 172.21.15.148:0/3042157324 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3fc00faa0 con 0x7fd404109e20 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40bfdf640 1 -- 172.21.15.148:0/3042157324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4041a06d0 con 0x7fd404109e20 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd3faffd640 1 -- 172.21.15.148:0/3042157324 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc018b70 con 0x7fd404109e20 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.746+0000 7fd40bfdf640 1 -- 172.21.15.148:0/3042157324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4041a0b90 con 0x7fd404109e20 2024-09-21T01:11:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.747+0000 7fd40bfdf640 1 -- 172.21.15.148:0/3042157324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd404104e10 con 0x7fd404109e20 2024-09-21T01:11:44.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.749+0000 7fd3faffd640 1 -- 172.21.15.148:0/3042157324 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7fd3fc018d10 con 0x7fd404109e20 2024-09-21T01:11:44.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.750+0000 7fd3faffd640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd3f00b6540 0x7fd3f00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:44.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.750+0000 7fd409d7b640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd3f00b6540 0x7fd3f00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:44.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.750+0000 7fd3faffd640 1 -- 172.21.15.148:0/3042157324 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fd3fc0e72d0 con 0x7fd404109e20 2024-09-21T01:11:44.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.750+0000 7fd409d7b640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd3f00b6540 0x7fd3f00b8a50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd400005fd0 tx=0x7fd400005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:44.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.753+0000 7fd3faffd640 1 -- 172.21.15.148:0/3042157324 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd3fc014030 con 0x7fd404109e20 2024-09-21T01:11:44.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.157:6834/2996859376,v1:172.21.15.157:6835/2996859376] up:boot 2024-09-21T01:11:44.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: fsmap 5 up:standby 2024-09-21T01:11:44.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:11:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: Deploying daemon mds.f on smithi181 2024-09-21T01:11:44.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:44 smithi148 ceph-mon[31000]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.157:6834/2996859376,v1:172.21.15.157:6835/2996859376] up:boot 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: fsmap 5 up:standby 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: Deploying daemon mds.f on smithi181 2024-09-21T01:11:44.879 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:44 smithi181 ceph-mon[34811]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:44.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.967+0000 7fd40bfdf640 1 -- 172.21.15.148:0/3042157324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd404103fa0 con 0x7fd404109e20 2024-09-21T01:11:44.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.968+0000 7fd3faffd640 1 -- 172.21.15.148:0/3042157324 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7fd404103fa0 con 0x7fd404109e20 2024-09-21T01:11:44.969 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:44.969 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":6,"btime":"2024-09-21T01:11:43:709269+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T01:11:44.969 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 6 2024-09-21T01:11:44.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.970+0000 7fd40bfdf640 1 -- 172.21.15.148:0/3042157324 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd3f00b6540 msgr2=0x7fd3f00b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:44.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.970+0000 7fd40bfdf640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd3f00b6540 0x7fd3f00b8a50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd400005fd0 tx=0x7fd400005850 comp rx=0 tx=0).stop 2024-09-21T01:11:44.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.970+0000 7fd40bfdf640 1 -- 172.21.15.148:0/3042157324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd404109e20 msgr2=0x7fd40419fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:44.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.970+0000 7fd40bfdf640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd404109e20 0x7fd40419fd70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00cce0 tx=0x7fd3fc00a620 comp rx=0 tx=0).stop 2024-09-21T01:11:44.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.970+0000 7fd40bfdf640 1 -- 172.21.15.148:0/3042157324 shutdown_connections 2024-09-21T01:11:44.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.970+0000 7fd40bfdf640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd3f00b6540 0x7fd3f00b8a50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:44.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.970+0000 7fd40bfdf640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd404109e20 0x7fd40419fd70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:44.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.970+0000 7fd40bfdf640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4041094d0 0x7fd40419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:44.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.970+0000 7fd40bfdf640 1 --2- 172.21.15.148:0/3042157324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd404103b90 0x7fd40419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:44.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.971+0000 7fd40bfdf640 1 -- 172.21.15.148:0/3042157324 >> 172.21.15.148:0/3042157324 conn(0x7fd4040ff600 msgr2=0x7fd404101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:44.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.971+0000 7fd40bfdf640 1 -- 172.21.15.148:0/3042157324 shutdown_connections 2024-09-21T01:11:44.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:44.971+0000 7fd40bfdf640 1 -- 172.21.15.148:0/3042157324 wait complete. 2024-09-21T01:11:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.157:6834/2996859376,v1:172.21.15.157:6835/2996859376] up:boot 2024-09-21T01:11:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: fsmap 5 up:standby 2024-09-21T01:11:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:11:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: Deploying daemon mds.f on smithi181 2024-09-21T01:11:44.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:44 smithi157 ceph-mon[34140]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:45.730 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:11:45 smithi181 systemd[1]: Starting Ceph mds.f for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:11:46.075 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:45 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3042157324' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:46.075 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:11:45 smithi181 podman[63379]: 2024-09-21 01:11:45.754842672 +0000 UTC m=+0.015671919 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:46.075 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:11:45 smithi181 podman[63379]: 2024-09-21 01:11:45.873174065 +0000 UTC m=+0.134003359 container create 2dc2a45cc738281502b1639a2da0fc662f5be31cd921dce492e47950c50fe75a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T01:11:46.075 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:11:46 smithi181 podman[63379]: 2024-09-21 01:11:46.075340687 +0000 UTC m=+0.336169934 container init 2dc2a45cc738281502b1639a2da0fc662f5be31cd921dce492e47950c50fe75a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T01:11:46.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:45 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3042157324' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:46.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:45 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3042157324' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:46.480 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:11:46 smithi181 podman[63379]: 2024-09-21 01:11:46.078188597 +0000 UTC m=+0.339017837 container start 2dc2a45cc738281502b1639a2da0fc662f5be31cd921dce492e47950c50fe75a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T01:11:46.480 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:11:46 smithi181 ceph-mds[63398]: -- 172.21.15.181:0/500944578 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5580fb025860 con 0x5580ff1cd600 2024-09-21T01:11:46.480 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:11:46 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f[63394]: starting mds.f at 2024-09-21T01:11:46.480 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:11:46 smithi181 bash[63379]: 2dc2a45cc738281502b1639a2da0fc662f5be31cd921dce492e47950c50fe75a 2024-09-21T01:11:46.480 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:11:46 smithi181 systemd[1]: Started Ceph mds.f for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:11:47.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:47.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:47.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:47.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:47.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:47.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:47.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: Deploying daemon mds.c on smithi181 2024-09-21T01:11:47.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:47.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.181:6834/685827281,v1:172.21.15.181:6835/685827281] up:boot 2024-09-21T01:11:47.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: fsmap 6 up:standby 2024-09-21T01:11:47.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:47 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:11:47.599 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:47.599 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:47.599 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:47.599 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:47.599 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:47.599 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:47.599 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: Deploying daemon mds.c on smithi181 2024-09-21T01:11:47.599 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:47.599 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.181:6834/685827281,v1:172.21.15.181:6835/685827281] up:boot 2024-09-21T01:11:47.599 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: fsmap 6 up:standby 2024-09-21T01:11:47.600 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:47 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:11:47.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:47.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:47.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:47.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:47.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:47.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:47.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: Deploying daemon mds.c on smithi181 2024-09-21T01:11:47.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:47.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.181:6834/685827281,v1:172.21.15.181:6835/685827281] up:boot 2024-09-21T01:11:47.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: fsmap 6 up:standby 2024-09-21T01:11:47.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:47 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:11:47.707 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:11:47.966 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:48.230 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:11:48 smithi181 systemd[1]: Starting Ceph mds.c for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:11:48.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.428+0000 7fbab372a640 1 -- 172.21.15.148:0/621946662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbaac1083a0 msgr2=0x7fbaac1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:48.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.428+0000 7fbab372a640 1 --2- 172.21.15.148:0/621946662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbaac1083a0 0x7fbaac1087b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009900 tx=0x7fba9c02a410 comp rx=0 tx=0).stop 2024-09-21T01:11:48.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.428+0000 7fbab372a640 1 -- 172.21.15.148:0/621946662 shutdown_connections 2024-09-21T01:11:48.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.428+0000 7fbab372a640 1 --2- 172.21.15.148:0/621946662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbaac1083a0 0x7fbaac1087b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:48.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.428+0000 7fbab372a640 1 --2- 172.21.15.148:0/621946662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaac108cf0 0x7fbaac10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:48.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.428+0000 7fbab372a640 1 --2- 172.21.15.148:0/621946662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaac102a60 0x7fbaac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:48.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.428+0000 7fbab372a640 1 -- 172.21.15.148:0/621946662 >> 172.21.15.148:0/621946662 conn(0x7fbaac079730 msgr2=0x7fbaac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:48.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.428+0000 7fbab372a640 1 -- 172.21.15.148:0/621946662 shutdown_connections 2024-09-21T01:11:48.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.428+0000 7fbab372a640 1 -- 172.21.15.148:0/621946662 wait complete. 2024-09-21T01:11:48.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab372a640 1 Processor -- start 2024-09-21T01:11:48.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab372a640 1 -- start start 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab372a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaac102a60 0x7fbaac19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab372a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaac1083a0 0x7fbaac19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab372a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbaac108cf0 0x7fbaac19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab372a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac112960 con 0x7fbaac108cf0 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab372a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1127e0 con 0x7fbaac102a60 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab372a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac112ae0 con 0x7fbaac1083a0 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab0cc5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaac1083a0 0x7fbaac19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab1cc7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbaac108cf0 0x7fbaac19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab0cc5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaac1083a0 0x7fbaac19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:57664/0 (socket says 172.21.15.148:57664) 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab0cc5640 1 -- 172.21.15.148:0/2374614924 learned_addr learned my addr 172.21.15.148:0/2374614924 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.429+0000 7fbab14c6640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaac102a60 0x7fbaac19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbab1cc7640 1 -- 172.21.15.148:0/2374614924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaac1083a0 msgr2=0x7fbaac19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbab1cc7640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaac1083a0 0x7fbaac19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:48.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbab1cc7640 1 -- 172.21.15.148:0/2374614924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaac102a60 msgr2=0x7fbaac19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:48.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbab1cc7640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaac102a60 0x7fbaac19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:48.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbab1cc7640 1 -- 172.21.15.148:0/2374614924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac1a03f0 con 0x7fbaac108cf0 2024-09-21T01:11:48.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbab14c6640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaac102a60 0x7fbaac19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:11:48.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbab0cc5640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaac1083a0 0x7fbaac19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:11:48.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbab1cc7640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbaac108cf0 0x7fbaac19fcc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009fd0 tx=0x7fbaa400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:48.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbaa27fc640 1 -- 172.21.15.148:0/2374614924 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa400ce20 con 0x7fbaac108cf0 2024-09-21T01:11:48.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbaa27fc640 1 -- 172.21.15.148:0/2374614924 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa4005020 con 0x7fbaac108cf0 2024-09-21T01:11:48.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbab372a640 1 -- 172.21.15.148:0/2374614924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaac1a06e0 con 0x7fbaac108cf0 2024-09-21T01:11:48.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbaa27fc640 1 -- 172.21.15.148:0/2374614924 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4010690 con 0x7fbaac108cf0 2024-09-21T01:11:48.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.430+0000 7fbab372a640 1 -- 172.21.15.148:0/2374614924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaac1a6e40 con 0x7fbaac108cf0 2024-09-21T01:11:48.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.431+0000 7fbab372a640 1 -- 172.21.15.148:0/2374614924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaac102e70 con 0x7fbaac108cf0 2024-09-21T01:11:48.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.433+0000 7fbaa27fc640 1 -- 172.21.15.148:0/2374614924 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7fbaa40054d0 con 0x7fbaac108cf0 2024-09-21T01:11:48.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.433+0000 7fbaa27fc640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fba980b6590 0x7fba980b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:48.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.433+0000 7fbab14c6640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fba980b6590 0x7fba980b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:48.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.434+0000 7fbaa27fc640 1 -- 172.21.15.148:0/2374614924 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fbaa40e7560 con 0x7fbaac108cf0 2024-09-21T01:11:48.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.434+0000 7fbab14c6640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fba980b6590 0x7fba980b8aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009c20 tx=0x7fbaa8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.437+0000 7fbaa27fc640 1 -- 172.21.15.148:0/2374614924 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbaa40ae290 con 0x7fbaac108cf0 2024-09-21T01:11:48.611 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:48 smithi181 ceph-mon[34811]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:48.612 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:11:48 smithi181 podman[63647]: 2024-09-21 01:11:48.24927546 +0000 UTC m=+0.015850221 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:48.612 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:11:48 smithi181 podman[63647]: 2024-09-21 01:11:48.376013374 +0000 UTC m=+0.142588121 container create daa2361f1b8037285e2dca6bf2eb8f8aa9c4f11f517966036dfc020b8fac1aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:11:48.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:48 smithi148 ceph-mon[31000]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:48.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.651+0000 7fbab372a640 1 -- 172.21.15.148:0/2374614924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbaac19b5b0 con 0x7fbaac108cf0 2024-09-21T01:11:48.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.652+0000 7fbaa27fc640 1 -- 172.21.15.148:0/2374614924 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5569 (secure 0 0 0) 0x7fbaac19b5b0 con 0x7fbaac108cf0 2024-09-21T01:11:48.653 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:48.653 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":7,"btime":"2024-09-21T01:11:46:788791+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24619,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T01:11:48.653 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 7 2024-09-21T01:11:48.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.654+0000 7fbab372a640 1 -- 172.21.15.148:0/2374614924 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fba980b6590 msgr2=0x7fba980b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.654+0000 7fbab372a640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fba980b6590 0x7fba980b8aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009c20 tx=0x7fbaa8005f90 comp rx=0 tx=0).stop 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.654+0000 7fbab372a640 1 -- 172.21.15.148:0/2374614924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbaac108cf0 msgr2=0x7fbaac19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.654+0000 7fbab372a640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbaac108cf0 0x7fbaac19fcc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009fd0 tx=0x7fbaa400ef10 comp rx=0 tx=0).stop 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.655+0000 7fbab372a640 1 -- 172.21.15.148:0/2374614924 shutdown_connections 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.655+0000 7fbab372a640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fba980b6590 0x7fba980b8aa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.655+0000 7fbab372a640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbaac108cf0 0x7fbaac19fcc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.655+0000 7fbab372a640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbaac1083a0 0x7fbaac19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.655+0000 7fbab372a640 1 --2- 172.21.15.148:0/2374614924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbaac102a60 0x7fbaac19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.655+0000 7fbab372a640 1 -- 172.21.15.148:0/2374614924 >> 172.21.15.148:0/2374614924 conn(0x7fbaac079730 msgr2=0x7fbaac06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.655+0000 7fbab372a640 1 -- 172.21.15.148:0/2374614924 shutdown_connections 2024-09-21T01:11:48.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:48.655+0000 7fbab372a640 1 -- 172.21.15.148:0/2374614924 wait complete. 2024-09-21T01:11:48.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:48 smithi157 ceph-mon[34140]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:48.980 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:11:48 smithi181 podman[63647]: 2024-09-21 01:11:48.611926877 +0000 UTC m=+0.378501638 container init daa2361f1b8037285e2dca6bf2eb8f8aa9c4f11f517966036dfc020b8fac1aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T01:11:48.980 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:11:48 smithi181 podman[63647]: 2024-09-21 01:11:48.614943372 +0000 UTC m=+0.381518119 container start daa2361f1b8037285e2dca6bf2eb8f8aa9c4f11f517966036dfc020b8fac1aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:11:48.980 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:11:48 smithi181 ceph-mds[63667]: -- 172.21.15.181:0/3070673853 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe05d45860 con 0x55fe09eed180 2024-09-21T01:11:48.980 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:11:48 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c[63663]: starting mds.c at 2024-09-21T01:11:48.980 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:11:48 smithi181 bash[63647]: daa2361f1b8037285e2dca6bf2eb8f8aa9c4f11f517966036dfc020b8fac1aea 2024-09-21T01:11:48.980 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:11:48 smithi181 systemd[1]: Started Ceph mds.c for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:11:49.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:49 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2374614924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:49.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:49.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:49.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:49.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:49.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:49.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:49 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:49.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:49 smithi157 ceph-mon[34140]: Deploying daemon mds.h on smithi157 2024-09-21T01:11:49.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:49 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2374614924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:49.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:49.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:49.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:49.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:49.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:49.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:49 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:49.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:49 smithi181 ceph-mon[34811]: Deploying daemon mds.h on smithi157 2024-09-21T01:11:49.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:49 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2374614924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:49.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:49.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:49.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:49.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:49.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:49.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:49 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:49.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:49 smithi148 ceph-mon[31000]: Deploying daemon mds.h on smithi157 2024-09-21T01:11:50.459 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:50 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] up:boot 2024-09-21T01:11:50.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:50 smithi157 ceph-mon[34140]: fsmap 7 up:standby 2024-09-21T01:11:50.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:50 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:11:50.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:50 smithi157 ceph-mon[34140]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:50.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:50 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] up:boot 2024-09-21T01:11:50.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:50 smithi181 ceph-mon[34811]: fsmap 7 up:standby 2024-09-21T01:11:50.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:50 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:11:50.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:50 smithi181 ceph-mon[34811]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:50.740 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:11:50 smithi157 systemd[1]: Starting Ceph mds.h for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:11:50.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:50 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] up:boot 2024-09-21T01:11:50.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:50 smithi148 ceph-mon[31000]: fsmap 7 up:standby 2024-09-21T01:11:50.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:50 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:11:50.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:50 smithi148 ceph-mon[31000]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:51.116 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:11:50 smithi157 podman[62273]: 2024-09-21 01:11:50.842630478 +0000 UTC m=+0.101630569 container create 633b15a168d2615711c8a429360c06754ce6a444cee188e51fe9050d393608dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T01:11:51.116 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:11:50 smithi157 podman[62273]: 2024-09-21 01:11:50.756838819 +0000 UTC m=+0.015838914 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:51.116 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:11:51 smithi157 podman[62273]: 2024-09-21 01:11:51.078694843 +0000 UTC m=+0.337694934 container init 633b15a168d2615711c8a429360c06754ce6a444cee188e51fe9050d393608dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T01:11:51.116 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:11:51 smithi157 podman[62273]: 2024-09-21 01:11:51.082206368 +0000 UTC m=+0.341206459 container start 633b15a168d2615711c8a429360c06754ce6a444cee188e51fe9050d393608dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T01:11:51.117 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:11:51 smithi157 ceph-mds[62292]: -- 172.21.15.157:0/2376101861 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56268ee65c20 con 0x56269300d600 2024-09-21T01:11:51.396 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:11:51.490 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:11:51 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h[62288]: starting mds.h at 2024-09-21T01:11:51.490 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:11:51 smithi157 bash[62273]: 633b15a168d2615711c8a429360c06754ce6a444cee188e51fe9050d393608dc 2024-09-21T01:11:51.490 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:11:51 smithi157 systemd[1]: Started Ceph mds.h for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:11:51.654 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:52.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.135+0000 7f4ad72d9640 1 -- 172.21.15.148:0/799398919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad0103b80 msgr2=0x7f4ad0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:52.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.135+0000 7f4ad72d9640 1 --2- 172.21.15.148:0/799398919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad0103b80 0x7f4ad0103f90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009900 tx=0x7f4acc02a410 comp rx=0 tx=0).stop 2024-09-21T01:11:52.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.135+0000 7f4ad72d9640 1 -- 172.21.15.148:0/799398919 shutdown_connections 2024-09-21T01:11:52.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.135+0000 7f4ad72d9640 1 --2- 172.21.15.148:0/799398919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad0109e10 0x7f4ad0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:52.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.135+0000 7f4ad72d9640 1 --2- 172.21.15.148:0/799398919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ad01094c0 0x7f4ad01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:52.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.136+0000 7f4ad72d9640 1 --2- 172.21.15.148:0/799398919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad0103b80 0x7f4ad0103f90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:52.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.136+0000 7f4ad72d9640 1 -- 172.21.15.148:0/799398919 >> 172.21.15.148:0/799398919 conn(0x7f4ad00ff610 msgr2=0x7f4ad0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.136+0000 7f4ad72d9640 1 -- 172.21.15.148:0/799398919 shutdown_connections 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.136+0000 7f4ad72d9640 1 -- 172.21.15.148:0/799398919 wait complete. 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.136+0000 7f4ad72d9640 1 Processor -- start 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.136+0000 7f4ad72d9640 1 -- start start 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad72d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ad0103b80 0x7f4ad019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad72d9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad01094c0 0x7f4ad019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad72d9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad0109e10 0x7f4ad019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad72d9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0113ad0 con 0x7f4ad0109e10 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad72d9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0113950 con 0x7f4ad01094c0 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad72d9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0113c50 con 0x7f4ad0103b80 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad5876640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad0109e10 0x7f4ad019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad5876640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad0109e10 0x7f4ad019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36644/0 (socket says 172.21.15.148:36644) 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad5876640 1 -- 172.21.15.148:0/900389300 learned_addr learned my addr 172.21.15.148:0/900389300 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad4874640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad01094c0 0x7f4ad019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad5075640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ad0103b80 0x7f4ad019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad5876640 1 -- 172.21.15.148:0/900389300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ad0103b80 msgr2=0x7f4ad019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad5876640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ad0103b80 0x7f4ad019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad5876640 1 -- 172.21.15.148:0/900389300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad01094c0 msgr2=0x7f4ad019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad5876640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad01094c0 0x7f4ad019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad5876640 1 -- 172.21.15.148:0/900389300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad01a0430 con 0x7f4ad0109e10 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad4874640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad01094c0 0x7f4ad019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.137+0000 7f4ad5876640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad0109e10 0x7f4ad019fd00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800eaa0 tx=0x7f4ac800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.138+0000 7f4ac67fc640 1 -- 172.21.15.148:0/900389300 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800cdb0 con 0x7f4ad0109e10 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.138+0000 7f4ad72d9640 1 -- 172.21.15.148:0/900389300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad01a0720 con 0x7f4ad0109e10 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.138+0000 7f4ac67fc640 1 -- 172.21.15.148:0/900389300 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ac8005020 con 0x7f4ad0109e10 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.138+0000 7f4ac67fc640 1 -- 172.21.15.148:0/900389300 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80116d0 con 0x7f4ad0109e10 2024-09-21T01:11:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.138+0000 7f4ad72d9640 1 -- 172.21.15.148:0/900389300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad01a6e80 con 0x7f4ad0109e10 2024-09-21T01:11:52.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.139+0000 7f4ad72d9640 1 -- 172.21.15.148:0/900389300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad0104e00 con 0x7f4ad0109e10 2024-09-21T01:11:52.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.142+0000 7f4ac67fc640 1 -- 172.21.15.148:0/900389300 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f4ac80051d0 con 0x7f4ad0109e10 2024-09-21T01:11:52.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.142+0000 7f4ac67fc640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f4abc0b6510 0x7f4abc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:52.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.143+0000 7f4ad5075640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f4abc0b6510 0x7f4abc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:52.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.143+0000 7f4ac67fc640 1 -- 172.21.15.148:0/900389300 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f4ac80e7380 con 0x7f4ad0109e10 2024-09-21T01:11:52.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.143+0000 7f4ad5075640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f4abc0b6510 0x7f4abc0b8a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4acc031440 tx=0x7f4acc009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:52.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.146+0000 7f4ac67fc640 1 -- 172.21.15.148:0/900389300 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ac8016030 con 0x7f4ad0109e10 2024-09-21T01:11:52.314 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:52.314 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:52.314 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:52.314 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:52.314 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:52.314 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:52.314 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:52 smithi148 ceph-mon[31000]: Deploying daemon mds.i on smithi181 2024-09-21T01:11:52.314 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:52 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.157:6836/3732138486,v1:172.21.15.157:6837/3732138486] up:boot 2024-09-21T01:11:52.314 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:52 smithi148 ceph-mon[31000]: fsmap 8 up:standby 2024-09-21T01:11:52.315 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:52 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:11:52.367 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:52.367 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":9,"btime":"2024-09-21T01:11:51:379268+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24619,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T01:11:52.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.365+0000 7f4ad72d9640 1 -- 172.21.15.148:0/900389300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ad010bc40 con 0x7f4ad0109e10 2024-09-21T01:11:52.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.366+0000 7f4ac67fc640 1 -- 172.21.15.148:0/900389300 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7f4ac80b2490 con 0x7f4ad0109e10 2024-09-21T01:11:52.367 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 9 2024-09-21T01:11:52.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 -- 172.21.15.148:0/900389300 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f4abc0b6510 msgr2=0x7f4abc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:52.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f4abc0b6510 0x7f4abc0b8a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4acc031440 tx=0x7f4acc009560 comp rx=0 tx=0).stop 2024-09-21T01:11:52.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 -- 172.21.15.148:0/900389300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad0109e10 msgr2=0x7f4ad019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:52.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad0109e10 0x7f4ad019fd00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800eaa0 tx=0x7f4ac800ef60 comp rx=0 tx=0).stop 2024-09-21T01:11:52.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 -- 172.21.15.148:0/900389300 shutdown_connections 2024-09-21T01:11:52.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f4abc0b6510 0x7f4abc0b8a20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:52.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad0109e10 0x7f4ad019fd00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:52.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad01094c0 0x7f4ad019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:52.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 --2- 172.21.15.148:0/900389300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ad0103b80 0x7f4ad019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:52.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 -- 172.21.15.148:0/900389300 >> 172.21.15.148:0/900389300 conn(0x7f4ad00ff610 msgr2=0x7f4ad0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:52.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 -- 172.21.15.148:0/900389300 shutdown_connections 2024-09-21T01:11:52.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:52.368+0000 7f4ad72d9640 1 -- 172.21.15.148:0/900389300 wait complete. 2024-09-21T01:11:52.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:52.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:52.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:52.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:52.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:52.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:52.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:52 smithi181 ceph-mon[34811]: Deploying daemon mds.i on smithi181 2024-09-21T01:11:52.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:52 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.157:6836/3732138486,v1:172.21.15.157:6837/3732138486] up:boot 2024-09-21T01:11:52.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:52 smithi181 ceph-mon[34811]: fsmap 8 up:standby 2024-09-21T01:11:52.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:52 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:11:52.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:52.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:52.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:52.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:52.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:52.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:52.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:52 smithi157 ceph-mon[34140]: Deploying daemon mds.i on smithi181 2024-09-21T01:11:52.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:52 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.157:6836/3732138486,v1:172.21.15.157:6837/3732138486] up:boot 2024-09-21T01:11:52.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:52 smithi157 ceph-mon[34140]: fsmap 8 up:standby 2024-09-21T01:11:52.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:52 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:11:53.219 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:11:53 smithi181 systemd[1]: Starting Ceph mds.i for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:11:53.469 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:53 smithi181 ceph-mon[34811]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:53.469 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:53 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/900389300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:53.469 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:11:53 smithi181 podman[63915]: 2024-09-21 01:11:53.184454493 +0000 UTC m=+0.015855479 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:53.469 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:11:53 smithi181 podman[63915]: 2024-09-21 01:11:53.30248128 +0000 UTC m=+0.133882262 container create 18d5f9f638a27bca74a080aa058cbaf24f8f2229dc86396a67911cbf47093c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:11:53.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:53 smithi157 ceph-mon[34140]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:53.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:53 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/900389300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:53.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:53 smithi148 ceph-mon[31000]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:53.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:53 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/900389300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:53.980 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:11:53 smithi181 podman[63915]: 2024-09-21 01:11:53.596853044 +0000 UTC m=+0.428254022 container init 18d5f9f638a27bca74a080aa058cbaf24f8f2229dc86396a67911cbf47093c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T01:11:53.980 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:11:53 smithi181 podman[63915]: 2024-09-21 01:11:53.599655024 +0000 UTC m=+0.431056003 container start 18d5f9f638a27bca74a080aa058cbaf24f8f2229dc86396a67911cbf47093c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T01:11:53.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:11:53 smithi181 ceph-mds[63934]: -- 172.21.15.181:0/4088818349 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5592729b9c20 con 0x559276b61600 2024-09-21T01:11:53.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:11:53 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i[63930]: starting mds.i at 2024-09-21T01:11:53.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:11:53 smithi181 bash[63915]: 18d5f9f638a27bca74a080aa058cbaf24f8f2229dc86396a67911cbf47093c8d 2024-09-21T01:11:53.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:11:53 smithi181 systemd[1]: Started Ceph mds.i for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:11:54.945 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:11:54.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: Deploying daemon mds.g on smithi148 2024-09-21T01:11:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] up:boot 2024-09-21T01:11:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: fsmap 9 up:standby 2024-09-21T01:11:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:11:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:54 smithi157 ceph-mon[34140]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: Deploying daemon mds.g on smithi148 2024-09-21T01:11:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] up:boot 2024-09-21T01:11:55.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: fsmap 9 up:standby 2024-09-21T01:11:55.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:11:55.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:54 smithi148 ceph-mon[31000]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:55.211 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: Deploying daemon mds.g on smithi148 2024-09-21T01:11:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] up:boot 2024-09-21T01:11:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: fsmap 9 up:standby 2024-09-21T01:11:55.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:11:55.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:54 smithi181 ceph-mon[34811]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:55.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.834+0000 7f51ab056640 1 -- 172.21.15.148:0/83965115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a4102a80 msgr2=0x7f51a4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:55.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.834+0000 7f51ab056640 1 --2- 172.21.15.148:0/83965115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a4102a80 0x7f51a4102e90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009900 tx=0x7f51a002a410 comp rx=0 tx=0).stop 2024-09-21T01:11:55.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.834+0000 7f51ab056640 1 -- 172.21.15.148:0/83965115 shutdown_connections 2024-09-21T01:11:55.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.834+0000 7f51ab056640 1 --2- 172.21.15.148:0/83965115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51a4108d10 0x7f51a410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:55.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.834+0000 7f51ab056640 1 --2- 172.21.15.148:0/83965115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51a41083c0 0x7f51a41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:55.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.834+0000 7f51ab056640 1 --2- 172.21.15.148:0/83965115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a4102a80 0x7f51a4102e90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:55.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.834+0000 7f51ab056640 1 -- 172.21.15.148:0/83965115 >> 172.21.15.148:0/83965115 conn(0x7f51a4079740 msgr2=0x7f51a4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:55.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.834+0000 7f51ab056640 1 -- 172.21.15.148:0/83965115 shutdown_connections 2024-09-21T01:11:55.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.834+0000 7f51ab056640 1 -- 172.21.15.148:0/83965115 wait complete. 2024-09-21T01:11:55.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.834+0000 7f51ab056640 1 Processor -- start 2024-09-21T01:11:55.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51ab056640 1 -- start start 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51ab056640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51a4102a80 0x7f51a4104270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51ab056640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51a41083c0 0x7f51a41047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51ab056640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a4108d10 0x7f51a4104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51ab056640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4112980 con 0x7f51a4108d10 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51ab056640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4112800 con 0x7f51a41083c0 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51ab056640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4112b00 con 0x7f51a4102a80 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51a95f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a4108d10 0x7f51a4104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51a95f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a4108d10 0x7f51a4104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36672/0 (socket says 172.21.15.148:36672) 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51a95f3640 1 -- 172.21.15.148:0/4187268489 learned_addr learned my addr 172.21.15.148:0/4187268489 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f519bfff640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51a41083c0 0x7f51a41047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51a8df2640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51a4102a80 0x7f51a4104270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51a95f3640 1 -- 172.21.15.148:0/4187268489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51a4102a80 msgr2=0x7f51a4104270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51a95f3640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51a4102a80 0x7f51a4104270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51a95f3640 1 -- 172.21.15.148:0/4187268489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51a41083c0 msgr2=0x7f51a41047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51a95f3640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51a41083c0 0x7f51a41047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51a95f3640 1 -- 172.21.15.148:0/4187268489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a41a8740 con 0x7f51a4108d10 2024-09-21T01:11:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f51a8df2640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51a4102a80 0x7f51a4104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:11:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.835+0000 7f519bfff640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51a41083c0 0x7f51a41047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:11:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.836+0000 7f51a95f3640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a4108d10 0x7f51a4104cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f519c00eaa0 tx=0x7f519c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.836+0000 7f5199ffb640 1 -- 172.21.15.148:0/4187268489 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c00cdb0 con 0x7f51a4108d10 2024-09-21T01:11:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.836+0000 7f5199ffb640 1 -- 172.21.15.148:0/4187268489 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f519c005020 con 0x7f51a4108d10 2024-09-21T01:11:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.836+0000 7f5199ffb640 1 -- 172.21.15.148:0/4187268489 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c0116d0 con 0x7f51a4108d10 2024-09-21T01:11:55.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.836+0000 7f51ab056640 1 -- 172.21.15.148:0/4187268489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a41a8a30 con 0x7f51a4108d10 2024-09-21T01:11:55.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.836+0000 7f51ab056640 1 -- 172.21.15.148:0/4187268489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a41a8f70 con 0x7f51a4108d10 2024-09-21T01:11:55.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.837+0000 7f51ab056640 1 -- 172.21.15.148:0/4187268489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a4103d00 con 0x7f51a4108d10 2024-09-21T01:11:55.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.839+0000 7f5199ffb640 1 -- 172.21.15.148:0/4187268489 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f519c0051d0 con 0x7f51a4108d10 2024-09-21T01:11:55.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.839+0000 7f5199ffb640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f518c0b6590 0x7f518c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:55.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.839+0000 7f51a8df2640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f518c0b6590 0x7f518c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:55.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.839+0000 7f5199ffb640 1 -- 172.21.15.148:0/4187268489 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f519c0e74b0 con 0x7f51a4108d10 2024-09-21T01:11:55.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.840+0000 7f51a8df2640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f518c0b6590 0x7f518c0b8aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f51a0000c00 tx=0x7f51a0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:55.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:55.842+0000 7f5199ffb640 1 -- 172.21.15.148:0/4187268489 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f519c016030 con 0x7f51a4108d10 2024-09-21T01:11:56.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.071+0000 7f51ab056640 1 -- 172.21.15.148:0/4187268489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51a4102e90 con 0x7f51a4108d10 2024-09-21T01:11:56.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.071+0000 7f5199ffb640 1 -- 172.21.15.148:0/4187268489 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8055 (secure 0 0 0) 0x7f51a4102e90 con 0x7f51a4108d10 2024-09-21T01:11:56.073 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:11:56.073 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":10,"btime":"2024-09-21T01:11:54:218222+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24619,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24646,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T01:11:56.073 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 10 2024-09-21T01:11:56.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 -- 172.21.15.148:0/4187268489 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f518c0b6590 msgr2=0x7f518c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:56.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f518c0b6590 0x7f518c0b8aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f51a0000c00 tx=0x7f51a0031400 comp rx=0 tx=0).stop 2024-09-21T01:11:56.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 -- 172.21.15.148:0/4187268489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a4108d10 msgr2=0x7f51a4104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:56.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a4108d10 0x7f51a4104cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f519c00eaa0 tx=0x7f519c00ef60 comp rx=0 tx=0).stop 2024-09-21T01:11:56.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 -- 172.21.15.148:0/4187268489 shutdown_connections 2024-09-21T01:11:56.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f518c0b6590 0x7f518c0b8aa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:56.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51a4108d10 0x7f51a4104cf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:56.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51a41083c0 0x7f51a41047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:56.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 --2- 172.21.15.148:0/4187268489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51a4102a80 0x7f51a4104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:56.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 -- 172.21.15.148:0/4187268489 >> 172.21.15.148:0/4187268489 conn(0x7f51a4079740 msgr2=0x7f51a4101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:56.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 -- 172.21.15.148:0/4187268489 shutdown_connections 2024-09-21T01:11:56.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:56.074+0000 7f51ab056640 1 -- 172.21.15.148:0/4187268489 wait complete. 2024-09-21T01:11:56.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:56 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4187268489' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:56.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:56 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/4187268489' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:56.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:56 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/4187268489' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:11:56.843 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 21 01:11:56 smithi148 systemd[1]: Started Ceph mds.g for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:11:57.394 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:57 smithi148 ceph-mon[31000]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:57.394 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:57.395 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:57.395 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:57.395 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:57.395 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:57.395 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:57 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:57 smithi181 ceph-mon[34811]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:57 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:57 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:57.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:57 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:57.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:57 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:57.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:57 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:57.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:57 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:57 smithi157 ceph-mon[34140]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:57 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:57 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:57 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:11:57.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:57 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:11:57.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:57 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:11:57.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:57 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:58.327 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:58 smithi148 ceph-mon[31000]: Deploying daemon mds.a on smithi148 2024-09-21T01:11:58.327 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:58 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.148:6838/1439710769,v1:172.21.15.148:6839/1439710769] up:boot 2024-09-21T01:11:58.327 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:58 smithi148 ceph-mon[31000]: fsmap 10 up:standby 2024-09-21T01:11:58.327 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:58 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:11:58.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:58 smithi181 ceph-mon[34811]: Deploying daemon mds.a on smithi148 2024-09-21T01:11:58.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:58 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.148:6838/1439710769,v1:172.21.15.148:6839/1439710769] up:boot 2024-09-21T01:11:58.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:58 smithi181 ceph-mon[34811]: fsmap 10 up:standby 2024-09-21T01:11:58.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:58 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:11:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:58 smithi157 ceph-mon[34140]: Deploying daemon mds.a on smithi148 2024-09-21T01:11:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:58 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.148:6838/1439710769,v1:172.21.15.148:6839/1439710769] up:boot 2024-09-21T01:11:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:58 smithi157 ceph-mon[34140]: fsmap 10 up:standby 2024-09-21T01:11:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:58 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:11:58.863 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:11:58 smithi148 systemd[1]: Starting Ceph mds.a for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:11:59.154 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:11:59.236 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:11:58 smithi148 podman[72413]: 2024-09-21 01:11:58.979138637 +0000 UTC m=+0.107297057 container create 9e47f141c712e1d9438e24e10343e466ef7bcfbf19a2829b29e666c2b4fda4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T01:11:59.236 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:11:58 smithi148 podman[72413]: 2024-09-21 01:11:58.887385476 +0000 UTC m=+0.015543851 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:59.237 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:11:59 smithi148 podman[72413]: 2024-09-21 01:11:59.198116086 +0000 UTC m=+0.326274472 container init 9e47f141c712e1d9438e24e10343e466ef7bcfbf19a2829b29e666c2b4fda4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T01:11:59.237 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:11:59 smithi148 podman[72413]: 2024-09-21 01:11:59.202183951 +0000 UTC m=+0.330342326 container start 9e47f141c712e1d9438e24e10343e466ef7bcfbf19a2829b29e666c2b4fda4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True) 2024-09-21T01:11:59.423 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:59.533 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:11:59 smithi148 ceph-mon[31000]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:59.533 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:11:59 smithi148 ceph-mds[72450]: -- 172.21.15.148:0/1747560741 <== mon.0 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5607c81e9c20 con 0x5607cc391a80 2024-09-21T01:11:59.533 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:11:59 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-a[72428]: starting mds.a at 2024-09-21T01:11:59.533 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:11:59 smithi148 bash[72413]: 9e47f141c712e1d9438e24e10343e466ef7bcfbf19a2829b29e666c2b4fda4e0 2024-09-21T01:11:59.533 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:11:59 smithi148 systemd[1]: Started Ceph mds.a for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:11:59.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:11:59 smithi181 ceph-mon[34811]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:59.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:11:59 smithi157 ceph-mon[34140]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.858+0000 7fe0edd29640 1 -- 172.21.15.148:0/4033689378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e8105220 msgr2=0x7fe0e8105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.858+0000 7fe0edd29640 1 --2- 172.21.15.148:0/4033689378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e8105220 0x7fe0e8105630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009900 tx=0x7fe0dc02a410 comp rx=0 tx=0).stop 2024-09-21T01:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.858+0000 7fe0edd29640 1 -- 172.21.15.148:0/4033689378 shutdown_connections 2024-09-21T01:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.858+0000 7fe0edd29640 1 --2- 172.21.15.148:0/4033689378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e8105220 0x7fe0e8105630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.858+0000 7fe0edd29640 1 --2- 172.21.15.148:0/4033689378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0e8105b70 0x7fe0e810f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:59.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.858+0000 7fe0edd29640 1 --2- 172.21.15.148:0/4033689378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e8103210 0x7fe0e8103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:59.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.858+0000 7fe0edd29640 1 -- 172.21.15.148:0/4033689378 >> 172.21.15.148:0/4033689378 conn(0x7fe0e8079ec0 msgr2=0x7fe0e807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:59.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.858+0000 7fe0edd29640 1 -- 172.21.15.148:0/4033689378 shutdown_connections 2024-09-21T01:11:59.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.858+0000 7fe0edd29640 1 -- 172.21.15.148:0/4033689378 wait complete. 2024-09-21T01:11:59.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0edd29640 1 Processor -- start 2024-09-21T01:11:59.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0edd29640 1 -- start start 2024-09-21T01:11:59.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0edd29640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e8103210 0x7fe0e81100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:59.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0edd29640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e8105220 0x7fe0e8110600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:59.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0edd29640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0e8105b70 0x7fe0e8110b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0edd29640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e8113b90 con 0x7fe0e8103210 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0edd29640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e8113a10 con 0x7fe0e8105b70 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0edd29640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e8113d10 con 0x7fe0e8105220 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0e77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e8103210 0x7fe0e81100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0e77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e8103210 0x7fe0e81100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36602/0 (socket says 172.21.15.148:36602) 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0e77fe640 1 -- 172.21.15.148:0/3512062588 learned_addr learned my addr 172.21.15.148:0/3512062588 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0e7fff640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0e8105b70 0x7fe0e8110b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.859+0000 7fe0e6ffd640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e8105220 0x7fe0e8110600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0e77fe640 1 -- 172.21.15.148:0/3512062588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e8105220 msgr2=0x7fe0e8110600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0e77fe640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e8105220 0x7fe0e8110600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0e77fe640 1 -- 172.21.15.148:0/3512062588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0e8105b70 msgr2=0x7fe0e8110b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0e77fe640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0e8105b70 0x7fe0e8110b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0e77fe640 1 -- 172.21.15.148:0/3512062588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e81a8820 con 0x7fe0e8103210 2024-09-21T01:11:59.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0e7fff640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0e8105b70 0x7fe0e8110b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:11:59.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0e77fe640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e8103210 0x7fe0e81100c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800cce0 tx=0x7fe0d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:59.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0e4ff9640 1 -- 172.21.15.148:0/3512062588 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8004b20 con 0x7fe0e8103210 2024-09-21T01:11:59.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0e4ff9640 1 -- 172.21.15.148:0/3512062588 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0d8004cc0 con 0x7fe0e8103210 2024-09-21T01:11:59.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0edd29640 1 -- 172.21.15.148:0/3512062588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e81a8b10 con 0x7fe0e8103210 2024-09-21T01:11:59.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0e4ff9640 1 -- 172.21.15.148:0/3512062588 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800f6b0 con 0x7fe0e8103210 2024-09-21T01:11:59.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.860+0000 7fe0edd29640 1 -- 172.21.15.148:0/3512062588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e81a9020 con 0x7fe0e8103210 2024-09-21T01:11:59.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.861+0000 7fe0edd29640 1 -- 172.21.15.148:0/3512062588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e8103620 con 0x7fe0e8103210 2024-09-21T01:11:59.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.863+0000 7fe0e4ff9640 1 -- 172.21.15.148:0/3512062588 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7fe0d800f850 con 0x7fe0e8103210 2024-09-21T01:11:59.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.864+0000 7fe0e4ff9640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0d00b6510 0x7fe0d00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:59.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.864+0000 7fe0e6ffd640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0d00b6510 0x7fe0d00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:59.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.864+0000 7fe0e4ff9640 1 -- 172.21.15.148:0/3512062588 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fe0d80e73a0 con 0x7fe0e8103210 2024-09-21T01:11:59.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.864+0000 7fe0e6ffd640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0d00b6510 0x7fe0d00b8a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009230 tx=0x7fe0dc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:59.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:11:59.867+0000 7fe0e4ff9640 1 -- 172.21.15.148:0/3512062588 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0d8014030 con 0x7fe0e8103210 2024-09-21T01:12:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.080+0000 7fe0edd29640 1 -- 172.21.15.148:0/3512062588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0e81113c0 con 0x7fe0e8103210 2024-09-21T01:12:00.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.081+0000 7fe0e4ff9640 1 -- 172.21.15.148:0/3512062588 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9713 (secure 0 0 0) 0x7fe0e81113c0 con 0x7fe0e8103210 2024-09-21T01:12:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:00.082 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":12,"btime":"2024-09-21T01:11:59:275651+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24619,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24646,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T01:12:00.082 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 12 2024-09-21T01:12:00.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 -- 172.21.15.148:0/3512062588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0d00b6510 msgr2=0x7fe0d00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:00.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0d00b6510 0x7fe0d00b8a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009230 tx=0x7fe0dc031400 comp rx=0 tx=0).stop 2024-09-21T01:12:00.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 -- 172.21.15.148:0/3512062588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e8103210 msgr2=0x7fe0e81100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:00.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e8103210 0x7fe0e81100c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800cce0 tx=0x7fe0d800a620 comp rx=0 tx=0).stop 2024-09-21T01:12:00.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 -- 172.21.15.148:0/3512062588 shutdown_connections 2024-09-21T01:12:00.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0d00b6510 0x7fe0d00b8a20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:00.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0e8105b70 0x7fe0e8110b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:00.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0e8105220 0x7fe0e8110600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:00.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 --2- 172.21.15.148:0/3512062588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e8103210 0x7fe0e81100c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:00.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 -- 172.21.15.148:0/3512062588 >> 172.21.15.148:0/3512062588 conn(0x7fe0e8079ec0 msgr2=0x7fe0e81064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:00.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 -- 172.21.15.148:0/3512062588 shutdown_connections 2024-09-21T01:12:00.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:00.083+0000 7fe0edd29640 1 -- 172.21.15.148:0/3512062588 wait complete. 2024-09-21T01:12:00.456 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:00 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.148:6840/3203788018,v1:172.21.15.148:6841/3203788018] up:boot 2024-09-21T01:12:00.456 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:00 smithi148 ceph-mon[31000]: fsmap 11 up:standby 2024-09-21T01:12:00.456 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:12:00.456 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:00.457 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:00.457 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:00.457 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:12:00.457 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:12:00.457 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:00 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:00.457 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:00 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3512062588' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:12:00.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:00 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.148:6840/3203788018,v1:172.21.15.148:6841/3203788018] up:boot 2024-09-21T01:12:00.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:00 smithi157 ceph-mon[34140]: fsmap 11 up:standby 2024-09-21T01:12:00.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:12:00.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:00.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:00.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:00.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:12:00.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:12:00.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:00 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:00.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:00 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3512062588' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:12:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:00 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.148:6840/3203788018,v1:172.21.15.148:6841/3203788018] up:boot 2024-09-21T01:12:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:00 smithi181 ceph-mon[34811]: fsmap 11 up:standby 2024-09-21T01:12:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:12:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:00.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:12:00.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:12:00.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:00 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:00.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:00 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3512062588' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:12:01.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:01 smithi157 ceph-mon[34140]: Deploying daemon mds.b on smithi157 2024-09-21T01:12:01.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:01 smithi157 ceph-mon[34140]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:01.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:01 smithi148 ceph-mon[31000]: Deploying daemon mds.b on smithi157 2024-09-21T01:12:01.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:01 smithi148 ceph-mon[31000]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:01.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:01 smithi181 ceph-mon[34811]: Deploying daemon mds.b on smithi157 2024-09-21T01:12:01.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:01 smithi181 ceph-mon[34811]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:02.240 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:12:01 smithi157 systemd[1]: Started Ceph mds.b for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:12:02.794 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:12:03.056 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:03.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:03.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:02 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] up:boot 2024-09-21T01:12:03.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:02 smithi148 ceph-mon[31000]: fsmap 12 up:standby 2024-09-21T01:12:03.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:02 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:12:03.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:02 smithi148 ceph-mon[31000]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:03.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:03.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:02 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] up:boot 2024-09-21T01:12:03.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:02 smithi181 ceph-mon[34811]: fsmap 12 up:standby 2024-09-21T01:12:03.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:02 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:12:03.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:02 smithi181 ceph-mon[34811]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:03.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:03.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:03.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:02 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] up:boot 2024-09-21T01:12:03.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:02 smithi157 ceph-mon[34140]: fsmap 12 up:standby 2024-09-21T01:12:03.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:02 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:12:03.241 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:02 smithi157 ceph-mon[34140]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.519+0000 7fc94cfca640 1 -- 172.21.15.148:0/444812463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc948109df0 msgr2=0x7fc948110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.519+0000 7fc94cfca640 1 --2- 172.21.15.148:0/444812463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc948109df0 0x7fc948110620 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc940009ca0 tx=0x7fc94002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.519+0000 7fc94cfca640 1 -- 172.21.15.148:0/444812463 shutdown_connections 2024-09-21T01:12:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.519+0000 7fc94cfca640 1 --2- 172.21.15.148:0/444812463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc948109df0 0x7fc948110620 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.519+0000 7fc94cfca640 1 --2- 172.21.15.148:0/444812463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9481094a0 0x7fc9481098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.519+0000 7fc94cfca640 1 --2- 172.21.15.148:0/444812463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc948103b60 0x7fc948103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.519+0000 7fc94cfca640 1 -- 172.21.15.148:0/444812463 >> 172.21.15.148:0/444812463 conn(0x7fc94807b850 msgr2=0x7fc94807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.520+0000 7fc94cfca640 1 -- 172.21.15.148:0/444812463 shutdown_connections 2024-09-21T01:12:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.520+0000 7fc94cfca640 1 -- 172.21.15.148:0/444812463 wait complete. 2024-09-21T01:12:03.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.520+0000 7fc94cfca640 1 Processor -- start 2024-09-21T01:12:03.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.521+0000 7fc94cfca640 1 -- start start 2024-09-21T01:12:03.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc94cfca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc948103b60 0x7fc948077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:03.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc94cfca640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9481094a0 0x7fc948075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:03.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc94cfca640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc948109df0 0x7fc948075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:03.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc94cfca640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc948113ab0 con 0x7fc948103b60 2024-09-21T01:12:03.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc94cfca640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc948113930 con 0x7fc948109df0 2024-09-21T01:12:03.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc94cfca640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc948113c30 con 0x7fc9481094a0 2024-09-21T01:12:03.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc94659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc948103b60 0x7fc948077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:03.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc93dd9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9481094a0 0x7fc948075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:03.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc93dd9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9481094a0 0x7fc948075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:34776/0 (socket says 172.21.15.148:34776) 2024-09-21T01:12:03.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc93dd9b640 1 -- 172.21.15.148:0/3529292068 learned_addr learned my addr 172.21.15.148:0/3529292068 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:03.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc946d9d640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc948109df0 0x7fc948075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:03.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc93dd9b640 1 -- 172.21.15.148:0/3529292068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc948109df0 msgr2=0x7fc948075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:03.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc93dd9b640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc948109df0 0x7fc948075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc93dd9b640 1 -- 172.21.15.148:0/3529292068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc948103b60 msgr2=0x7fc948077120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:03.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc93dd9b640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc948103b60 0x7fc948077120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc93dd9b640 1 -- 172.21.15.148:0/3529292068 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc948076470 con 0x7fc9481094a0 2024-09-21T01:12:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc946d9d640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc948109df0 0x7fc948075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:12:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.522+0000 7fc94659c640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc948103b60 0x7fc948077120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:12:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.523+0000 7fc93dd9b640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9481094a0 0x7fc948075710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc93000e9f0 tx=0x7fc93000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.523+0000 7fc93ffff640 1 -- 172.21.15.148:0/3529292068 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93000ccc0 con 0x7fc9481094a0 2024-09-21T01:12:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.523+0000 7fc93ffff640 1 -- 172.21.15.148:0/3529292068 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9300108e0 con 0x7fc9481094a0 2024-09-21T01:12:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.523+0000 7fc93ffff640 1 -- 172.21.15.148:0/3529292068 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc930018860 con 0x7fc9481094a0 2024-09-21T01:12:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.523+0000 7fc94cfca640 1 -- 172.21.15.148:0/3529292068 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9481ace00 con 0x7fc9481094a0 2024-09-21T01:12:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.523+0000 7fc94cfca640 1 -- 172.21.15.148:0/3529292068 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9481ad2b0 con 0x7fc9481094a0 2024-09-21T01:12:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.524+0000 7fc94cfca640 1 -- 172.21.15.148:0/3529292068 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc948103f70 con 0x7fc9481094a0 2024-09-21T01:12:03.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.525+0000 7fc93ffff640 1 -- 172.21.15.148:0/3529292068 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7fc930010430 con 0x7fc9481094a0 2024-09-21T01:12:03.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.526+0000 7fc93ffff640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc9340b6590 0x7fc9340b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:03.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.526+0000 7fc94659c640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc9340b6590 0x7fc9340b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.526+0000 7fc93ffff640 1 -- 172.21.15.148:0/3529292068 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fc9300e7180 con 0x7fc9481094a0 2024-09-21T01:12:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.526+0000 7fc94659c640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc9340b6590 0x7fc9340b8aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc94819e310 tx=0x7fc938005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:03.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.530+0000 7fc93ffff640 1 -- 172.21.15.148:0/3529292068 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9300ade90 con 0x7fc9481094a0 2024-09-21T01:12:03.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.761+0000 7fc94cfca640 1 -- 172.21.15.148:0/3529292068 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc94802e640 con 0x7fc9481094a0 2024-09-21T01:12:03.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.762+0000 7fc93ffff640 1 -- 172.21.15.148:0/3529292068 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10539 (secure 0 0 0) 0x7fc9300b2270 con 0x7fc9481094a0 2024-09-21T01:12:03.763 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:03.764 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 13 2024-09-21T01:12:03.764 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":13,"btime":"2024-09-21T01:12:02:288808+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24619,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24646,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T01:12:03.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.764+0000 7fc94cfca640 1 -- 172.21.15.148:0/3529292068 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc9340b6590 msgr2=0x7fc9340b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:03.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.764+0000 7fc94cfca640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc9340b6590 0x7fc9340b8aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc94819e310 tx=0x7fc938005f90 comp rx=0 tx=0).stop 2024-09-21T01:12:03.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.765+0000 7fc94cfca640 1 -- 172.21.15.148:0/3529292068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9481094a0 msgr2=0x7fc948075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:03.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.765+0000 7fc94cfca640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9481094a0 0x7fc948075710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc93000e9f0 tx=0x7fc93000eeb0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.765+0000 7fc94cfca640 1 -- 172.21.15.148:0/3529292068 shutdown_connections 2024-09-21T01:12:03.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.765+0000 7fc94cfca640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc9340b6590 0x7fc9340b8aa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.765+0000 7fc94cfca640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc948109df0 0x7fc948075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.765+0000 7fc94cfca640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9481094a0 0x7fc948075710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.765+0000 7fc94cfca640 1 --2- 172.21.15.148:0/3529292068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc948103b60 0x7fc948077120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.765+0000 7fc94cfca640 1 -- 172.21.15.148:0/3529292068 >> 172.21.15.148:0/3529292068 conn(0x7fc94807b850 msgr2=0x7fc948105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:03.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.765+0000 7fc94cfca640 1 -- 172.21.15.148:0/3529292068 shutdown_connections 2024-09-21T01:12:03.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:03.765+0000 7fc94cfca640 1 -- 172.21.15.148:0/3529292068 wait complete. 2024-09-21T01:12:04.395 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T01:12:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:04 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3529292068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:12:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:04 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:04 smithi148 ceph-mon[31000]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:04.677 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:04 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3529292068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:12:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:04 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:04 smithi181 ceph-mon[34811]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:04.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:04 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3529292068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:12:04.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:04 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:04.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:04 smithi157 ceph-mon[34140]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.153+0000 7f911e05a640 1 -- 172.21.15.148:0/769858364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9118103b80 msgr2=0x7f9118103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.153+0000 7f911e05a640 1 --2- 172.21.15.148:0/769858364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9118103b80 0x7f9118103f90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9108009900 tx=0x7f910802a410 comp rx=0 tx=0).stop 2024-09-21T01:12:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.153+0000 7f911e05a640 1 -- 172.21.15.148:0/769858364 shutdown_connections 2024-09-21T01:12:05.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.153+0000 7f911e05a640 1 --2- 172.21.15.148:0/769858364 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118109e10 0x7f9118110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.153+0000 7f911e05a640 1 --2- 172.21.15.148:0/769858364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91181094c0 0x7f91181098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.153+0000 7f911e05a640 1 --2- 172.21.15.148:0/769858364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9118103b80 0x7f9118103f90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.153+0000 7f911e05a640 1 -- 172.21.15.148:0/769858364 >> 172.21.15.148:0/769858364 conn(0x7f91180ff610 msgr2=0x7f9118101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.153+0000 7f911e05a640 1 -- 172.21.15.148:0/769858364 shutdown_connections 2024-09-21T01:12:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.153+0000 7f911e05a640 1 -- 172.21.15.148:0/769858364 wait complete. 2024-09-21T01:12:05.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.154+0000 7f911e05a640 1 Processor -- start 2024-09-21T01:12:05.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.154+0000 7f911e05a640 1 -- start start 2024-09-21T01:12:05.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.154+0000 7f911e05a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9118103b80 0x7f911819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.154+0000 7f911e05a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91181094c0 0x7f911819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.154+0000 7f911e05a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118109e10 0x7f911819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.154+0000 7f911e05a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9118113ad0 con 0x7f91181094c0 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.154+0000 7f911e05a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9118113950 con 0x7f9118103b80 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.154+0000 7f911e05a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9118113c50 con 0x7f9118109e10 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.154+0000 7f910ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91181094c0 0x7f911819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f910ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91181094c0 0x7f911819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36652/0 (socket says 172.21.15.148:36652) 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f910ffff640 1 -- 172.21.15.148:0/2903165927 learned_addr learned my addr 172.21.15.148:0/2903165927 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f91177fe640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9118103b80 0x7f911819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f9117fff640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118109e10 0x7f911819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f910ffff640 1 -- 172.21.15.148:0/2903165927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118109e10 msgr2=0x7f911819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f910ffff640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118109e10 0x7f911819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f910ffff640 1 -- 172.21.15.148:0/2903165927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9118103b80 msgr2=0x7f911819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f910ffff640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9118103b80 0x7f911819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f910ffff640 1 -- 172.21.15.148:0/2903165927 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91181a03f0 con 0x7f91181094c0 2024-09-21T01:12:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f9117fff640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118109e10 0x7f911819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:12:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f910ffff640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91181094c0 0x7f911819aa20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f910000d740 tx=0x7f910000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f91157fa640 1 -- 172.21.15.148:0/2903165927 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100017070 con 0x7f91181094c0 2024-09-21T01:12:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f911e05a640 1 -- 172.21.15.148:0/2903165927 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91181a06e0 con 0x7f91181094c0 2024-09-21T01:12:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f91157fa640 1 -- 172.21.15.148:0/2903165927 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f910000de50 con 0x7f91181094c0 2024-09-21T01:12:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.155+0000 7f91157fa640 1 -- 172.21.15.148:0/2903165927 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910000f620 con 0x7f91181094c0 2024-09-21T01:12:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.156+0000 7f911e05a640 1 -- 172.21.15.148:0/2903165927 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91181a6e40 con 0x7f91181094c0 2024-09-21T01:12:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.157+0000 7f911e05a640 1 -- 172.21.15.148:0/2903165927 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9118104e00 con 0x7f91181094c0 2024-09-21T01:12:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.158+0000 7f91157fa640 1 -- 172.21.15.148:0/2903165927 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f910001a070 con 0x7f91181094c0 2024-09-21T01:12:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.159+0000 7f91157fa640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91040b6510 0x7f91040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:05.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.159+0000 7f91177fe640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91040b6510 0x7f91040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:05.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.159+0000 7f91157fa640 1 -- 172.21.15.148:0/2903165927 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f91000e6840 con 0x7f91181094c0 2024-09-21T01:12:05.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.160+0000 7f91177fe640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91040b6510 0x7f91040b8a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9108031440 tx=0x7f9108009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:05.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.166+0000 7f91157fa640 1 -- 172.21.15.148:0/2903165927 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91000ad570 con 0x7f91181094c0 2024-09-21T01:12:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.375+0000 7f911e05a640 1 -- 172.21.15.148:0/2903165927 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f911819b5b0 con 0x7f91181094c0 2024-09-21T01:12:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.375+0000 7f91157fa640 1 -- 172.21.15.148:0/2903165927 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7f911819b5b0 con 0x7f91181094c0 2024-09-21T01:12:05.376 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:05.376 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2024-09-21T01:12:05.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:12:05.377 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2024-09-21T01:12:05.377 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": ".mgr" 2024-09-21T01:12:05.377 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:12:05.377 INFO:teuthology.orchestra.run.smithi148.stdout:] 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.377+0000 7f911e05a640 1 -- 172.21.15.148:0/2903165927 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91040b6510 msgr2=0x7f91040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.377+0000 7f911e05a640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91040b6510 0x7f91040b8a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9108031440 tx=0x7f9108009560 comp rx=0 tx=0).stop 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.377+0000 7f911e05a640 1 -- 172.21.15.148:0/2903165927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91181094c0 msgr2=0x7f911819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.377+0000 7f911e05a640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91181094c0 0x7f911819aa20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f910000d740 tx=0x7f910000dc00 comp rx=0 tx=0).stop 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.377+0000 7f911e05a640 1 -- 172.21.15.148:0/2903165927 shutdown_connections 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.377+0000 7f911e05a640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91040b6510 0x7f91040b8a20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.377+0000 7f911e05a640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91181094c0 0x7f911819aa20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.377+0000 7f911e05a640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118109e10 0x7f911819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.377+0000 7f911e05a640 1 --2- 172.21.15.148:0/2903165927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9118103b80 0x7f911819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.378+0000 7f911e05a640 1 -- 172.21.15.148:0/2903165927 >> 172.21.15.148:0/2903165927 conn(0x7f91180ff610 msgr2=0x7f9118101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.378+0000 7f911e05a640 1 -- 172.21.15.148:0/2903165927 shutdown_connections 2024-09-21T01:12:05.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:05.378+0000 7f911e05a640 1 -- 172.21.15.148:0/2903165927 wait complete. 2024-09-21T01:12:05.823 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:05.823 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:05.823 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:05.823 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:05.824 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:05 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:05.824 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:05 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2903165927' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T01:12:05.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:05.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:05.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:05.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:05.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:05 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:05.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:05 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2903165927' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T01:12:05.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:05.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:05.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:05.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:05.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:05 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:05.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:05 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2903165927' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T01:12:06.640 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T01:12:06.640 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T01:12:06.909 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:07.276 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:07 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.276 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:07 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.277 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:07 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.277 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:07 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.277 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:07 smithi148 ceph-mon[31000]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:07.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.369+0000 7f133b869640 1 -- 172.21.15.148:0/606793030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334109e50 msgr2=0x7f1334110680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:07.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.369+0000 7f133b869640 1 --2- 172.21.15.148:0/606793030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334109e50 0x7f1334110680 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f132c009ca0 tx=0x7f132c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.369+0000 7f133b869640 1 -- 172.21.15.148:0/606793030 shutdown_connections 2024-09-21T01:12:07.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.369+0000 7f133b869640 1 --2- 172.21.15.148:0/606793030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334109e50 0x7f1334110680 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.369+0000 7f133b869640 1 --2- 172.21.15.148:0/606793030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1334109500 0x7f1334109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.369+0000 7f133b869640 1 --2- 172.21.15.148:0/606793030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334101fc0 0x7f13341023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.369+0000 7f133b869640 1 -- 172.21.15.148:0/606793030 >> 172.21.15.148:0/606793030 conn(0x7f1334079f90 msgr2=0x7f133407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:07.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.369+0000 7f133b869640 1 -- 172.21.15.148:0/606793030 shutdown_connections 2024-09-21T01:12:07.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.369+0000 7f133b869640 1 -- 172.21.15.148:0/606793030 wait complete. 2024-09-21T01:12:07.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f133b869640 1 Processor -- start 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f133b869640 1 -- start start 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f133b869640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334101fc0 0x7f133419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f133b869640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1334109500 0x7f133419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f133b869640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334109e50 0x7f133419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f133b869640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1334113b10 con 0x7f1334101fc0 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f133b869640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1334113990 con 0x7f1334109e50 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f133b869640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1334113c90 con 0x7f1334109500 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f1339605640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334101fc0 0x7f133419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f1339605640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334101fc0 0x7f133419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33636/0 (socket says 172.21.15.148:33636) 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f1339605640 1 -- 172.21.15.148:0/2396551552 learned_addr learned my addr 172.21.15.148:0/2396551552 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f1339e06640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334109e50 0x7f133419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f1338e04640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1334109500 0x7f133419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f1339605640 1 -- 172.21.15.148:0/2396551552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1334109500 msgr2=0x7f133419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:07.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f1339605640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1334109500 0x7f133419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f1339605640 1 -- 172.21.15.148:0/2396551552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334109e50 msgr2=0x7f133419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f1339605640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334109e50 0x7f133419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.370+0000 7f1339605640 1 -- 172.21.15.148:0/2396551552 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13341a0410 con 0x7f1334101fc0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.371+0000 7f1339605640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334101fc0 0x7f133419a4a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f133000d950 tx=0x7f133000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.371+0000 7f132a7fc640 1 -- 172.21.15.148:0/2396551552 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330017070 con 0x7f1334101fc0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.371+0000 7f132a7fc640 1 -- 172.21.15.148:0/2396551552 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1330009c30 con 0x7f1334101fc0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.371+0000 7f133b869640 1 -- 172.21.15.148:0/2396551552 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13341a0700 con 0x7f1334101fc0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.371+0000 7f132a7fc640 1 -- 172.21.15.148:0/2396551552 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133000f620 con 0x7f1334101fc0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.371+0000 7f133b869640 1 -- 172.21.15.148:0/2396551552 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13341a6e60 con 0x7f1334101fc0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.372+0000 7f133b869640 1 -- 172.21.15.148:0/2396551552 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f133406b910 con 0x7f1334101fc0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.373+0000 7f132a7fc640 1 -- 172.21.15.148:0/2396551552 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f1330010460 con 0x7f1334101fc0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.374+0000 7f132a7fc640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f13200b6510 0x7f13200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.374+0000 7f1338e04640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f13200b6510 0x7f13200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.374+0000 7f132a7fc640 1 -- 172.21.15.148:0/2396551552 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f13300e6a30 con 0x7f1334101fc0 2024-09-21T01:12:07.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.375+0000 7f1338e04640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f13200b6510 0x7f13200b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f133407a8c0 tx=0x7f132400a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:07.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.379+0000 7f132a7fc640 1 -- 172.21.15.148:0/2396551552 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1330009de0 con 0x7f1334101fc0 2024-09-21T01:12:07.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:07 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:07 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:07 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:07 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:07 smithi181 ceph-mon[34811]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:07.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:07 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:07 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:07 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:07 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:07.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:07 smithi157 ceph-mon[34140]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:07.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:07.556+0000 7f133b869640 1 -- 172.21.15.148:0/2396551552 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f133410bc40 con 0x7f1334101fc0 2024-09-21T01:12:08.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.272+0000 7f132a7fc640 1 -- 172.21.15.148:0/2396551552 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7f13300b1b40 con 0x7f1334101fc0 2024-09-21T01:12:08.274 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2024-09-21T01:12:08.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.275+0000 7f133b869640 1 -- 172.21.15.148:0/2396551552 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f13200b6510 msgr2=0x7f13200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:08.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.275+0000 7f133b869640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f13200b6510 0x7f13200b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f133407a8c0 tx=0x7f132400a250 comp rx=0 tx=0).stop 2024-09-21T01:12:08.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.275+0000 7f133b869640 1 -- 172.21.15.148:0/2396551552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334101fc0 msgr2=0x7f133419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:08.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.275+0000 7f133b869640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334101fc0 0x7f133419a4a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f133000d950 tx=0x7f133000de10 comp rx=0 tx=0).stop 2024-09-21T01:12:08.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.275+0000 7f133b869640 1 -- 172.21.15.148:0/2396551552 shutdown_connections 2024-09-21T01:12:08.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.275+0000 7f133b869640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f13200b6510 0x7f13200b8a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:08.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.275+0000 7f133b869640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334109e50 0x7f133419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:08.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.275+0000 7f133b869640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1334109500 0x7f133419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:08.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.275+0000 7f133b869640 1 --2- 172.21.15.148:0/2396551552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334101fc0 0x7f133419a4a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:08.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.275+0000 7f133b869640 1 -- 172.21.15.148:0/2396551552 >> 172.21.15.148:0/2396551552 conn(0x7f1334079f90 msgr2=0x7f1334107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:08.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.276+0000 7f133b869640 1 -- 172.21.15.148:0/2396551552 shutdown_connections 2024-09-21T01:12:08.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:08.276+0000 7f133b869640 1 -- 172.21.15.148:0/2396551552 wait complete. 2024-09-21T01:12:08.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:08 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:08.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:08 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:08.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:08 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:08.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:08 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:08.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:08 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:08.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:08 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2396551552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T01:12:08.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:08 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:08.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:08 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:08.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:08 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:08.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:08 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:08.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:08 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:08.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:08 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2396551552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T01:12:08.601 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:08 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:08.601 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:08 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:08.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:08 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:08.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:08 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:08.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:08 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:12:08.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:08 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2396551552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T01:12:08.950 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T01:12:09.202 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:09.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:09 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2396551552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T01:12:09.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:09 smithi148 ceph-mon[31000]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T01:12:09.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:09 smithi148 ceph-mon[31000]: pgmap v277: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:09.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.682+0000 7f9182497640 1 -- 172.21.15.148:0/987974218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c108d70 msgr2=0x7f917c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:09.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.682+0000 7f9182497640 1 --2- 172.21.15.148:0/987974218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c108d70 0x7f917c10f5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9174009ca0 tx=0x7f917402a8e0 comp rx=0 tx=0).stop 2024-09-21T01:12:09.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.682+0000 7f9182497640 1 -- 172.21.15.148:0/987974218 shutdown_connections 2024-09-21T01:12:09.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.682+0000 7f9182497640 1 --2- 172.21.15.148:0/987974218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c108d70 0x7f917c10f5a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:09.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.682+0000 7f9182497640 1 --2- 172.21.15.148:0/987974218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f917c108420 0x7f917c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:09.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.682+0000 7f9182497640 1 --2- 172.21.15.148:0/987974218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f917c102ae0 0x7f917c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:09.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.682+0000 7f9182497640 1 -- 172.21.15.148:0/987974218 >> 172.21.15.148:0/987974218 conn(0x7f917c079770 msgr2=0x7f917c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:09.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.682+0000 7f9182497640 1 -- 172.21.15.148:0/987974218 shutdown_connections 2024-09-21T01:12:09.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.682+0000 7f9182497640 1 -- 172.21.15.148:0/987974218 wait complete. 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9182497640 1 Processor -- start 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9182497640 1 -- start start 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9182497640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f917c102ae0 0x7f917c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9182497640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f917c108420 0x7f917c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9182497640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c108d70 0x7f917c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9182497640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f917c112a70 con 0x7f917c108d70 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9182497640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f917c1128f0 con 0x7f917c102ae0 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9182497640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f917c112bf0 con 0x7f917c108420 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9180a34640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c108d70 0x7f917c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9180a34640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c108d70 0x7f917c19fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33652/0 (socket says 172.21.15.148:33652) 2024-09-21T01:12:09.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9180a34640 1 -- 172.21.15.148:0/1206251894 learned_addr learned my addr 172.21.15.148:0/1206251894 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f917bfff640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f917c102ae0 0x7f917c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9173fff640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f917c108420 0x7f917c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f917bfff640 1 -- 172.21.15.148:0/1206251894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f917c108420 msgr2=0x7f917c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f917bfff640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f917c108420 0x7f917c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f917bfff640 1 -- 172.21.15.148:0/1206251894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c108d70 msgr2=0x7f917c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f917bfff640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c108d70 0x7f917c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f917bfff640 1 -- 172.21.15.148:0/1206251894 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917c1a0480 con 0x7f917c102ae0 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.683+0000 7f9180a34640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c108d70 0x7f917c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.684+0000 7f917bfff640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f917c102ae0 0x7f917c19a510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f916c00e9f0 tx=0x7f916c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.684+0000 7f9179ffb640 1 -- 172.21.15.148:0/1206251894 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c00ccc0 con 0x7f917c102ae0 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.684+0000 7f9179ffb640 1 -- 172.21.15.148:0/1206251894 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f916c0108e0 con 0x7f917c102ae0 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.684+0000 7f9182497640 1 -- 172.21.15.148:0/1206251894 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917c1a0770 con 0x7f917c102ae0 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.684+0000 7f9179ffb640 1 -- 172.21.15.148:0/1206251894 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c018840 con 0x7f917c102ae0 2024-09-21T01:12:09.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.684+0000 7f9182497640 1 -- 172.21.15.148:0/1206251894 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f917c1a6ed0 con 0x7f917c102ae0 2024-09-21T01:12:09.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.685+0000 7f9182497640 1 -- 172.21.15.148:0/1206251894 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f917c103d60 con 0x7f917c102ae0 2024-09-21T01:12:09.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.687+0000 7f9179ffb640 1 -- 172.21.15.148:0/1206251894 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f916c010430 con 0x7f917c102ae0 2024-09-21T01:12:09.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.687+0000 7f9179ffb640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91680b6590 0x7f91680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:09.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.687+0000 7f9173fff640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91680b6590 0x7f91680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:09.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.688+0000 7f9179ffb640 1 -- 172.21.15.148:0/1206251894 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7497+0+0 (secure 0 0 0) 0x7f916c0e7730 con 0x7f917c102ae0 2024-09-21T01:12:09.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.688+0000 7f9173fff640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91680b6590 0x7f91680b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f917c1053d0 tx=0x7f9164009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:09.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.690+0000 7f9179ffb640 1 -- 172.21.15.148:0/1206251894 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f916c0ae250 con 0x7f917c102ae0 2024-09-21T01:12:09.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:09 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2396551552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T01:12:09.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:09 smithi181 ceph-mon[34811]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T01:12:09.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:09 smithi181 ceph-mon[34811]: pgmap v277: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:09.738 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:09 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2396551552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T01:12:09.738 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:09 smithi157 ceph-mon[34140]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T01:12:09.738 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:09 smithi157 ceph-mon[34140]: pgmap v277: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:09.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:09.871+0000 7f9182497640 1 -- 172.21.15.148:0/1206251894 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f917c10bbd0 con 0x7f917c102ae0 2024-09-21T01:12:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.285+0000 7f9179ffb640 1 -- 172.21.15.148:0/1206251894 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v72) ==== 170+0+0 (secure 0 0 0) 0x7f916c0b2630 con 0x7f917c102ae0 2024-09-21T01:12:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2024-09-21T01:12:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.289+0000 7f9182497640 1 -- 172.21.15.148:0/1206251894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91680b6590 msgr2=0x7f91680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.289+0000 7f9182497640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91680b6590 0x7f91680b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f917c1053d0 tx=0x7f9164009110 comp rx=0 tx=0).stop 2024-09-21T01:12:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.289+0000 7f9182497640 1 -- 172.21.15.148:0/1206251894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f917c102ae0 msgr2=0x7f917c19a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.289+0000 7f9182497640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f917c102ae0 0x7f917c19a510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f916c00e9f0 tx=0x7f916c00edf0 comp rx=0 tx=0).stop 2024-09-21T01:12:10.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.291+0000 7f9182497640 1 -- 172.21.15.148:0/1206251894 shutdown_connections 2024-09-21T01:12:10.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.291+0000 7f9182497640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91680b6590 0x7f91680b8aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:10.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.291+0000 7f9182497640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f917c108d70 0x7f917c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:10.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.291+0000 7f9182497640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f917c108420 0x7f917c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:10.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.291+0000 7f9182497640 1 --2- 172.21.15.148:0/1206251894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f917c102ae0 0x7f917c19a510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:10.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.291+0000 7f9182497640 1 -- 172.21.15.148:0/1206251894 >> 172.21.15.148:0/1206251894 conn(0x7f917c079770 msgr2=0x7f917c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:10.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.291+0000 7f9182497640 1 -- 172.21.15.148:0/1206251894 shutdown_connections 2024-09-21T01:12:10.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:10.291+0000 7f9182497640 1 -- 172.21.15.148:0/1206251894 wait complete. 2024-09-21T01:12:10.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:10 smithi148 ceph-mon[31000]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T01:12:10.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:10 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1206251894' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:12:10.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:10 smithi148 ceph-mon[31000]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:12:10.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:10 smithi181 ceph-mon[34811]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T01:12:10.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:10 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1206251894' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:12:10.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:10 smithi181 ceph-mon[34811]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:12:10.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:10 smithi157 ceph-mon[34140]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T01:12:10.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:10 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1206251894' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:12:10.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:10 smithi157 ceph-mon[34140]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:12:10.940 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T01:12:11.185 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:11.575 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:11 smithi148 ceph-mon[31000]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T01:12:11.575 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:11 smithi148 ceph-mon[31000]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T01:12:11.575 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:11 smithi148 ceph-mon[31000]: pgmap v280: 97 pgs: 87 unknown, 10 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:11.575 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:11 smithi148 ceph-mon[31000]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T01:12:11.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.666+0000 7f3165e67640 1 -- 172.21.15.148:0/1507203254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3160102a80 msgr2=0x7f3160102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:11.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.666+0000 7f3165e67640 1 --2- 172.21.15.148:0/1507203254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3160102a80 0x7f3160102e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3150009900 tx=0x7f315002a410 comp rx=0 tx=0).stop 2024-09-21T01:12:11.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.666+0000 7f3165e67640 1 -- 172.21.15.148:0/1507203254 shutdown_connections 2024-09-21T01:12:11.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.666+0000 7f3165e67640 1 --2- 172.21.15.148:0/1507203254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3160108d10 0x7f316010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:11.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.666+0000 7f3165e67640 1 --2- 172.21.15.148:0/1507203254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31601083c0 0x7f31601087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:11.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.666+0000 7f3165e67640 1 --2- 172.21.15.148:0/1507203254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3160102a80 0x7f3160102e90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:11.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.666+0000 7f3165e67640 1 -- 172.21.15.148:0/1507203254 >> 172.21.15.148:0/1507203254 conn(0x7f3160079740 msgr2=0x7f3160079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:11.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.666+0000 7f3165e67640 1 -- 172.21.15.148:0/1507203254 shutdown_connections 2024-09-21T01:12:11.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.666+0000 7f3165e67640 1 -- 172.21.15.148:0/1507203254 wait complete. 2024-09-21T01:12:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f3165e67640 1 Processor -- start 2024-09-21T01:12:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f3165e67640 1 -- start start 2024-09-21T01:12:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f3165e67640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3160102a80 0x7f316019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f3165e67640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31601083c0 0x7f316019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f3165e67640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3160108d10 0x7f316019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f3165e67640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f31601129e0 con 0x7f3160102a80 2024-09-21T01:12:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f3165e67640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3160112860 con 0x7f3160108d10 2024-09-21T01:12:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f3165e67640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3160112b60 con 0x7f31601083c0 2024-09-21T01:12:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f315f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3160102a80 0x7f316019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f315f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3160102a80 0x7f316019b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33672/0 (socket says 172.21.15.148:33672) 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.667+0000 7f315f7fe640 1 -- 172.21.15.148:0/3808772695 learned_addr learned my addr 172.21.15.148:0/3808772695 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f3157fff640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31601083c0 0x7f316019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f315f7fe640 1 -- 172.21.15.148:0/3808772695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31601083c0 msgr2=0x7f316019b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f315f7fe640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31601083c0 0x7f316019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f315f7fe640 1 -- 172.21.15.148:0/3808772695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3160108d10 msgr2=0x7f316019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f315f7fe640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3160108d10 0x7f316019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f315f7fe640 1 -- 172.21.15.148:0/3808772695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31601a65b0 con 0x7f3160102a80 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f315f7fe640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3160102a80 0x7f316019b2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3150005940 tx=0x7f31500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f315d7fa640 1 -- 172.21.15.148:0/3808772695 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315003f030 con 0x7f3160102a80 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f315d7fa640 1 -- 172.21.15.148:0/3808772695 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3150003cb0 con 0x7f3160102a80 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f315d7fa640 1 -- 172.21.15.148:0/3808772695 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150035070 con 0x7f3160102a80 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f3165e67640 1 -- 172.21.15.148:0/3808772695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31601a6840 con 0x7f3160102a80 2024-09-21T01:12:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.668+0000 7f3165e67640 1 -- 172.21.15.148:0/3808772695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31601a6df0 con 0x7f3160102a80 2024-09-21T01:12:11.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.669+0000 7f3165e67640 1 -- 172.21.15.148:0/3808772695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3160103d00 con 0x7f3160102a80 2024-09-21T01:12:11.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.671+0000 7f315d7fa640 1 -- 172.21.15.148:0/3808772695 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f3150042030 con 0x7f3160102a80 2024-09-21T01:12:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.671+0000 7f315d7fa640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f314c0b6590 0x7f314c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.672+0000 7f3157fff640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f314c0b6590 0x7f314c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.672+0000 7f315d7fa640 1 -- 172.21.15.148:0/3808772695 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7879+0+0 (secure 0 0 0) 0x7f3150107d00 con 0x7f3160102a80 2024-09-21T01:12:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.672+0000 7f3157fff640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f314c0b6590 0x7f314c0b8aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3148005fd0 tx=0x7f3148005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:11.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.675+0000 7f315d7fa640 1 -- 172.21.15.148:0/3808772695 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31500ce740 con 0x7f3160102a80 2024-09-21T01:12:11.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:11 smithi181 ceph-mon[34811]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T01:12:11.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:11 smithi181 ceph-mon[34811]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T01:12:11.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:11 smithi181 ceph-mon[34811]: pgmap v280: 97 pgs: 87 unknown, 10 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:11.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:11 smithi181 ceph-mon[34811]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T01:12:11.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:11 smithi157 ceph-mon[34140]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T01:12:11.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:11 smithi157 ceph-mon[34140]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T01:12:11.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:11 smithi157 ceph-mon[34140]: pgmap v280: 97 pgs: 87 unknown, 10 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:11.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:11 smithi157 ceph-mon[34140]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T01:12:11.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:11.891+0000 7f3165e67640 1 -- 172.21.15.148:0/3808772695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f316006bf70 con 0x7f3160102a80 2024-09-21T01:12:12.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.314+0000 7f315d7fa640 1 -- 172.21.15.148:0/3808772695 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f31500d2b20 con 0x7f3160102a80 2024-09-21T01:12:12.316 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T01:12:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 -- 172.21.15.148:0/3808772695 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f314c0b6590 msgr2=0x7f314c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f314c0b6590 0x7f314c0b8aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3148005fd0 tx=0x7f3148005850 comp rx=0 tx=0).stop 2024-09-21T01:12:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 -- 172.21.15.148:0/3808772695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3160102a80 msgr2=0x7f316019b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3160102a80 0x7f316019b2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3150005940 tx=0x7f31500042f0 comp rx=0 tx=0).stop 2024-09-21T01:12:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 -- 172.21.15.148:0/3808772695 shutdown_connections 2024-09-21T01:12:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f314c0b6590 0x7f314c0b8aa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3160108d10 0x7f316019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31601083c0 0x7f316019b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 --2- 172.21.15.148:0/3808772695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3160102a80 0x7f316019b2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 -- 172.21.15.148:0/3808772695 >> 172.21.15.148:0/3808772695 conn(0x7f3160079740 msgr2=0x7f3160101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 -- 172.21.15.148:0/3808772695 shutdown_connections 2024-09-21T01:12:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:12.316+0000 7f3165e67640 1 -- 172.21.15.148:0/3808772695 wait complete. 2024-09-21T01:12:12.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:12 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3808772695' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T01:12:12.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:12 smithi148 ceph-mon[31000]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T01:12:12.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:12 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3808772695' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T01:12:12.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:12 smithi181 ceph-mon[34811]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T01:12:12.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:12 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3808772695' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T01:12:12.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:12 smithi157 ceph-mon[34140]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T01:12:12.947 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:12:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:13.571 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:13 smithi148 ceph-mon[31000]: pgmap v282: 97 pgs: 5 creating+activating, 22 creating+peering, 30 unknown, 40 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:13.571 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:13 smithi148 ceph-mon[31000]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T01:12:13.571 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:13 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3808772695' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T01:12:13.571 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:13 smithi148 ceph-mon[31000]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T01:12:13.571 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:13 smithi148 ceph-mon[31000]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T01:12:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.659+0000 7f7889dda640 1 -- 172.21.15.148:0/1105742595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7884102ac0 msgr2=0x7f7884102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.659+0000 7f7889dda640 1 --2- 172.21.15.148:0/1105742595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7884102ac0 0x7f7884102ed0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7874009900 tx=0x7f787402a410 comp rx=0 tx=0).stop 2024-09-21T01:12:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.659+0000 7f7889dda640 1 -- 172.21.15.148:0/1105742595 shutdown_connections 2024-09-21T01:12:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.659+0000 7f7889dda640 1 --2- 172.21.15.148:0/1105742595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884108d00 0x7f788410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.659+0000 7f7889dda640 1 --2- 172.21.15.148:0/1105742595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78841083b0 0x7f78841087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.659+0000 7f7889dda640 1 --2- 172.21.15.148:0/1105742595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7884102ac0 0x7f7884102ed0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.659+0000 7f7889dda640 1 -- 172.21.15.148:0/1105742595 >> 172.21.15.148:0/1105742595 conn(0x7f7884079790 msgr2=0x7f7884079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.659+0000 7f7889dda640 1 -- 172.21.15.148:0/1105742595 shutdown_connections 2024-09-21T01:12:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.659+0000 7f7889dda640 1 -- 172.21.15.148:0/1105742595 wait complete. 2024-09-21T01:12:13.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.660+0000 7f7889dda640 1 Processor -- start 2024-09-21T01:12:13.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.660+0000 7f7889dda640 1 -- start start 2024-09-21T01:12:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.660+0000 7f7889dda640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884102ac0 0x7f788419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.660+0000 7f7889dda640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78841083b0 0x7f788419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.660+0000 7f7889dda640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7884108d00 0x7f788419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.661+0000 7f7889dda640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f78841129c0 con 0x7f7884108d00 2024-09-21T01:12:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.661+0000 7f7889dda640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7884112840 con 0x7f78841083b0 2024-09-21T01:12:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.661+0000 7f7889dda640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7884112b40 con 0x7f7884102ac0 2024-09-21T01:12:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.661+0000 7f7883fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7884108d00 0x7f788419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:13.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.661+0000 7f7883fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7884108d00 0x7f788419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33684/0 (socket says 172.21.15.148:33684) 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.661+0000 7f7883fff640 1 -- 172.21.15.148:0/8894493 learned_addr learned my addr 172.21.15.148:0/8894493 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.661+0000 7f78837fe640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884102ac0 0x7f788419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.661+0000 7f787bfff640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78841083b0 0x7f788419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f7883fff640 1 -- 172.21.15.148:0/8894493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884102ac0 msgr2=0x7f788419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f7883fff640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884102ac0 0x7f788419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f7883fff640 1 -- 172.21.15.148:0/8894493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78841083b0 msgr2=0x7f788419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f7883fff640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78841083b0 0x7f788419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f7883fff640 1 -- 172.21.15.148:0/8894493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78841a03d0 con 0x7f7884108d00 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f787bfff640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78841083b0 0x7f788419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f7883fff640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7884108d00 0x7f788419fca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f787c00eaa0 tx=0x7f787c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f78817fa640 1 -- 172.21.15.148:0/8894493 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c00cdb0 con 0x7f7884108d00 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f7889dda640 1 -- 172.21.15.148:0/8894493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78841a06c0 con 0x7f7884108d00 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f78817fa640 1 -- 172.21.15.148:0/8894493 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f787c005020 con 0x7f7884108d00 2024-09-21T01:12:13.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f78817fa640 1 -- 172.21.15.148:0/8894493 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c0116d0 con 0x7f7884108d00 2024-09-21T01:12:13.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.662+0000 7f7889dda640 1 -- 172.21.15.148:0/8894493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78841a6e20 con 0x7f7884108d00 2024-09-21T01:12:13.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.663+0000 7f7889dda640 1 -- 172.21.15.148:0/8894493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7884102ed0 con 0x7f7884108d00 2024-09-21T01:12:13.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.665+0000 7f78817fa640 1 -- 172.21.15.148:0/8894493 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f787c0051d0 con 0x7f7884108d00 2024-09-21T01:12:13.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.665+0000 7f78817fa640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78700b6510 0x7f78700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:13.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.665+0000 7f78837fe640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78700b6510 0x7f78700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:13.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.665+0000 7f78817fa640 1 -- 172.21.15.148:0/8894493 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f787c0e76e0 con 0x7f7884108d00 2024-09-21T01:12:13.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.666+0000 7f78837fe640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78700b6510 0x7f78700b8a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7874031440 tx=0x7f7874009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:13.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.668+0000 7f78817fa640 1 -- 172.21.15.148:0/8894493 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f787c016030 con 0x7f7884108d00 2024-09-21T01:12:13.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:13 smithi181 ceph-mon[34811]: pgmap v282: 97 pgs: 5 creating+activating, 22 creating+peering, 30 unknown, 40 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:13.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:13 smithi181 ceph-mon[34811]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T01:12:13.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:13 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3808772695' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T01:12:13.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:13 smithi181 ceph-mon[34811]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T01:12:13.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:13 smithi181 ceph-mon[34811]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T01:12:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:13 smithi157 ceph-mon[34140]: pgmap v282: 97 pgs: 5 creating+activating, 22 creating+peering, 30 unknown, 40 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:12:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:13 smithi157 ceph-mon[34140]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T01:12:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:13 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3808772695' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T01:12:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:13 smithi157 ceph-mon[34140]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T01:12:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:13 smithi157 ceph-mon[34140]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T01:12:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.849+0000 7f7889dda640 1 -- 172.21.15.148:0/8894493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f788419b590 con 0x7f7884108d00 2024-09-21T01:12:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.851+0000 7f78817fa640 1 -- 172.21.15.148:0/8894493 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22386 (secure 0 0 0) 0x7f788419b590 con 0x7f7884108d00 2024-09-21T01:12:13.853 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:13.854 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:11.894328+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:12:13.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 -- 172.21.15.148:0/8894493 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78700b6510 msgr2=0x7f78700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:13.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78700b6510 0x7f78700b8a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7874031440 tx=0x7f7874009560 comp rx=0 tx=0).stop 2024-09-21T01:12:13.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 -- 172.21.15.148:0/8894493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7884108d00 msgr2=0x7f788419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:13.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7884108d00 0x7f788419fca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f787c00eaa0 tx=0x7f787c00ef60 comp rx=0 tx=0).stop 2024-09-21T01:12:13.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 -- 172.21.15.148:0/8894493 shutdown_connections 2024-09-21T01:12:13.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78700b6510 0x7f78700b8a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:13.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7884108d00 0x7f788419fca0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:13.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78841083b0 0x7f788419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:13.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 --2- 172.21.15.148:0/8894493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7884102ac0 0x7f788419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:13.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 -- 172.21.15.148:0/8894493 >> 172.21.15.148:0/8894493 conn(0x7f7884079790 msgr2=0x7f7884101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:13.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 -- 172.21.15.148:0/8894493 shutdown_connections 2024-09-21T01:12:13.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:13.854+0000 7f7889dda640 1 -- 172.21.15.148:0/8894493 wait complete. 2024-09-21T01:12:14.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:14 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] up:active 2024-09-21T01:12:14.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:14 smithi148 ceph-mon[31000]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:14.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:14 smithi148 ceph-mon[31000]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:14.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:14 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/8894493' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:14.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:14 smithi148 ceph-mon[31000]: pgmap v284: 97 pgs: 5 creating+activating, 22 creating+peering, 21 unknown, 49 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T01:12:14.504 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:12:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:14 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] up:active 2024-09-21T01:12:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:14 smithi181 ceph-mon[34811]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:14 smithi181 ceph-mon[34811]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:14 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/8894493' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:14 smithi181 ceph-mon[34811]: pgmap v284: 97 pgs: 5 creating+activating, 22 creating+peering, 21 unknown, 49 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T01:12:14.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:14 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] up:active 2024-09-21T01:12:14.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:14 smithi157 ceph-mon[34140]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:14.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:14 smithi157 ceph-mon[34140]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:14.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:14 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/8894493' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:14.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:14 smithi157 ceph-mon[34140]: pgmap v284: 97 pgs: 5 creating+activating, 22 creating+peering, 21 unknown, 49 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T01:12:14.748 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.235+0000 7ff88db24640 1 -- 172.21.15.148:0/90978394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8881083a0 msgr2=0x7ff8881087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.235+0000 7ff88db24640 1 --2- 172.21.15.148:0/90978394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8881083a0 0x7ff8881087b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff870009900 tx=0x7ff87002a410 comp rx=0 tx=0).stop 2024-09-21T01:12:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.235+0000 7ff88db24640 1 -- 172.21.15.148:0/90978394 shutdown_connections 2024-09-21T01:12:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.235+0000 7ff88db24640 1 --2- 172.21.15.148:0/90978394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8881083a0 0x7ff8881087b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.235+0000 7ff88db24640 1 --2- 172.21.15.148:0/90978394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff888108cf0 0x7ff88810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.235+0000 7ff88db24640 1 --2- 172.21.15.148:0/90978394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff888102a60 0x7ff888102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:15.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.235+0000 7ff88db24640 1 -- 172.21.15.148:0/90978394 >> 172.21.15.148:0/90978394 conn(0x7ff888079730 msgr2=0x7ff888079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:15.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.235+0000 7ff88db24640 1 -- 172.21.15.148:0/90978394 shutdown_connections 2024-09-21T01:12:15.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.235+0000 7ff88db24640 1 -- 172.21.15.148:0/90978394 wait complete. 2024-09-21T01:12:15.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.236+0000 7ff88db24640 1 Processor -- start 2024-09-21T01:12:15.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.236+0000 7ff88db24640 1 -- start start 2024-09-21T01:12:15.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.236+0000 7ff88db24640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff888102a60 0x7ff88819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:15.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.236+0000 7ff88db24640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8881083a0 0x7ff88819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:15.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.236+0000 7ff88db24640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff888108cf0 0x7ff88819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.236+0000 7ff88db24640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff888112960 con 0x7ff8881083a0 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.236+0000 7ff88db24640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff8881127e0 con 0x7ff888102a60 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.236+0000 7ff88db24640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff888112ae0 con 0x7ff888108cf0 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.236+0000 7ff87ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8881083a0 0x7ff88819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.236+0000 7ff87ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8881083a0 0x7ff88819b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33700/0 (socket says 172.21.15.148:33700) 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff87ffff640 1 -- 172.21.15.148:0/429380846 learned_addr learned my addr 172.21.15.148:0/429380846 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff8877fe640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff888102a60 0x7ff88819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff887fff640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff888108cf0 0x7ff88819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff87ffff640 1 -- 172.21.15.148:0/429380846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff888108cf0 msgr2=0x7ff88819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff87ffff640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff888108cf0 0x7ff88819bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff87ffff640 1 -- 172.21.15.148:0/429380846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff888102a60 msgr2=0x7ff88819b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff87ffff640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff888102a60 0x7ff88819b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff87ffff640 1 -- 172.21.15.148:0/429380846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8881a65b0 con 0x7ff8881083a0 2024-09-21T01:12:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff87ffff640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8881083a0 0x7ff88819b830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff870032fd0 tx=0x7ff870004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:15.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff8857fa640 1 -- 172.21.15.148:0/429380846 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87003f030 con 0x7ff8881083a0 2024-09-21T01:12:15.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff8857fa640 1 -- 172.21.15.148:0/429380846 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff870004490 con 0x7ff8881083a0 2024-09-21T01:12:15.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff88db24640 1 -- 172.21.15.148:0/429380846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8881a6840 con 0x7ff8881083a0 2024-09-21T01:12:15.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff8857fa640 1 -- 172.21.15.148:0/429380846 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870035070 con 0x7ff8881083a0 2024-09-21T01:12:15.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.237+0000 7ff88db24640 1 -- 172.21.15.148:0/429380846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8881a6d70 con 0x7ff8881083a0 2024-09-21T01:12:15.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.238+0000 7ff88db24640 1 -- 172.21.15.148:0/429380846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff888102e70 con 0x7ff8881083a0 2024-09-21T01:12:15.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.240+0000 7ff8857fa640 1 -- 172.21.15.148:0/429380846 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7ff870042030 con 0x7ff8881083a0 2024-09-21T01:12:15.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.241+0000 7ff8857fa640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff8740b6590 0x7ff8740b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:15.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.241+0000 7ff8877fe640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff8740b6590 0x7ff8740b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.241+0000 7ff8857fa640 1 -- 172.21.15.148:0/429380846 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7ff870107ac0 con 0x7ff8881083a0 2024-09-21T01:12:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.241+0000 7ff8877fe640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff8740b6590 0x7ff8740b8aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff88806b9e0 tx=0x7ff87800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.244+0000 7ff8857fa640 1 -- 172.21.15.148:0/429380846 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8700ce4a0 con 0x7ff8881083a0 2024-09-21T01:12:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.425+0000 7ff88db24640 1 -- 172.21.15.148:0/429380846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff88802e640 con 0x7ff8881083a0 2024-09-21T01:12:15.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.426+0000 7ff8857fa640 1 -- 172.21.15.148:0/429380846 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22386 (secure 0 0 0) 0x7ff8700d2880 con 0x7ff8881083a0 2024-09-21T01:12:15.427 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:15.427 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:11.894328+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.428+0000 7ff88db24640 1 -- 172.21.15.148:0/429380846 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff8740b6590 msgr2=0x7ff8740b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff8740b6590 0x7ff8740b8aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff88806b9e0 tx=0x7ff87800b390 comp rx=0 tx=0).stop 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 -- 172.21.15.148:0/429380846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8881083a0 msgr2=0x7ff88819b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8881083a0 0x7ff88819b830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff870032fd0 tx=0x7ff870004270 comp rx=0 tx=0).stop 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 -- 172.21.15.148:0/429380846 shutdown_connections 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff8740b6590 0x7ff8740b8aa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8881083a0 0x7ff88819b830 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff888108cf0 0x7ff88819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 --2- 172.21.15.148:0/429380846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff888102a60 0x7ff88819b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 -- 172.21.15.148:0/429380846 >> 172.21.15.148:0/429380846 conn(0x7ff888079730 msgr2=0x7ff888104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 -- 172.21.15.148:0/429380846 shutdown_connections 2024-09-21T01:12:15.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:15.429+0000 7ff88db24640 1 -- 172.21.15.148:0/429380846 wait complete. 2024-09-21T01:12:15.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:15 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/429380846' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:15.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:15 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/429380846' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:15.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:15 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/429380846' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:16.105 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T01:12:16.354 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:16.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:16 smithi157 ceph-mon[34140]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-21T01:12:16.745 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:16 smithi148 ceph-mon[31000]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-21T01:12:16.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.837+0000 7fd73c351640 1 -- 172.21.15.148:0/2899768304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd734108cf0 msgr2=0x7fd73410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:16.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.837+0000 7fd73c351640 1 --2- 172.21.15.148:0/2899768304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd734108cf0 0x7fd73410f520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009900 tx=0x7fd72c02a410 comp rx=0 tx=0).stop 2024-09-21T01:12:16.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.837+0000 7fd73c351640 1 -- 172.21.15.148:0/2899768304 shutdown_connections 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.837+0000 7fd73c351640 1 --2- 172.21.15.148:0/2899768304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd734108cf0 0x7fd73410f520 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.837+0000 7fd73c351640 1 --2- 172.21.15.148:0/2899768304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7341083a0 0x7fd7341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.837+0000 7fd73c351640 1 --2- 172.21.15.148:0/2899768304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd734102a60 0x7fd734102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.837+0000 7fd73c351640 1 -- 172.21.15.148:0/2899768304 >> 172.21.15.148:0/2899768304 conn(0x7fd734079730 msgr2=0x7fd734079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.837+0000 7fd73c351640 1 -- 172.21.15.148:0/2899768304 shutdown_connections 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.837+0000 7fd73c351640 1 -- 172.21.15.148:0/2899768304 wait complete. 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.838+0000 7fd73c351640 1 Processor -- start 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.838+0000 7fd73c351640 1 -- start start 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.838+0000 7fd73c351640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd734102a60 0x7fd73419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.838+0000 7fd73c351640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7341083a0 0x7fd73419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.838+0000 7fd73c351640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd734108cf0 0x7fd73419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:16.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.838+0000 7fd73c351640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd734113a70 con 0x7fd734108cf0 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.838+0000 7fd73c351640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341138f0 con 0x7fd7341083a0 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.838+0000 7fd73c351640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd734113bf0 con 0x7fd734102a60 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73a8ee640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd734108cf0 0x7fd73419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73a8ee640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd734108cf0 0x7fd73419fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42394/0 (socket says 172.21.15.148:42394) 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73a8ee640 1 -- 172.21.15.148:0/2889713709 learned_addr learned my addr 172.21.15.148:0/2889713709 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73a0ed640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd734102a60 0x7fd73419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd7398ec640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7341083a0 0x7fd73419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73a8ee640 1 -- 172.21.15.148:0/2889713709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd734102a60 msgr2=0x7fd73419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73a8ee640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd734102a60 0x7fd73419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73a8ee640 1 -- 172.21.15.148:0/2889713709 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7341083a0 msgr2=0x7fd73419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73a8ee640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7341083a0 0x7fd73419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73a8ee640 1 -- 172.21.15.148:0/2889713709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7341a0350 con 0x7fd734108cf0 2024-09-21T01:12:16.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd7398ec640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7341083a0 0x7fd73419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73a8ee640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd734108cf0 0x7fd73419fce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd72c004770 tx=0x7fd72c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd7337fe640 1 -- 172.21.15.148:0/2889713709 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c03f030 con 0x7fd734108cf0 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd7337fe640 1 -- 172.21.15.148:0/2889713709 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd72c003aa0 con 0x7fd734108cf0 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd7337fe640 1 -- 172.21.15.148:0/2889713709 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c035070 con 0x7fd734108cf0 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73c351640 1 -- 172.21.15.148:0/2889713709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7341a05e0 con 0x7fd734108cf0 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.839+0000 7fd73c351640 1 -- 172.21.15.148:0/2889713709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7341a0b10 con 0x7fd734108cf0 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.840+0000 7fd73c351640 1 -- 172.21.15.148:0/2889713709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd734102e70 con 0x7fd734108cf0 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.842+0000 7fd7337fe640 1 -- 172.21.15.148:0/2889713709 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7fd72c042030 con 0x7fd734108cf0 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.842+0000 7fd7337fe640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd71c0b65c0 0x7fd71c0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.843+0000 7fd73a0ed640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd71c0b65c0 0x7fd71c0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.843+0000 7fd7337fe640 1 -- 172.21.15.148:0/2889713709 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fd72c107c50 con 0x7fd734108cf0 2024-09-21T01:12:16.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.843+0000 7fd73a0ed640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd71c0b65c0 0x7fd71c0b8ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd724005fd0 tx=0x7fd7240098b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:16.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:16.846+0000 7fd7337fe640 1 -- 172.21.15.148:0/2889713709 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7341a0b10 con 0x7fd734108cf0 2024-09-21T01:12:16.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:16 smithi181 ceph-mon[34811]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-21T01:12:17.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.059+0000 7fd73c351640 1 -- 172.21.15.148:0/2889713709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd73419b5d0 con 0x7fd734108cf0 2024-09-21T01:12:17.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.493+0000 7fd7337fe640 1 -- 172.21.15.148:0/2889713709 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fd73419b5d0 con 0x7fd734108cf0 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 -- 172.21.15.148:0/2889713709 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd71c0b65c0 msgr2=0x7fd71c0b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd71c0b65c0 0x7fd71c0b8ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd724005fd0 tx=0x7fd7240098b0 comp rx=0 tx=0).stop 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 -- 172.21.15.148:0/2889713709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd734108cf0 msgr2=0x7fd73419fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd734108cf0 0x7fd73419fce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd72c004770 tx=0x7fd72c004270 comp rx=0 tx=0).stop 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 -- 172.21.15.148:0/2889713709 shutdown_connections 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd71c0b65c0 0x7fd71c0b8ad0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd734108cf0 0x7fd73419fce0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7341083a0 0x7fd73419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 --2- 172.21.15.148:0/2889713709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd734102a60 0x7fd73419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 -- 172.21.15.148:0/2889713709 >> 172.21.15.148:0/2889713709 conn(0x7fd734079730 msgr2=0x7fd734104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:17.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 -- 172.21.15.148:0/2889713709 shutdown_connections 2024-09-21T01:12:17.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:17.496+0000 7fd73c351640 1 -- 172.21.15.148:0/2889713709 wait complete. 2024-09-21T01:12:17.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:17 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2889713709' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T01:12:17.741 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:12:17 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b[62559]: 2024-09-21T01:12:17.299+0000 7ff286142640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T01:12:17.840 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:17 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2889713709' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T01:12:17.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:17 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2889713709' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T01:12:18.145 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-21T01:12:18.145 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T01:12:18.389 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:18.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:18 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2889713709' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T01:12:18.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:18 smithi181 ceph-mon[34811]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:18.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:18 smithi181 ceph-mon[34811]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T01:12:18.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:18 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2889713709' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T01:12:18.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:18 smithi148 ceph-mon[31000]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:18.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:18 smithi148 ceph-mon[31000]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.887+0000 7f8d65e80640 1 -- 172.21.15.148:0/1737944834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d60108cf0 msgr2=0x7f8d6010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.887+0000 7f8d65e80640 1 --2- 172.21.15.148:0/1737944834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d60108cf0 0x7f8d6010f520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009900 tx=0x7f8d5802a410 comp rx=0 tx=0).stop 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.887+0000 7f8d65e80640 1 -- 172.21.15.148:0/1737944834 shutdown_connections 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.887+0000 7f8d65e80640 1 --2- 172.21.15.148:0/1737944834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d60108cf0 0x7f8d6010f520 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.887+0000 7f8d65e80640 1 --2- 172.21.15.148:0/1737944834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d601083a0 0x7f8d601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.887+0000 7f8d65e80640 1 --2- 172.21.15.148:0/1737944834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d60102a60 0x7f8d60102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.887+0000 7f8d65e80640 1 -- 172.21.15.148:0/1737944834 >> 172.21.15.148:0/1737944834 conn(0x7f8d60079730 msgr2=0x7f8d60079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.887+0000 7f8d65e80640 1 -- 172.21.15.148:0/1737944834 shutdown_connections 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.887+0000 7f8d65e80640 1 -- 172.21.15.148:0/1737944834 wait complete. 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.888+0000 7f8d65e80640 1 Processor -- start 2024-09-21T01:12:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.888+0000 7f8d65e80640 1 -- start start 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.888+0000 7f8d65e80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d60102a60 0x7f8d60199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.888+0000 7f8d65e80640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d601083a0 0x7f8d601999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.888+0000 7f8d65e80640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d60108cf0 0x7f8d6019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.888+0000 7f8d65e80640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601129c0 con 0x7f8d60102a60 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.888+0000 7f8d65e80640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60112840 con 0x7f8d60108cf0 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.888+0000 7f8d65e80640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60112b40 con 0x7f8d601083a0 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d60102a60 0x7f8d60199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d60102a60 0x7f8d60199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42410/0 (socket says 172.21.15.148:42410) 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5f7fe640 1 -- 172.21.15.148:0/3689659528 learned_addr learned my addr 172.21.15.148:0/3689659528 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5effd640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d601083a0 0x7f8d601999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5ffff640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d60108cf0 0x7f8d6019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5f7fe640 1 -- 172.21.15.148:0/3689659528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d601083a0 msgr2=0x7f8d601999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:18.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5f7fe640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d601083a0 0x7f8d601999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5f7fe640 1 -- 172.21.15.148:0/3689659528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d60108cf0 msgr2=0x7f8d6019ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5f7fe640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d60108cf0 0x7f8d6019ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5f7fe640 1 -- 172.21.15.148:0/3689659528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6019f2c0 con 0x7f8d60102a60 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5effd640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d601083a0 0x7f8d601999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5f7fe640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d60102a60 0x7f8d60199410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000ba50 tx=0x7f8d5000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5cff9640 1 -- 172.21.15.148:0/3689659528 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d50019070 con 0x7f8d60102a60 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d65e80640 1 -- 172.21.15.148:0/3689659528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6019f5b0 con 0x7f8d60102a60 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5cff9640 1 -- 172.21.15.148:0/3689659528 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d5000cbe0 con 0x7f8d60102a60 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d5cff9640 1 -- 172.21.15.148:0/3689659528 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d500075d0 con 0x7f8d60102a60 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.889+0000 7f8d65e80640 1 -- 172.21.15.148:0/3689659528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d601a5dd0 con 0x7f8d60102a60 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.890+0000 7f8d65e80640 1 -- 172.21.15.148:0/3689659528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d60102e70 con 0x7f8d60102a60 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.893+0000 7f8d5cff9640 1 -- 172.21.15.148:0/3689659528 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f8d5001c070 con 0x7f8d60102a60 2024-09-21T01:12:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.894+0000 7f8d5cff9640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8d480b6540 0x7f8d480b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:18.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.894+0000 7f8d5effd640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8d480b6540 0x7f8d480b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:18.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.894+0000 7f8d5cff9640 1 -- 172.21.15.148:0/3689659528 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f8d500e6be0 con 0x7f8d60102a60 2024-09-21T01:12:18.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.894+0000 7f8d5effd640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8d480b6540 0x7f8d480b8a50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8d60107bb0 tx=0x7f8d54005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:18.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:18.897+0000 7f8d5cff9640 1 -- 172.21.15.148:0/3689659528 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8d500ad5c0 con 0x7f8d60102a60 2024-09-21T01:12:18.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:18 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2889713709' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T01:12:18.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:18 smithi157 ceph-mon[34140]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:18.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:18 smithi157 ceph-mon[34140]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T01:12:19.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.114+0000 7f8d65e80640 1 -- 172.21.15.148:0/3689659528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f8d6002e640 con 0x7f8d60102a60 2024-09-21T01:12:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.506+0000 7f8d5cff9640 1 -- 172.21.15.148:0/3689659528 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f8d500b19a0 con 0x7f8d60102a60 2024-09-21T01:12:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.508+0000 7f8d65e80640 1 -- 172.21.15.148:0/3689659528 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8d480b6540 msgr2=0x7f8d480b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.508+0000 7f8d65e80640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8d480b6540 0x7f8d480b8a50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8d60107bb0 tx=0x7f8d54005d90 comp rx=0 tx=0).stop 2024-09-21T01:12:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.508+0000 7f8d65e80640 1 -- 172.21.15.148:0/3689659528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d60102a60 msgr2=0x7f8d60199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.508+0000 7f8d65e80640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d60102a60 0x7f8d60199410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000ba50 tx=0x7f8d5000bf10 comp rx=0 tx=0).stop 2024-09-21T01:12:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.509+0000 7f8d65e80640 1 -- 172.21.15.148:0/3689659528 shutdown_connections 2024-09-21T01:12:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.509+0000 7f8d65e80640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8d480b6540 0x7f8d480b8a50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.509+0000 7f8d65e80640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d60108cf0 0x7f8d6019ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.509+0000 7f8d65e80640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d601083a0 0x7f8d601999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.509+0000 7f8d65e80640 1 --2- 172.21.15.148:0/3689659528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d60102a60 0x7f8d60199410 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.509+0000 7f8d65e80640 1 -- 172.21.15.148:0/3689659528 >> 172.21.15.148:0/3689659528 conn(0x7f8d60079730 msgr2=0x7f8d601052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.509+0000 7f8d65e80640 1 -- 172.21.15.148:0/3689659528 shutdown_connections 2024-09-21T01:12:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:19.509+0000 7f8d65e80640 1 -- 172.21.15.148:0/3689659528 wait complete. 2024-09-21T01:12:19.809 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:19 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3689659528' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T01:12:19.824 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:19 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3689659528' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T01:12:19.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:19 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3689659528' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T01:12:20.163 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T01:12:20.410 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:20.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:20 smithi148 ceph-mon[31000]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T01:12:20.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:20 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3689659528' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T01:12:20.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:20 smithi148 ceph-mon[31000]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T01:12:20.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:20 smithi148 ceph-mon[31000]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:20.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:20 smithi148 ceph-mon[31000]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T01:12:20.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:20 smithi148 ceph-mon[31000]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T01:12:20.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:20 smithi148 ceph-mon[31000]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T01:12:20.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.871+0000 7ff305efd640 1 -- 172.21.15.148:0/2516294313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3001083a0 msgr2=0x7ff3001087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:20.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.871+0000 7ff305efd640 1 --2- 172.21.15.148:0/2516294313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3001083a0 0x7ff3001087b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009900 tx=0x7ff2f402a410 comp rx=0 tx=0).stop 2024-09-21T01:12:20.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.871+0000 7ff305efd640 1 -- 172.21.15.148:0/2516294313 shutdown_connections 2024-09-21T01:12:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.871+0000 7ff305efd640 1 --2- 172.21.15.148:0/2516294313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3001083a0 0x7ff3001087b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.871+0000 7ff305efd640 1 --2- 172.21.15.148:0/2516294313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff300108cf0 0x7ff30010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.871+0000 7ff305efd640 1 --2- 172.21.15.148:0/2516294313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff300102a60 0x7ff300102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.871+0000 7ff305efd640 1 -- 172.21.15.148:0/2516294313 >> 172.21.15.148:0/2516294313 conn(0x7ff300079760 msgr2=0x7ff300079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.871+0000 7ff305efd640 1 -- 172.21.15.148:0/2516294313 shutdown_connections 2024-09-21T01:12:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.871+0000 7ff305efd640 1 -- 172.21.15.148:0/2516294313 wait complete. 2024-09-21T01:12:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff305efd640 1 Processor -- start 2024-09-21T01:12:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff305efd640 1 -- start start 2024-09-21T01:12:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff305efd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff300102a60 0x7ff30019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff305efd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3001083a0 0x7ff30019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff305efd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff300108cf0 0x7ff30019fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff305efd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff300113af0 con 0x7ff3001083a0 2024-09-21T01:12:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff305efd640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff300113970 con 0x7ff300102a60 2024-09-21T01:12:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff305efd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff300113c70 con 0x7ff300108cf0 2024-09-21T01:12:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff2feffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3001083a0 0x7ff30019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff2feffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3001083a0 0x7ff30019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42416/0 (socket says 172.21.15.148:42416) 2024-09-21T01:12:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff2feffd640 1 -- 172.21.15.148:0/3292994972 learned_addr learned my addr 172.21.15.148:0/3292994972 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.872+0000 7ff2ff7fe640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff300102a60 0x7ff30019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff2fffff640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff300108cf0 0x7ff30019fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff2feffd640 1 -- 172.21.15.148:0/3292994972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff300108cf0 msgr2=0x7ff30019fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff2feffd640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff300108cf0 0x7ff30019fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff2feffd640 1 -- 172.21.15.148:0/3292994972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff300102a60 msgr2=0x7ff30019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff2feffd640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff300102a60 0x7ff30019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff2feffd640 1 -- 172.21.15.148:0/3292994972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3001a05b0 con 0x7ff3001083a0 2024-09-21T01:12:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff2feffd640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3001083a0 0x7ff30019abe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2f402a930 tx=0x7ff2f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:20.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff2fcff9640 1 -- 172.21.15.148:0/3292994972 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f403f030 con 0x7ff3001083a0 2024-09-21T01:12:20.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff2fcff9640 1 -- 172.21.15.148:0/3292994972 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2f4003cb0 con 0x7ff3001083a0 2024-09-21T01:12:20.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff305efd640 1 -- 172.21.15.148:0/3292994972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3001a0840 con 0x7ff3001083a0 2024-09-21T01:12:20.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff2fcff9640 1 -- 172.21.15.148:0/3292994972 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4035070 con 0x7ff3001083a0 2024-09-21T01:12:20.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.873+0000 7ff305efd640 1 -- 172.21.15.148:0/3292994972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3001a7000 con 0x7ff3001083a0 2024-09-21T01:12:20.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.874+0000 7ff305efd640 1 -- 172.21.15.148:0/3292994972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff300103ce0 con 0x7ff3001083a0 2024-09-21T01:12:20.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.876+0000 7ff2fcff9640 1 -- 172.21.15.148:0/3292994972 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7ff2f4042030 con 0x7ff3001083a0 2024-09-21T01:12:20.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.876+0000 7ff2fcff9640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2e80b6510 0x7ff2e80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:20.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.876+0000 7ff2ff7fe640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2e80b6510 0x7ff2e80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:20.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.876+0000 7ff2fcff9640 1 -- 172.21.15.148:0/3292994972 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7ff2f41074b0 con 0x7ff3001083a0 2024-09-21T01:12:20.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.877+0000 7ff2ff7fe640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2e80b6510 0x7ff2e80b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000a400 tx=0x7ff2f000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:20.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:20.881+0000 7ff2fcff9640 1 -- 172.21.15.148:0/3292994972 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2f40cde90 con 0x7ff3001083a0 2024-09-21T01:12:20.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:20 smithi181 ceph-mon[34811]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T01:12:20.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:20 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3689659528' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T01:12:20.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:20 smithi181 ceph-mon[34811]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T01:12:20.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:20 smithi181 ceph-mon[34811]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:20.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:20 smithi181 ceph-mon[34811]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T01:12:20.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:20 smithi181 ceph-mon[34811]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T01:12:20.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:20 smithi181 ceph-mon[34811]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T01:12:20.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:20 smithi157 ceph-mon[34140]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T01:12:20.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:20 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3689659528' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T01:12:20.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:20 smithi157 ceph-mon[34140]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T01:12:20.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:20 smithi157 ceph-mon[34140]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:12:20.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:20 smithi157 ceph-mon[34140]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T01:12:20.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:20 smithi157 ceph-mon[34140]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T01:12:20.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:20 smithi157 ceph-mon[34140]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T01:12:21.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.095+0000 7ff305efd640 1 -- 172.21.15.148:0/3292994972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7ff30010aac0 con 0x7ff3001083a0 2024-09-21T01:12:21.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.270+0000 7ff2fcff9640 1 -- 172.21.15.148:0/3292994972 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7ff2f40d2270 con 0x7ff3001083a0 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 -- 172.21.15.148:0/3292994972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2e80b6510 msgr2=0x7ff2e80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2e80b6510 0x7ff2e80b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000a400 tx=0x7ff2f000d040 comp rx=0 tx=0).stop 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 -- 172.21.15.148:0/3292994972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3001083a0 msgr2=0x7ff30019abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3001083a0 0x7ff30019abe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2f402a930 tx=0x7ff2f4004270 comp rx=0 tx=0).stop 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 -- 172.21.15.148:0/3292994972 shutdown_connections 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2e80b6510 0x7ff2e80b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3001083a0 0x7ff30019abe0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff300108cf0 0x7ff30019fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 --2- 172.21.15.148:0/3292994972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff300102a60 0x7ff30019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 -- 172.21.15.148:0/3292994972 >> 172.21.15.148:0/3292994972 conn(0x7ff300079760 msgr2=0x7ff300106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 -- 172.21.15.148:0/3292994972 shutdown_connections 2024-09-21T01:12:21.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:21.273+0000 7ff305efd640 1 -- 172.21.15.148:0/3292994972 wait complete. 2024-09-21T01:12:21.825 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] up:active 2024-09-21T01:12:21.825 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T01:12:21.825 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T01:12:21.825 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: Cluster is now healthy 2024-09-21T01:12:21.825 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T01:12:21.825 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T01:12:21.826 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T01:12:21.826 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3292994972' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T01:12:21.826 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3292994972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T01:12:21.826 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] up:active 2024-09-21T01:12:21.826 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:21 smithi148 ceph-mon[31000]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:12:21.853 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T01:12:21.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] up:active 2024-09-21T01:12:21.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T01:12:21.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T01:12:21.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: Cluster is now healthy 2024-09-21T01:12:21.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T01:12:21.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T01:12:21.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T01:12:21.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3292994972' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T01:12:21.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3292994972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T01:12:21.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] up:active 2024-09-21T01:12:21.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:21 smithi181 ceph-mon[34811]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:12:21.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] up:active 2024-09-21T01:12:21.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T01:12:21.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T01:12:21.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: Cluster is now healthy 2024-09-21T01:12:21.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T01:12:21.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T01:12:21.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T01:12:21.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3292994972' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T01:12:21.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3292994972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T01:12:21.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] up:active 2024-09-21T01:12:21.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:21 smithi157 ceph-mon[34140]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:12:22.100 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:22.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.555+0000 7fef4555d640 1 -- 172.21.15.148:0/1180949995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef40103b80 msgr2=0x7fef40103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:22.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.555+0000 7fef4555d640 1 --2- 172.21.15.148:0/1180949995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef40103b80 0x7fef40103f90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fef30009ca0 tx=0x7fef3002a8e0 comp rx=0 tx=0).stop 2024-09-21T01:12:22.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.555+0000 7fef4555d640 1 -- 172.21.15.148:0/1180949995 shutdown_connections 2024-09-21T01:12:22.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.555+0000 7fef4555d640 1 --2- 172.21.15.148:0/1180949995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef40109e10 0x7fef40110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:22.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.555+0000 7fef4555d640 1 --2- 172.21.15.148:0/1180949995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef401094c0 0x7fef401098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.555+0000 7fef4555d640 1 --2- 172.21.15.148:0/1180949995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef40103b80 0x7fef40103f90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.555+0000 7fef4555d640 1 -- 172.21.15.148:0/1180949995 >> 172.21.15.148:0/1180949995 conn(0x7fef400ff5d0 msgr2=0x7fef40101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.555+0000 7fef4555d640 1 -- 172.21.15.148:0/1180949995 shutdown_connections 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.555+0000 7fef4555d640 1 -- 172.21.15.148:0/1180949995 wait complete. 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.556+0000 7fef4555d640 1 Processor -- start 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.556+0000 7fef4555d640 1 -- start start 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef4555d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef40103b80 0x7fef4019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef4555d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef401094c0 0x7fef4019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef4555d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef40109e10 0x7fef4019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef4555d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fef40113b90 con 0x7fef40103b80 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef4555d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fef40113a10 con 0x7fef401094c0 2024-09-21T01:12:22.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef4555d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fef40113d10 con 0x7fef40109e10 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef40103b80 0x7fef4019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef40103b80 0x7fef4019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42426/0 (socket says 172.21.15.148:42426) 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3effd640 1 -- 172.21.15.148:0/432464369 learned_addr learned my addr 172.21.15.148:0/432464369 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3f7fe640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef40109e10 0x7fef4019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3e7fc640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef401094c0 0x7fef4019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3effd640 1 -- 172.21.15.148:0/432464369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef40109e10 msgr2=0x7fef4019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3effd640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef40109e10 0x7fef4019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3effd640 1 -- 172.21.15.148:0/432464369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef401094c0 msgr2=0x7fef4019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3effd640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef401094c0 0x7fef4019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3effd640 1 -- 172.21.15.148:0/432464369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef401a0550 con 0x7fef40103b80 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef3effd640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef40103b80 0x7fef4019a5e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fef3002ae00 tx=0x7fef30003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef27fff640 1 -- 172.21.15.148:0/432464369 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30004040 con 0x7fef40103b80 2024-09-21T01:12:22.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef4555d640 1 -- 172.21.15.148:0/432464369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef401a07e0 con 0x7fef40103b80 2024-09-21T01:12:22.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef27fff640 1 -- 172.21.15.148:0/432464369 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef30004690 con 0x7fef40103b80 2024-09-21T01:12:22.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.557+0000 7fef27fff640 1 -- 172.21.15.148:0/432464369 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30030e20 con 0x7fef40103b80 2024-09-21T01:12:22.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.558+0000 7fef4555d640 1 -- 172.21.15.148:0/432464369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef401a6fa0 con 0x7fef40103b80 2024-09-21T01:12:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.559+0000 7fef4555d640 1 -- 172.21.15.148:0/432464369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef40104010 con 0x7fef40103b80 2024-09-21T01:12:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.560+0000 7fef27fff640 1 -- 172.21.15.148:0/432464369 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7fef300305e0 con 0x7fef40103b80 2024-09-21T01:12:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.561+0000 7fef27fff640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fef280b6510 0x7fef280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.561+0000 7fef3e7fc640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fef280b6510 0x7fef280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.561+0000 7fef27fff640 1 -- 172.21.15.148:0/432464369 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fef30108880 con 0x7fef40103b80 2024-09-21T01:12:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.561+0000 7fef3e7fc640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fef280b6510 0x7fef280b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef401090e0 tx=0x7fef34009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:22.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.564+0000 7fef27fff640 1 -- 172.21.15.148:0/432464369 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef300cf260 con 0x7fef40103b80 2024-09-21T01:12:22.740 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:12:22 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b[62559]: 2024-09-21T01:12:22.299+0000 7ff286142640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T01:12:22.740 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:12:22 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b[62559]: 2024-09-21T01:12:22.299+0000 7ff286142640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T01:12:22.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:22 smithi157 ceph-mon[34140]: pgmap v288: 97 pgs: 97 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-21T01:12:22.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:22.779+0000 7fef4555d640 1 -- 172.21.15.148:0/432464369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fef4019b710 con 0x7fef40103b80 2024-09-21T01:12:22.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:22 smithi148 ceph-mon[31000]: pgmap v288: 97 pgs: 97 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-21T01:12:22.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:22 smithi181 ceph-mon[34811]: pgmap v288: 97 pgs: 97 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-21T01:12:23.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.530+0000 7fef27fff640 1 -- 172.21.15.148:0/432464369 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7fef300d3640 con 0x7fef40103b80 2024-09-21T01:12:23.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 -- 172.21.15.148:0/432464369 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fef280b6510 msgr2=0x7fef280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:23.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fef280b6510 0x7fef280b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef401090e0 tx=0x7fef34009110 comp rx=0 tx=0).stop 2024-09-21T01:12:23.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 -- 172.21.15.148:0/432464369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef40103b80 msgr2=0x7fef4019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:23.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef40103b80 0x7fef4019a5e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fef3002ae00 tx=0x7fef30003ba0 comp rx=0 tx=0).stop 2024-09-21T01:12:23.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 -- 172.21.15.148:0/432464369 shutdown_connections 2024-09-21T01:12:23.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fef280b6510 0x7fef280b8a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:23.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef40109e10 0x7fef4019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:23.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef401094c0 0x7fef4019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:23.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 --2- 172.21.15.148:0/432464369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef40103b80 0x7fef4019a5e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:23.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 -- 172.21.15.148:0/432464369 >> 172.21.15.148:0/432464369 conn(0x7fef400ff5d0 msgr2=0x7fef401019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:23.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 -- 172.21.15.148:0/432464369 shutdown_connections 2024-09-21T01:12:23.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:23.533+0000 7fef4555d640 1 -- 172.21.15.148:0/432464369 wait complete. 2024-09-21T01:12:23.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:23 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/432464369' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T01:12:23.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:23 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/432464369' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T01:12:23.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:23 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/432464369' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T01:12:24.120 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T01:12:24.120 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T01:12:24.377 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:24.806 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:24 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/432464369' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T01:12:24.806 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:24 smithi148 ceph-mon[31000]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:12:24.806 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:24 smithi148 ceph-mon[31000]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.815+0000 7f3e2232e640 1 -- 172.21.15.148:0/200479294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1c102a60 msgr2=0x7f3e1c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.815+0000 7f3e2232e640 1 --2- 172.21.15.148:0/200479294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1c102a60 0x7f3e1c102e70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009900 tx=0x7f3e0c02a410 comp rx=0 tx=0).stop 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.815+0000 7f3e2232e640 1 -- 172.21.15.148:0/200479294 shutdown_connections 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.815+0000 7f3e2232e640 1 --2- 172.21.15.148:0/200479294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1c108cf0 0x7f3e1c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.815+0000 7f3e2232e640 1 --2- 172.21.15.148:0/200479294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c1083a0 0x7f3e1c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.815+0000 7f3e2232e640 1 --2- 172.21.15.148:0/200479294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1c102a60 0x7f3e1c102e70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.815+0000 7f3e2232e640 1 -- 172.21.15.148:0/200479294 >> 172.21.15.148:0/200479294 conn(0x7f3e1c079730 msgr2=0x7f3e1c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.815+0000 7f3e2232e640 1 -- 172.21.15.148:0/200479294 shutdown_connections 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.815+0000 7f3e2232e640 1 -- 172.21.15.148:0/200479294 wait complete. 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.816+0000 7f3e2232e640 1 Processor -- start 2024-09-21T01:12:24.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.816+0000 7f3e2232e640 1 -- start start 2024-09-21T01:12:24.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e2232e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1c102a60 0x7f3e1c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:24.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e2232e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1c1083a0 0x7f3e1c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:24.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e2232e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c108cf0 0x7f3e1c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:24.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e2232e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c112960 con 0x7f3e1c1083a0 2024-09-21T01:12:24.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e2232e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c1127e0 con 0x7f3e1c102a60 2024-09-21T01:12:24.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e2232e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c112ae0 con 0x7f3e1c108cf0 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e1b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1c1083a0 0x7f3e1c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e1b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1c1083a0 0x7f3e1c199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42444/0 (socket says 172.21.15.148:42444) 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e1b7fe640 1 -- 172.21.15.148:0/4252553580 learned_addr learned my addr 172.21.15.148:0/4252553580 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e1bfff640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1c102a60 0x7f3e1c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e208cb640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c108cf0 0x7f3e1c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e1b7fe640 1 -- 172.21.15.148:0/4252553580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c108cf0 msgr2=0x7f3e1c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e1b7fe640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c108cf0 0x7f3e1c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e1b7fe640 1 -- 172.21.15.148:0/4252553580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1c102a60 msgr2=0x7f3e1c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e1b7fe640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1c102a60 0x7f3e1c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e1b7fe640 1 -- 172.21.15.148:0/4252553580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c19f2e0 con 0x7f3e1c1083a0 2024-09-21T01:12:24.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e208cb640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c108cf0 0x7f3e1c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:12:24.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.817+0000 7f3e1b7fe640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1c1083a0 0x7f3e1c199910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000d740 tx=0x7f3e1000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:24.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.818+0000 7f3e197fa640 1 -- 172.21.15.148:0/4252553580 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10017070 con 0x7f3e1c1083a0 2024-09-21T01:12:24.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.818+0000 7f3e197fa640 1 -- 172.21.15.148:0/4252553580 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1000de50 con 0x7f3e1c1083a0 2024-09-21T01:12:24.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.818+0000 7f3e197fa640 1 -- 172.21.15.148:0/4252553580 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10004ce0 con 0x7f3e1c1083a0 2024-09-21T01:12:24.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.818+0000 7f3e2232e640 1 -- 172.21.15.148:0/4252553580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c19f5d0 con 0x7f3e1c1083a0 2024-09-21T01:12:24.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.818+0000 7f3e2232e640 1 -- 172.21.15.148:0/4252553580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c1a5d30 con 0x7f3e1c1083a0 2024-09-21T01:12:24.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.819+0000 7f3e2232e640 1 -- 172.21.15.148:0/4252553580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c102e70 con 0x7f3e1c1083a0 2024-09-21T01:12:24.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.821+0000 7f3e197fa640 1 -- 172.21.15.148:0/4252553580 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f3e10004e80 con 0x7f3e1c1083a0 2024-09-21T01:12:24.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.822+0000 7f3e197fa640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3e040b6510 0x7f3e040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:24.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.822+0000 7f3e1bfff640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3e040b6510 0x7f3e040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:24.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.822+0000 7f3e197fa640 1 -- 172.21.15.148:0/4252553580 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f3e100e6f70 con 0x7f3e1c1083a0 2024-09-21T01:12:24.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.822+0000 7f3e1bfff640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3e040b6510 0x7f3e040b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c031440 tx=0x7f3e0c009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:24.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:24.825+0000 7f3e197fa640 1 -- 172.21.15.148:0/4252553580 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e100ad950 con 0x7f3e1c1083a0 2024-09-21T01:12:24.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:24 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/432464369' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T01:12:24.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:24 smithi181 ceph-mon[34811]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:12:24.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:24 smithi181 ceph-mon[34811]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T01:12:24.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:24 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/432464369' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T01:12:24.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:24 smithi157 ceph-mon[34140]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:12:24.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:24 smithi157 ceph-mon[34140]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T01:12:25.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.028+0000 7f3e2232e640 1 -- 172.21.15.148:0/4252553580 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3e1c063800 con 0x7f3e040b6510 2024-09-21T01:12:25.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.056+0000 7f3e197fa640 1 -- 172.21.15.148:0/4252553580 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3e1c063800 con 0x7f3e040b6510 2024-09-21T01:12:25.057 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:12:25 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:12:25.034+0000 7fb856915640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:12:25.057 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:12:25 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:12:25.034+0000 7fb856915640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:12:25.057 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:12:25 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:12:25.034+0000 7fb856915640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:12:25.057 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:12:25 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:12:25.034+0000 7fb856915640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:12:25.058 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:12:25 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:12:25.034+0000 7fb856915640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:12:25.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 -- 172.21.15.148:0/4252553580 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3e040b6510 msgr2=0x7f3e040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:25.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3e040b6510 0x7f3e040b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c031440 tx=0x7f3e0c009560 comp rx=0 tx=0).stop 2024-09-21T01:12:25.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 -- 172.21.15.148:0/4252553580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1c1083a0 msgr2=0x7f3e1c199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:25.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1c1083a0 0x7f3e1c199910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000d740 tx=0x7f3e1000dc00 comp rx=0 tx=0).stop 2024-09-21T01:12:25.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 -- 172.21.15.148:0/4252553580 shutdown_connections 2024-09-21T01:12:25.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3e040b6510 0x7f3e040b8a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:25.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e1c1083a0 0x7f3e1c199910 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:25.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c108cf0 0x7f3e1c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:25.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 --2- 172.21.15.148:0/4252553580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e1c102a60 0x7f3e1c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:25.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 -- 172.21.15.148:0/4252553580 >> 172.21.15.148:0/4252553580 conn(0x7f3e1c079730 msgr2=0x7f3e1c1013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:25.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 -- 172.21.15.148:0/4252553580 shutdown_connections 2024-09-21T01:12:25.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:25.059+0000 7f3e2232e640 1 -- 172.21.15.148:0/4252553580 wait complete. 2024-09-21T01:12:25.758 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:25 smithi148 ceph-mon[31000]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:25.785 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T01:12:25.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:25 smithi181 ceph-mon[34811]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:25.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:25 smithi157 ceph-mon[34140]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:26.033 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:26.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.498+0000 7f91f05f2640 1 -- 172.21.15.148:0/2285946806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e8103bc0 msgr2=0x7f91e8103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:26.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.498+0000 7f91f05f2640 1 --2- 172.21.15.148:0/2285946806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e8103bc0 0x7f91e8103fd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009900 tx=0x7f91e402a410 comp rx=0 tx=0).stop 2024-09-21T01:12:26.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.498+0000 7f91f05f2640 1 -- 172.21.15.148:0/2285946806 shutdown_connections 2024-09-21T01:12:26.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.498+0000 7f91f05f2640 1 --2- 172.21.15.148:0/2285946806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e8109e00 0x7f91e8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:26.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.498+0000 7f91f05f2640 1 --2- 172.21.15.148:0/2285946806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e81094b0 0x7f91e81098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:26.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.498+0000 7f91f05f2640 1 --2- 172.21.15.148:0/2285946806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e8103bc0 0x7f91e8103fd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:26.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.498+0000 7f91f05f2640 1 -- 172.21.15.148:0/2285946806 >> 172.21.15.148:0/2285946806 conn(0x7f91e807b910 msgr2=0x7f91e807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:26.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.498+0000 7f91f05f2640 1 -- 172.21.15.148:0/2285946806 shutdown_connections 2024-09-21T01:12:26.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.498+0000 7f91f05f2640 1 -- 172.21.15.148:0/2285946806 wait complete. 2024-09-21T01:12:26.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.499+0000 7f91f05f2640 1 Processor -- start 2024-09-21T01:12:26.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.499+0000 7f91f05f2640 1 -- start start 2024-09-21T01:12:26.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.499+0000 7f91f05f2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e8103bc0 0x7f91e819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:26.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.499+0000 7f91f05f2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e81094b0 0x7f91e819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:26.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.499+0000 7f91f05f2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e8109e00 0x7f91e819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:26.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.499+0000 7f91f05f2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8113b20 con 0x7f91e81094b0 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.499+0000 7f91f05f2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81139a0 con 0x7f91e8103bc0 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.499+0000 7f91f05f2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8113ca0 con 0x7f91e8109e00 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91edb8d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e81094b0 0x7f91e819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91edb8d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e81094b0 0x7f91e819aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49962/0 (socket says 172.21.15.148:49962) 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91edb8d640 1 -- 172.21.15.148:0/1291756839 learned_addr learned my addr 172.21.15.148:0/1291756839 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91ee38e640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e8103bc0 0x7f91e819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91eeb8f640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e8109e00 0x7f91e819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91edb8d640 1 -- 172.21.15.148:0/1291756839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e8109e00 msgr2=0x7f91e819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91edb8d640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e8109e00 0x7f91e819fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91edb8d640 1 -- 172.21.15.148:0/1291756839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e8103bc0 msgr2=0x7f91e819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91edb8d640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e8103bc0 0x7f91e819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91edb8d640 1 -- 172.21.15.148:0/1291756839 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e81a04a0 con 0x7f91e81094b0 2024-09-21T01:12:26.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91eeb8f640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e8109e00 0x7f91e819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:12:26.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91edb8d640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e81094b0 0x7f91e819aad0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c970 tx=0x7f91d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:26.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91df7fe640 1 -- 172.21.15.148:0/1291756839 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8007bb0 con 0x7f91e81094b0 2024-09-21T01:12:26.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91f05f2640 1 -- 172.21.15.148:0/1291756839 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e81a0790 con 0x7f91e81094b0 2024-09-21T01:12:26.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91df7fe640 1 -- 172.21.15.148:0/1291756839 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91d8007d50 con 0x7f91e81094b0 2024-09-21T01:12:26.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91df7fe640 1 -- 172.21.15.148:0/1291756839 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8004e10 con 0x7f91e81094b0 2024-09-21T01:12:26.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.500+0000 7f91f05f2640 1 -- 172.21.15.148:0/1291756839 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e81a6ef0 con 0x7f91e81094b0 2024-09-21T01:12:26.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.501+0000 7f91f05f2640 1 -- 172.21.15.148:0/1291756839 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e8103fd0 con 0x7f91e81094b0 2024-09-21T01:12:26.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.503+0000 7f91df7fe640 1 -- 172.21.15.148:0/1291756839 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 154513+0+0 (secure 0 0 0) 0x7f91d8005000 con 0x7f91e81094b0 2024-09-21T01:12:26.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.504+0000 7f91df7fe640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91d40b6510 0x7f91d40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:26.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.504+0000 7f91ee38e640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91d40b6510 0x7f91d40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:26.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.504+0000 7f91df7fe640 1 -- 172.21.15.148:0/1291756839 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f91d80e7340 con 0x7f91e81094b0 2024-09-21T01:12:26.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.504+0000 7f91ee38e640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91d40b6510 0x7f91d40b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f91e4031440 tx=0x7f91e4005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:26.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.507+0000 7f91df7fe640 1 -- 172.21.15.148:0/1291756839 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91d8014030 con 0x7f91e81094b0 2024-09-21T01:12:26.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.559+0000 7f91df7fe640 1 -- 172.21.15.148:0/1291756839 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f91d80a9890 con 0x7f91e81094b0 2024-09-21T01:12:26.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.720+0000 7f91f05f2640 1 -- 172.21.15.148:0/1291756839 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f91e8063800 con 0x7f91d40b6510 2024-09-21T01:12:26.722 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:26 smithi148 ceph-mon[31000]: pgmap v290: 97 pgs: 97 active+clean; 588 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-21T01:12:26.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.749+0000 7f91df7fe640 1 -- 172.21.15.148:0/1291756839 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f91e8063800 con 0x7f91d40b6510 2024-09-21T01:12:26.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 -- 172.21.15.148:0/1291756839 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91d40b6510 msgr2=0x7f91d40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:26.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91d40b6510 0x7f91d40b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f91e4031440 tx=0x7f91e4005e80 comp rx=0 tx=0).stop 2024-09-21T01:12:26.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 -- 172.21.15.148:0/1291756839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e81094b0 msgr2=0x7f91e819aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:26.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e81094b0 0x7f91e819aad0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c970 tx=0x7f91d800ce30 comp rx=0 tx=0).stop 2024-09-21T01:12:26.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 -- 172.21.15.148:0/1291756839 shutdown_connections 2024-09-21T01:12:26.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f91d40b6510 0x7f91d40b8a20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:26.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91e81094b0 0x7f91e819aad0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:26.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e8109e00 0x7f91e819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:26.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 --2- 172.21.15.148:0/1291756839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e8103bc0 0x7f91e819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:26.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 -- 172.21.15.148:0/1291756839 >> 172.21.15.148:0/1291756839 conn(0x7f91e807b910 msgr2=0x7f91e81075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:26.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 -- 172.21.15.148:0/1291756839 shutdown_connections 2024-09-21T01:12:26.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:26.751+0000 7f91f05f2640 1 -- 172.21.15.148:0/1291756839 wait complete. 2024-09-21T01:12:26.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:26 smithi181 ceph-mon[34811]: pgmap v290: 97 pgs: 97 active+clean; 588 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-21T01:12:26.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:26 smithi157 ceph-mon[34140]: pgmap v290: 97 pgs: 97 active+clean; 588 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-21T01:12:27.370 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T01:12:27.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:27 smithi148 ceph-mon[31000]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T01:12:27.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:27 smithi148 ceph-mon[31000]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:27.618 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:27.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:27 smithi181 ceph-mon[34811]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T01:12:27.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:27 smithi181 ceph-mon[34811]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:27.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:27 smithi157 ceph-mon[34140]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T01:12:27.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:27 smithi157 ceph-mon[34140]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:28.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.147+0000 7f1576a0b640 1 -- 172.21.15.148:0/891008730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1570106bd0 msgr2=0x7f1570110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:28.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.147+0000 7f1576a0b640 1 --2- 172.21.15.148:0/891008730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1570106bd0 0x7f1570110660 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1568009ca0 tx=0x7f156802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.147+0000 7f1576a0b640 1 -- 172.21.15.148:0/891008730 shutdown_connections 2024-09-21T01:12:28.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.147+0000 7f1576a0b640 1 --2- 172.21.15.148:0/891008730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1570106bd0 0x7f1570110660 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.147+0000 7f1576a0b640 1 --2- 172.21.15.148:0/891008730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1570106280 0x7f1570106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.147+0000 7f1576a0b640 1 --2- 172.21.15.148:0/891008730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1570102030 0x7f1570102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.147+0000 7f1576a0b640 1 -- 172.21.15.148:0/891008730 >> 172.21.15.148:0/891008730 conn(0x7f1570077c60 msgr2=0x7f15700780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:28.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.147+0000 7f1576a0b640 1 -- 172.21.15.148:0/891008730 shutdown_connections 2024-09-21T01:12:28.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.147+0000 7f1576a0b640 1 -- 172.21.15.148:0/891008730 wait complete. 2024-09-21T01:12:28.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.148+0000 7f1576a0b640 1 Processor -- start 2024-09-21T01:12:28.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.148+0000 7f1576a0b640 1 -- start start 2024-09-21T01:12:28.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.148+0000 7f1576a0b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1570102030 0x7f157019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:28.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.148+0000 7f1576a0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1570106280 0x7f157019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:28.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f1576a0b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1570106bd0 0x7f157019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:28.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f1576a0b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1570113ac0 con 0x7f1570106280 2024-09-21T01:12:28.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f1576a0b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1570113940 con 0x7f1570102030 2024-09-21T01:12:28.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f1576a0b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1570113c40 con 0x7f1570106bd0 2024-09-21T01:12:28.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1570106280 0x7f157019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1570106280 0x7f157019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49966/0 (socket says 172.21.15.148:49966) 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156f7fe640 1 -- 172.21.15.148:0/4196578505 learned_addr learned my addr 172.21.15.148:0/4196578505 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156ffff640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1570102030 0x7f157019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f1574fa8640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1570106bd0 0x7f157019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156f7fe640 1 -- 172.21.15.148:0/4196578505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1570106bd0 msgr2=0x7f157019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156f7fe640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1570106bd0 0x7f157019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156f7fe640 1 -- 172.21.15.148:0/4196578505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1570102030 msgr2=0x7f157019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156f7fe640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1570102030 0x7f157019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156f7fe640 1 -- 172.21.15.148:0/4196578505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15701a0340 con 0x7f1570106280 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f1574fa8640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1570106bd0 0x7f157019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156f7fe640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1570106280 0x7f157019aa30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f156400c8c0 tx=0x7f156400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:28.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156d7fa640 1 -- 172.21.15.148:0/4196578505 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564007bb0 con 0x7f1570106280 2024-09-21T01:12:28.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156d7fa640 1 -- 172.21.15.148:0/4196578505 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1564007d50 con 0x7f1570106280 2024-09-21T01:12:28.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f1576a0b640 1 -- 172.21.15.148:0/4196578505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15701a0630 con 0x7f1570106280 2024-09-21T01:12:28.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.149+0000 7f156d7fa640 1 -- 172.21.15.148:0/4196578505 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15640187c0 con 0x7f1570106280 2024-09-21T01:12:28.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.150+0000 7f1576a0b640 1 -- 172.21.15.148:0/4196578505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15701a6e50 con 0x7f1570106280 2024-09-21T01:12:28.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.151+0000 7f1576a0b640 1 -- 172.21.15.148:0/4196578505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1570102440 con 0x7f1570106280 2024-09-21T01:12:28.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.152+0000 7f156d7fa640 1 -- 172.21.15.148:0/4196578505 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f156400fa20 con 0x7f1570106280 2024-09-21T01:12:28.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.153+0000 7f156d7fa640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15580b6650 0x7f15580b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:28.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.153+0000 7f156ffff640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15580b6650 0x7f15580b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:28.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.153+0000 7f156d7fa640 1 -- 172.21.15.148:0/4196578505 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f15640e72b0 con 0x7f1570106280 2024-09-21T01:12:28.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.153+0000 7f156ffff640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15580b6650 0x7f15580b8b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f157006ae30 tx=0x7f1560005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:28.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.157+0000 7f156d7fa640 1 -- 172.21.15.148:0/4196578505 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1564014030 con 0x7f1570106280 2024-09-21T01:12:28.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.366+0000 7f1576a0b640 1 -- 172.21.15.148:0/4196578505 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f1570063800 con 0x7f15580b6650 2024-09-21T01:12:28.372 INFO:teuthology.orchestra.run.smithi148.stdout:/volumes/qa/sv_0/0d98cd81-7656-4cde-99f0-c6ec09277c88 2024-09-21T01:12:28.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.372+0000 7f156d7fa640 1 -- 172.21.15.148:0/4196578505 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1570063800 con 0x7f15580b6650 2024-09-21T01:12:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 -- 172.21.15.148:0/4196578505 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15580b6650 msgr2=0x7f15580b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15580b6650 0x7f15580b8b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f157006ae30 tx=0x7f1560005f90 comp rx=0 tx=0).stop 2024-09-21T01:12:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 -- 172.21.15.148:0/4196578505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1570106280 msgr2=0x7f157019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1570106280 0x7f157019aa30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f156400c8c0 tx=0x7f156400cd80 comp rx=0 tx=0).stop 2024-09-21T01:12:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 -- 172.21.15.148:0/4196578505 shutdown_connections 2024-09-21T01:12:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15580b6650 0x7f15580b8b60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1570106280 0x7f157019aa30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1570106bd0 0x7f157019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 --2- 172.21.15.148:0/4196578505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1570102030 0x7f157019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 -- 172.21.15.148:0/4196578505 >> 172.21.15.148:0/4196578505 conn(0x7f1570077c60 msgr2=0x7f15701074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 -- 172.21.15.148:0/4196578505 shutdown_connections 2024-09-21T01:12:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:28.374+0000 7f1576a0b640 1 -- 172.21.15.148:0/4196578505 wait complete. 2024-09-21T01:12:28.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:28 smithi148 ceph-mon[31000]: pgmap v291: 97 pgs: 97 active+clean; 588 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-09-21T01:12:28.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:28 smithi181 ceph-mon[34811]: pgmap v291: 97 pgs: 97 active+clean; 588 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-09-21T01:12:28.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:28 smithi157 ceph-mon[34140]: pgmap v291: 97 pgs: 97 active+clean; 588 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-09-21T01:12:29.011 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T01:12:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:29.687 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:29 smithi148 ceph-mon[31000]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:29.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.708+0000 7fe26c666640 1 -- 172.21.15.148:0/3457974569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2641083c0 msgr2=0x7fe2641087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:29.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.708+0000 7fe26c666640 1 --2- 172.21.15.148:0/3457974569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2641083c0 0x7fe2641087d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe254009900 tx=0x7fe25402a410 comp rx=0 tx=0).stop 2024-09-21T01:12:29.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.708+0000 7fe26c666640 1 -- 172.21.15.148:0/3457974569 shutdown_connections 2024-09-21T01:12:29.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.708+0000 7fe26c666640 1 --2- 172.21.15.148:0/3457974569 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2641083c0 0x7fe2641087d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:29.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.708+0000 7fe26c666640 1 --2- 172.21.15.148:0/3457974569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe264108d10 0x7fe26410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:29.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.708+0000 7fe26c666640 1 --2- 172.21.15.148:0/3457974569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe264102a80 0x7fe264102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:29.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.708+0000 7fe26c666640 1 -- 172.21.15.148:0/3457974569 >> 172.21.15.148:0/3457974569 conn(0x7fe264079740 msgr2=0x7fe264079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:29.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.708+0000 7fe26c666640 1 -- 172.21.15.148:0/3457974569 shutdown_connections 2024-09-21T01:12:29.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.708+0000 7fe26c666640 1 -- 172.21.15.148:0/3457974569 wait complete. 2024-09-21T01:12:29.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.709+0000 7fe26c666640 1 Processor -- start 2024-09-21T01:12:29.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.709+0000 7fe26c666640 1 -- start start 2024-09-21T01:12:29.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.709+0000 7fe26c666640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe264102a80 0x7fe2641993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:29.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.709+0000 7fe26c666640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2641083c0 0x7fe264199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.709+0000 7fe26c666640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264108d10 0x7fe26419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.709+0000 7fe26c666640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe264112980 con 0x7fe264108d10 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.709+0000 7fe26c666640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe264112800 con 0x7fe2641083c0 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.709+0000 7fe26c666640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe264112b00 con 0x7fe264102a80 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26ac03640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264108d10 0x7fe26419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26ac03640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264108d10 0x7fe26419ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49988/0 (socket says 172.21.15.148:49988) 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26ac03640 1 -- 172.21.15.148:0/378296380 learned_addr learned my addr 172.21.15.148:0/378296380 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26a402640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe264102a80 0x7fe2641993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe269c01640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2641083c0 0x7fe264199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26ac03640 1 -- 172.21.15.148:0/378296380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe264102a80 msgr2=0x7fe2641993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26ac03640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe264102a80 0x7fe2641993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26ac03640 1 -- 172.21.15.148:0/378296380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2641083c0 msgr2=0x7fe264199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:29.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26ac03640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2641083c0 0x7fe264199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:29.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26ac03640 1 -- 172.21.15.148:0/378296380 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26419f360 con 0x7fe264108d10 2024-09-21T01:12:29.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe269c01640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2641083c0 0x7fe264199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:29.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26ac03640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264108d10 0x7fe26419ec30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00eaa0 tx=0x7fe25c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:29.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe25b7fe640 1 -- 172.21.15.148:0/378296380 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00cdb0 con 0x7fe264108d10 2024-09-21T01:12:29.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe25b7fe640 1 -- 172.21.15.148:0/378296380 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe25c005020 con 0x7fe264108d10 2024-09-21T01:12:29.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26c666640 1 -- 172.21.15.148:0/378296380 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26419f650 con 0x7fe264108d10 2024-09-21T01:12:29.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe25b7fe640 1 -- 172.21.15.148:0/378296380 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0116d0 con 0x7fe264108d10 2024-09-21T01:12:29.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.710+0000 7fe26c666640 1 -- 172.21.15.148:0/378296380 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2641a5db0 con 0x7fe264108d10 2024-09-21T01:12:29.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.712+0000 7fe26c666640 1 -- 172.21.15.148:0/378296380 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe264103d00 con 0x7fe264108d10 2024-09-21T01:12:29.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.713+0000 7fe25b7fe640 1 -- 172.21.15.148:0/378296380 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fe25c0051d0 con 0x7fe264108d10 2024-09-21T01:12:29.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.714+0000 7fe25b7fe640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2500b65a0 0x7fe2500b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:29.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.714+0000 7fe26a402640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2500b65a0 0x7fe2500b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:29.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.714+0000 7fe25b7fe640 1 -- 172.21.15.148:0/378296380 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fe25c0e7890 con 0x7fe264108d10 2024-09-21T01:12:29.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.714+0000 7fe26a402640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2500b65a0 0x7fe2500b8ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe26000bbe0 tx=0x7fe26000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:29.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.717+0000 7fe25b7fe640 1 -- 172.21.15.148:0/378296380 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe25c016030 con 0x7fe264108d10 2024-09-21T01:12:29.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.922+0000 7fe26c666640 1 -- 172.21.15.148:0/378296380 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe264063800 con 0x7fe2500b65a0 2024-09-21T01:12:29.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.953+0000 7fe25b7fe640 1 -- 172.21.15.148:0/378296380 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe264063800 con 0x7fe2500b65a0 2024-09-21T01:12:29.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 -- 172.21.15.148:0/378296380 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2500b65a0 msgr2=0x7fe2500b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:29.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2500b65a0 0x7fe2500b8ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe26000bbe0 tx=0x7fe26000b390 comp rx=0 tx=0).stop 2024-09-21T01:12:29.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 -- 172.21.15.148:0/378296380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264108d10 msgr2=0x7fe26419ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:29.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264108d10 0x7fe26419ec30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00eaa0 tx=0x7fe25c00ef60 comp rx=0 tx=0).stop 2024-09-21T01:12:29.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 -- 172.21.15.148:0/378296380 shutdown_connections 2024-09-21T01:12:29.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2500b65a0 0x7fe2500b8ab0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:29.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe264108d10 0x7fe26419ec30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:29.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2641083c0 0x7fe264199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:29.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 --2- 172.21.15.148:0/378296380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe264102a80 0x7fe2641993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:29.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 -- 172.21.15.148:0/378296380 >> 172.21.15.148:0/378296380 conn(0x7fe264079740 msgr2=0x7fe2641043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:29.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 -- 172.21.15.148:0/378296380 shutdown_connections 2024-09-21T01:12:29.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:29.955+0000 7fe26c666640 1 -- 172.21.15.148:0/378296380 wait complete. 2024-09-21T01:12:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:29 smithi181 ceph-mon[34811]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:29.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:29 smithi157 ceph-mon[34140]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:30.595 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T01:12:30.842 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:30.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:30 smithi148 ceph-mon[31000]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:30.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:30 smithi148 ceph-mon[31000]: pgmap v292: 97 pgs: 97 active+clean; 588 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T01:12:30.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:30 smithi181 ceph-mon[34811]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:30.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:30 smithi181 ceph-mon[34811]: pgmap v292: 97 pgs: 97 active+clean; 588 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T01:12:30.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:30 smithi157 ceph-mon[34140]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:30.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:30 smithi157 ceph-mon[34140]: pgmap v292: 97 pgs: 97 active+clean; 588 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T01:12:31.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.308+0000 7fc741637640 1 -- 172.21.15.148:0/3247038974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc73c1094e0 msgr2=0x7fc73c1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:31.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.308+0000 7fc741637640 1 --2- 172.21.15.148:0/3247038974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc73c1094e0 0x7fc73c1098f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc724009900 tx=0x7fc72402a410 comp rx=0 tx=0).stop 2024-09-21T01:12:31.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.308+0000 7fc741637640 1 -- 172.21.15.148:0/3247038974 shutdown_connections 2024-09-21T01:12:31.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.308+0000 7fc741637640 1 --2- 172.21.15.148:0/3247038974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc73c1094e0 0x7fc73c1098f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:31.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.308+0000 7fc741637640 1 --2- 172.21.15.148:0/3247038974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73c109e30 0x7fc73c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:31.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.308+0000 7fc741637640 1 --2- 172.21.15.148:0/3247038974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc73c103ba0 0x7fc73c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:31.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.308+0000 7fc741637640 1 -- 172.21.15.148:0/3247038974 >> 172.21.15.148:0/3247038974 conn(0x7fc73c0ff630 msgr2=0x7fc73c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:31.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.308+0000 7fc741637640 1 -- 172.21.15.148:0/3247038974 shutdown_connections 2024-09-21T01:12:31.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.308+0000 7fc741637640 1 -- 172.21.15.148:0/3247038974 wait complete. 2024-09-21T01:12:31.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc741637640 1 Processor -- start 2024-09-21T01:12:31.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc741637640 1 -- start start 2024-09-21T01:12:31.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc741637640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc73c103ba0 0x7fc73c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:31.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc741637640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73c1094e0 0x7fc73c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:31.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc741637640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc73c109e30 0x7fc73c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:31.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc741637640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c113af0 con 0x7fc73c109e30 2024-09-21T01:12:31.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc741637640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c113970 con 0x7fc73c1094e0 2024-09-21T01:12:31.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc741637640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c113c70 con 0x7fc73c103ba0 2024-09-21T01:12:31.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc73b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc73c109e30 0x7fc73c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc73b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc73c109e30 0x7fc73c19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50004/0 (socket says 172.21.15.148:50004) 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.309+0000 7fc73b7fe640 1 -- 172.21.15.148:0/229091043 learned_addr learned my addr 172.21.15.148:0/229091043 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc733fff640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73c1094e0 0x7fc73c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc73b7fe640 1 -- 172.21.15.148:0/229091043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc73c103ba0 msgr2=0x7fc73c19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc73b7fe640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc73c103ba0 0x7fc73c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc73b7fe640 1 -- 172.21.15.148:0/229091043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73c1094e0 msgr2=0x7fc73c19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc73b7fe640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73c1094e0 0x7fc73c19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc73b7fe640 1 -- 172.21.15.148:0/229091043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73c1a0430 con 0x7fc73c109e30 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc733fff640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73c1094e0 0x7fc73c19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc73b7fe640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc73c109e30 0x7fc73c19fd00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc73400eaa0 tx=0x7fc73400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc738ff9640 1 -- 172.21.15.148:0/229091043 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73400cdb0 con 0x7fc73c109e30 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc738ff9640 1 -- 172.21.15.148:0/229091043 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc734005020 con 0x7fc73c109e30 2024-09-21T01:12:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc738ff9640 1 -- 172.21.15.148:0/229091043 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7340116d0 con 0x7fc73c109e30 2024-09-21T01:12:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc741637640 1 -- 172.21.15.148:0/229091043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73c1a0720 con 0x7fc73c109e30 2024-09-21T01:12:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.310+0000 7fc741637640 1 -- 172.21.15.148:0/229091043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc73c1a6e80 con 0x7fc73c109e30 2024-09-21T01:12:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.311+0000 7fc741637640 1 -- 172.21.15.148:0/229091043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc73c103fb0 con 0x7fc73c109e30 2024-09-21T01:12:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.313+0000 7fc738ff9640 1 -- 172.21.15.148:0/229091043 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fc7340051d0 con 0x7fc73c109e30 2024-09-21T01:12:31.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.314+0000 7fc738ff9640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b65a0 0x7fc7280b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:31.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.314+0000 7fc73affd640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b65a0 0x7fc7280b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:31.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.314+0000 7fc738ff9640 1 -- 172.21.15.148:0/229091043 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fc7340e7960 con 0x7fc73c109e30 2024-09-21T01:12:31.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.315+0000 7fc73affd640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b65a0 0x7fc7280b8ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00a8f0 tx=0x7fc72c005bf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:31.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.317+0000 7fc738ff9640 1 -- 172.21.15.148:0/229091043 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc734016030 con 0x7fc73c109e30 2024-09-21T01:12:31.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.527+0000 7fc741637640 1 -- 172.21.15.148:0/229091043 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fc73c063800 con 0x7fc7280b65a0 2024-09-21T01:12:31.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.533+0000 7fc738ff9640 1 -- 172.21.15.148:0/229091043 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc73c063800 con 0x7fc7280b65a0 2024-09-21T01:12:31.533 INFO:teuthology.orchestra.run.smithi148.stdout:/volumes/qa/sv_1/cbb79553-cc4e-4e67-8ff1-e4ab53484f44 2024-09-21T01:12:31.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 -- 172.21.15.148:0/229091043 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b65a0 msgr2=0x7fc7280b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:31.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b65a0 0x7fc7280b8ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00a8f0 tx=0x7fc72c005bf0 comp rx=0 tx=0).stop 2024-09-21T01:12:31.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 -- 172.21.15.148:0/229091043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc73c109e30 msgr2=0x7fc73c19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:31.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc73c109e30 0x7fc73c19fd00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc73400eaa0 tx=0x7fc73400ef60 comp rx=0 tx=0).stop 2024-09-21T01:12:31.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 -- 172.21.15.148:0/229091043 shutdown_connections 2024-09-21T01:12:31.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b65a0 0x7fc7280b8ab0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:31.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc73c109e30 0x7fc73c19fd00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:31.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73c1094e0 0x7fc73c19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:31.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 --2- 172.21.15.148:0/229091043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc73c103ba0 0x7fc73c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:31.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 -- 172.21.15.148:0/229091043 >> 172.21.15.148:0/229091043 conn(0x7fc73c0ff630 msgr2=0x7fc73c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:31.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 -- 172.21.15.148:0/229091043 shutdown_connections 2024-09-21T01:12:31.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:31.535+0000 7fc741637640 1 -- 172.21.15.148:0/229091043 wait complete. 2024-09-21T01:12:32.164 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:12:32.415 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:32.536 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:32 smithi148 ceph-mon[31000]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:32.536 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:32 smithi148 ceph-mon[31000]: pgmap v293: 97 pgs: 97 active+clean; 625 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-09-21T01:12:32.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:32 smithi181 ceph-mon[34811]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:32.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:32 smithi181 ceph-mon[34811]: pgmap v293: 97 pgs: 97 active+clean; 625 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-09-21T01:12:32.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:32 smithi157 ceph-mon[34140]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:32.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:32 smithi157 ceph-mon[34140]: pgmap v293: 97 pgs: 97 active+clean; 625 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-09-21T01:12:32.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.851+0000 7fe41b81c640 1 -- 172.21.15.148:0/1745531539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414105380 msgr2=0x7fe41410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:32.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.851+0000 7fe41b81c640 1 --2- 172.21.15.148:0/1745531539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414105380 0x7fe41410d8d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe408009900 tx=0x7fe40802a410 comp rx=0 tx=0).stop 2024-09-21T01:12:32.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.851+0000 7fe41b81c640 1 -- 172.21.15.148:0/1745531539 shutdown_connections 2024-09-21T01:12:32.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.851+0000 7fe41b81c640 1 --2- 172.21.15.148:0/1745531539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414105380 0x7fe41410d8d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:32.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.851+0000 7fe41b81c640 1 --2- 172.21.15.148:0/1745531539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41410de90 0x7fe414110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:32.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.851+0000 7fe41b81c640 1 --2- 172.21.15.148:0/1745531539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe414104a30 0x7fe414104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:32.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.851+0000 7fe41b81c640 1 -- 172.21.15.148:0/1745531539 >> 172.21.15.148:0/1745531539 conn(0x7fe414079770 msgr2=0x7fe414079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:32.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.851+0000 7fe41b81c640 1 -- 172.21.15.148:0/1745531539 shutdown_connections 2024-09-21T01:12:32.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.851+0000 7fe41b81c640 1 -- 172.21.15.148:0/1745531539 wait complete. 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe41b81c640 1 Processor -- start 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe41b81c640 1 -- start start 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe41b81c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414104a30 0x7fe414102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe41b81c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe414105380 0x7fe414102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe41b81c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41410de90 0x7fe4141031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe41b81c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe414113b30 con 0x7fe414104a30 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe41b81c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe4141139b0 con 0x7fe414105380 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe41b81c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe414113cb0 con 0x7fe41410de90 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe4195b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414104a30 0x7fe414102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe4195b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414104a30 0x7fe414102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50018/0 (socket says 172.21.15.148:50018) 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.852+0000 7fe4195b8640 1 -- 172.21.15.148:0/1322911495 learned_addr learned my addr 172.21.15.148:0/1322911495 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe418db7640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe414105380 0x7fe414102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe4195b8640 1 -- 172.21.15.148:0/1322911495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41410de90 msgr2=0x7fe4141031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe4195b8640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41410de90 0x7fe4141031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe4195b8640 1 -- 172.21.15.148:0/1322911495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe414105380 msgr2=0x7fe414102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe4195b8640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe414105380 0x7fe414102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe4195b8640 1 -- 172.21.15.148:0/1322911495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4141a87b0 con 0x7fe414104a30 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe4195b8640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414104a30 0x7fe414102770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe40400c920 tx=0x7fe40400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe4127fc640 1 -- 172.21.15.148:0/1322911495 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe404007c70 con 0x7fe414104a30 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe4127fc640 1 -- 172.21.15.148:0/1322911495 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe404007e10 con 0x7fe414104a30 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe41b81c640 1 -- 172.21.15.148:0/1322911495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4141a8aa0 con 0x7fe414104a30 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe4127fc640 1 -- 172.21.15.148:0/1322911495 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe404018820 con 0x7fe414104a30 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.853+0000 7fe41b81c640 1 -- 172.21.15.148:0/1322911495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4141a8fb0 con 0x7fe414104a30 2024-09-21T01:12:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.854+0000 7fe41b81c640 1 -- 172.21.15.148:0/1322911495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe41406c260 con 0x7fe414104a30 2024-09-21T01:12:32.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.856+0000 7fe4127fc640 1 -- 172.21.15.148:0/1322911495 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fe40400f450 con 0x7fe414104a30 2024-09-21T01:12:32.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.856+0000 7fe4127fc640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe3fc0b65a0 0x7fe3fc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:32.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.856+0000 7fe4127fc640 1 -- 172.21.15.148:0/1322911495 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fe4040e7790 con 0x7fe414104a30 2024-09-21T01:12:32.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.856+0000 7fe418db7640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe3fc0b65a0 0x7fe3fc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:32.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.857+0000 7fe418db7640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe3fc0b65a0 0x7fe3fc0b8ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe408009230 tx=0x7fe408031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:32.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:32.860+0000 7fe4127fc640 1 -- 172.21.15.148:0/1322911495 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe404014030 con 0x7fe414104a30 2024-09-21T01:12:33.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.075+0000 7fe41b81c640 1 -- 172.21.15.148:0/1322911495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe414104e40 con 0x7fe414104a30 2024-09-21T01:12:33.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.076+0000 7fe4127fc640 1 -- 172.21.15.148:0/1322911495 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11926 (secure 0 0 0) 0x7fe4040ae100 con 0x7fe414104a30 2024-09-21T01:12:33.077 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:33.077 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":23,"btime":"2024-09-21T01:12:23:525439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:12:22.780555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24646,24631]},"id":1}]} 2024-09-21T01:12:33.077 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 23 2024-09-21T01:12:33.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 -- 172.21.15.148:0/1322911495 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe3fc0b65a0 msgr2=0x7fe3fc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:33.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe3fc0b65a0 0x7fe3fc0b8ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe408009230 tx=0x7fe408031400 comp rx=0 tx=0).stop 2024-09-21T01:12:33.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 -- 172.21.15.148:0/1322911495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414104a30 msgr2=0x7fe414102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:33.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414104a30 0x7fe414102770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe40400c920 tx=0x7fe40400cde0 comp rx=0 tx=0).stop 2024-09-21T01:12:33.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 -- 172.21.15.148:0/1322911495 shutdown_connections 2024-09-21T01:12:33.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe3fc0b65a0 0x7fe3fc0b8ab0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:33.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41410de90 0x7fe4141031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:33.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe414105380 0x7fe414102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:33.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 --2- 172.21.15.148:0/1322911495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414104a30 0x7fe414102770 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:33.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 -- 172.21.15.148:0/1322911495 >> 172.21.15.148:0/1322911495 conn(0x7fe414079770 msgr2=0x7fe414100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:33.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 -- 172.21.15.148:0/1322911495 shutdown_connections 2024-09-21T01:12:33.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:33.078+0000 7fe41b81c640 1 -- 172.21.15.148:0/1322911495 wait complete. 2024-09-21T01:12:33.700 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:33 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1322911495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:12:33.730 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:12:33.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:33 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1322911495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:12:33.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:33 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1322911495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:12:33.976 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:34.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.453+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/2228239028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a4103b60 msgr2=0x7fc6a4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:34.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.453+0000 7fc6ab5ec640 1 --2- 172.21.15.148:0/2228239028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a4103b60 0x7fc6a4103f70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc694009900 tx=0x7fc69402a410 comp rx=0 tx=0).stop 2024-09-21T01:12:34.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.453+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/2228239028 shutdown_connections 2024-09-21T01:12:34.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.453+0000 7fc6ab5ec640 1 --2- 172.21.15.148:0/2228239028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a4109df0 0x7fc6a4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:34.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.453+0000 7fc6ab5ec640 1 --2- 172.21.15.148:0/2228239028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a41094a0 0x7fc6a41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:34.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.453+0000 7fc6ab5ec640 1 --2- 172.21.15.148:0/2228239028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a4103b60 0x7fc6a4103f70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:34.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.453+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/2228239028 >> 172.21.15.148:0/2228239028 conn(0x7fc6a407b850 msgr2=0x7fc6a407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:34.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.453+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/2228239028 shutdown_connections 2024-09-21T01:12:34.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.453+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/2228239028 wait complete. 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.454+0000 7fc6ab5ec640 1 Processor -- start 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.454+0000 7fc6ab5ec640 1 -- start start 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.454+0000 7fc6ab5ec640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a4103b60 0x7fc6a419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.454+0000 7fc6ab5ec640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a41094a0 0x7fc6a419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.454+0000 7fc6ab5ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a4109df0 0x7fc6a419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.454+0000 7fc6ab5ec640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a4113b70 con 0x7fc6a4109df0 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.454+0000 7fc6ab5ec640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a41139f0 con 0x7fc6a4103b60 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.454+0000 7fc6ab5ec640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a4113cf0 con 0x7fc6a41094a0 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a9b89640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a4109df0 0x7fc6a419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a9b89640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a4109df0 0x7fc6a419fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50034/0 (socket says 172.21.15.148:50034) 2024-09-21T01:12:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a9b89640 1 -- 172.21.15.148:0/3033689372 learned_addr learned my addr 172.21.15.148:0/3033689372 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a8b87640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a41094a0 0x7fc6a419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a9388640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a4103b60 0x7fc6a419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a9b89640 1 -- 172.21.15.148:0/3033689372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a41094a0 msgr2=0x7fc6a419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a9b89640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a41094a0 0x7fc6a419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a9b89640 1 -- 172.21.15.148:0/3033689372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a4103b60 msgr2=0x7fc6a419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a9b89640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a4103b60 0x7fc6a419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a9b89640 1 -- 172.21.15.148:0/3033689372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a41a0530 con 0x7fc6a4109df0 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6a9b89640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a4109df0 0x7fc6a419fe00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00b970 tx=0x7fc69c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc69a7fc640 1 -- 172.21.15.148:0/3033689372 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c019070 con 0x7fc6a4109df0 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc69a7fc640 1 -- 172.21.15.148:0/3033689372 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc69c014440 con 0x7fc6a4109df0 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/3033689372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a41a0820 con 0x7fc6a4109df0 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc69a7fc640 1 -- 172.21.15.148:0/3033689372 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c0075d0 con 0x7fc6a4109df0 2024-09-21T01:12:34.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.455+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/3033689372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a41a6f80 con 0x7fc6a4109df0 2024-09-21T01:12:34.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.457+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/3033689372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a4103ff0 con 0x7fc6a4109df0 2024-09-21T01:12:34.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.458+0000 7fc69a7fc640 1 -- 172.21.15.148:0/3033689372 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fc69c01c070 con 0x7fc6a4109df0 2024-09-21T01:12:34.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.459+0000 7fc69a7fc640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc6900b6620 0x7fc6900b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:34.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.459+0000 7fc6a9388640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc6900b6620 0x7fc6900b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:34.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.459+0000 7fc69a7fc640 1 -- 172.21.15.148:0/3033689372 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fc69c0e6c00 con 0x7fc6a4109df0 2024-09-21T01:12:34.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.459+0000 7fc6a9388640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc6900b6620 0x7fc6900b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc694031440 tx=0x7fc694031c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:34.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.462+0000 7fc69a7fc640 1 -- 172.21.15.148:0/3033689372 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc69c0ad4e0 con 0x7fc6a4109df0 2024-09-21T01:12:34.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:34 smithi148 ceph-mon[31000]: pgmap v294: 97 pgs: 97 active+clean; 625 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-21T01:12:34.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.642+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/3033689372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6a402e640 con 0x7fc6a4109df0 2024-09-21T01:12:34.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.643+0000 7fc69a7fc640 1 -- 172.21.15.148:0/3033689372 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22386 (secure 0 0 0) 0x7fc69c0b18c0 con 0x7fc6a4109df0 2024-09-21T01:12:34.645 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:34.645 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:11.894328+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/3033689372 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc6900b6620 msgr2=0x7fc6900b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc6900b6620 0x7fc6900b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc694031440 tx=0x7fc694031c90 comp rx=0 tx=0).stop 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/3033689372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a4109df0 msgr2=0x7fc6a419fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a4109df0 0x7fc6a419fe00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00b970 tx=0x7fc69c00bd70 comp rx=0 tx=0).stop 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/3033689372 shutdown_connections 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc6900b6620 0x7fc6900b8b30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6a4109df0 0x7fc6a419fe00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6a41094a0 0x7fc6a419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 --2- 172.21.15.148:0/3033689372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6a4103b60 0x7fc6a419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/3033689372 >> 172.21.15.148:0/3033689372 conn(0x7fc6a407b850 msgr2=0x7fc6a41075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/3033689372 shutdown_connections 2024-09-21T01:12:34.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:34.646+0000 7fc6ab5ec640 1 -- 172.21.15.148:0/3033689372 wait complete. 2024-09-21T01:12:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:34 smithi181 ceph-mon[34811]: pgmap v294: 97 pgs: 97 active+clean; 625 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-21T01:12:34.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:34 smithi157 ceph-mon[34140]: pgmap v294: 97 pgs: 97 active+clean; 625 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-21T01:12:35.261 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T01:12:35.261 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:12:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:35.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:35 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3033689372' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:35 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3033689372' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:35.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:35 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3033689372' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:36.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.000+0000 7fb3ba62c640 1 -- 172.21.15.148:0/2364842992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3b4108670 msgr2=0x7fb3b4108a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.000+0000 7fb3ba62c640 1 --2- 172.21.15.148:0/2364842992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3b4108670 0x7fb3b4108a80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009900 tx=0x7fb39c02a410 comp rx=0 tx=0).stop 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.000+0000 7fb3ba62c640 1 -- 172.21.15.148:0/2364842992 shutdown_connections 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.000+0000 7fb3ba62c640 1 --2- 172.21.15.148:0/2364842992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3b4108670 0x7fb3b4108a80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.000+0000 7fb3ba62c640 1 --2- 172.21.15.148:0/2364842992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3b4108fc0 0x7fb3b410f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.000+0000 7fb3ba62c640 1 --2- 172.21.15.148:0/2364842992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3b4103230 0x7fb3b4103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.000+0000 7fb3ba62c640 1 -- 172.21.15.148:0/2364842992 >> 172.21.15.148:0/2364842992 conn(0x7fb3b4079ea0 msgr2=0x7fb3b407a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.000+0000 7fb3ba62c640 1 -- 172.21.15.148:0/2364842992 shutdown_connections 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.000+0000 7fb3ba62c640 1 -- 172.21.15.148:0/2364842992 wait complete. 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3ba62c640 1 Processor -- start 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3ba62c640 1 -- start start 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3ba62c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3b4103230 0x7fb3b419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3ba62c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3b4108670 0x7fb3b419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3ba62c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3b4108fc0 0x7fb3b41a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3ba62c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b4112cc0 con 0x7fb3b4108670 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3ba62c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b4112b40 con 0x7fb3b4108fc0 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3ba62c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b4112e40 con 0x7fb3b4103230 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3b37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3b4108670 0x7fb3b419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3b37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3b4108670 0x7fb3b419adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50048/0 (socket says 172.21.15.148:50048) 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.001+0000 7fb3b37fe640 1 -- 172.21.15.148:0/1383001842 learned_addr learned my addr 172.21.15.148:0/1383001842 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b8bc9640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3b4108fc0 0x7fb3b41a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b3fff640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3b4103230 0x7fb3b419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b37fe640 1 -- 172.21.15.148:0/1383001842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3b4103230 msgr2=0x7fb3b419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b37fe640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3b4103230 0x7fb3b419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b37fe640 1 -- 172.21.15.148:0/1383001842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3b4108fc0 msgr2=0x7fb3b41a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b37fe640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3b4108fc0 0x7fb3b41a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:36.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b37fe640 1 -- 172.21.15.148:0/1383001842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b41a0790 con 0x7fb3b4108670 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b3fff640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3b4103230 0x7fb3b419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b8bc9640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3b4108fc0 0x7fb3b41a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b37fe640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3b4108670 0x7fb3b419adc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb39c02a930 tx=0x7fb39c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b17fa640 1 -- 172.21.15.148:0/1383001842 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c03f030 con 0x7fb3b4108670 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3ba62c640 1 -- 172.21.15.148:0/1383001842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b41a0a20 con 0x7fb3b4108670 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b17fa640 1 -- 172.21.15.148:0/1383001842 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb39c003cb0 con 0x7fb3b4108670 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3b17fa640 1 -- 172.21.15.148:0/1383001842 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c035070 con 0x7fb3b4108670 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.002+0000 7fb3ba62c640 1 -- 172.21.15.148:0/1383001842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b41a71e0 con 0x7fb3b4108670 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.003+0000 7fb3ba62c640 1 -- 172.21.15.148:0/1383001842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b4104040 con 0x7fb3b4108670 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.005+0000 7fb3b17fa640 1 -- 172.21.15.148:0/1383001842 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fb39c042030 con 0x7fb3b4108670 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.005+0000 7fb3b17fa640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb3a00b65a0 0x7fb3a00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.005+0000 7fb3b3fff640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb3a00b65a0 0x7fb3a00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.005+0000 7fb3b17fa640 1 -- 172.21.15.148:0/1383001842 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fb39c107df0 con 0x7fb3b4108670 2024-09-21T01:12:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.006+0000 7fb3b3fff640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb3a00b65a0 0x7fb3a00b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40058c0 tx=0x7fb3a4005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:36.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.009+0000 7fb3b17fa640 1 -- 172.21.15.148:0/1383001842 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb39c0ce6d0 con 0x7fb3b4108670 2024-09-21T01:12:36.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.184+0000 7fb3ba62c640 1 -- 172.21.15.148:0/1383001842 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3b406b9a0 con 0x7fb3a00b65a0 2024-09-21T01:12:36.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.191+0000 7fb3b17fa640 1 -- 172.21.15.148:0/1383001842 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258691 (secure 0 0 0) 0x7fb3b406b9a0 con 0x7fb3a00b65a0 2024-09-21T01:12:36.194 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:36.195 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-21T01:12:36.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 -- 172.21.15.148:0/1383001842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb3a00b65a0 msgr2=0x7fb3a00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:36.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb3a00b65a0 0x7fb3a00b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40058c0 tx=0x7fb3a4005d30 comp rx=0 tx=0).stop 2024-09-21T01:12:36.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 -- 172.21.15.148:0/1383001842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3b4108670 msgr2=0x7fb3b419adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:36.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3b4108670 0x7fb3b419adc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb39c02a930 tx=0x7fb39c004270 comp rx=0 tx=0).stop 2024-09-21T01:12:36.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 -- 172.21.15.148:0/1383001842 shutdown_connections 2024-09-21T01:12:36.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb3a00b65a0 0x7fb3a00b8ab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:36.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3b4108670 0x7fb3b419adc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:36.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3b4108fc0 0x7fb3b41a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:36.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 --2- 172.21.15.148:0/1383001842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3b4103230 0x7fb3b419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:36.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 -- 172.21.15.148:0/1383001842 >> 172.21.15.148:0/1383001842 conn(0x7fb3b4079ea0 msgr2=0x7fb3b41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:36.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 -- 172.21.15.148:0/1383001842 shutdown_connections 2024-09-21T01:12:36.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:36.194+0000 7fb3ba62c640 1 -- 172.21.15.148:0/1383001842 wait complete. 2024-09-21T01:12:36.515 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:36 smithi148 ceph-mon[31000]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:12:36.515 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:36 smithi148 ceph-mon[31000]: pgmap v295: 97 pgs: 97 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-21T01:12:36.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:36 smithi181 ceph-mon[34811]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:12:36.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:36 smithi181 ceph-mon[34811]: pgmap v295: 97 pgs: 97 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-21T01:12:36.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:36 smithi157 ceph-mon[34140]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:12:36.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:36 smithi157 ceph-mon[34140]: pgmap v295: 97 pgs: 97 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-21T01:12:36.927 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-21T01:12:34.314925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639806,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":162,"num_read_kb":161,"num_write":268,"num_write_kb":2241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219,"ondisk_log_size":219,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385528,"kb_used_data":11320,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556296,"statfs":{"total":1151940427776,"available":1151545647104,"internally_reserved":0,"allocated":11591680,"data_stored":6443721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44418,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":79,"num_read_kb":91,"num_write":50,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003068"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328637+0000","last_change":"2024-09-21T01:12:11.314815+0000","last_active":"2024-09-21T01:12:12.328637+0000","last_peered":"2024-09-21T01:12:12.328637+0000","last_clean":"2024-09-21T01:12:12.328637+0000","last_became_active":"2024-09-21T01:12:11.314139+0000","last_became_peered":"2024-09-21T01:12:11.314139+0000","last_unstale":"2024-09-21T01:12:12.328637+0000","last_undegraded":"2024-09-21T01:12:12.328637+0000","last_fullsized":"2024-09-21T01:12:12.328637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.538846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328669+0000","last_change":"2024-09-21T01:12:11.309915+0000","last_active":"2024-09-21T01:12:12.328669+0000","last_peered":"2024-09-21T01:12:12.328669+0000","last_clean":"2024-09-21T01:12:12.328669+0000","last_became_active":"2024-09-21T01:12:11.309551+0000","last_became_peered":"2024-09-21T01:12:11.309551+0000","last_unstale":"2024-09-21T01:12:12.328669+0000","last_undegraded":"2024-09-21T01:12:12.328669+0000","last_fullsized":"2024-09-21T01:12:12.328669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.568041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328664+0000","last_change":"2024-09-21T01:12:11.306393+0000","last_active":"2024-09-21T01:12:12.328664+0000","last_peered":"2024-09-21T01:12:12.328664+0000","last_clean":"2024-09-21T01:12:12.328664+0000","last_became_active":"2024-09-21T01:12:11.306035+0000","last_became_peered":"2024-09-21T01:12:11.306035+0000","last_unstale":"2024-09-21T01:12:12.328664+0000","last_undegraded":"2024-09-21T01:12:12.328664+0000","last_fullsized":"2024-09-21T01:12:12.328664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:20.528141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325130+0000","last_change":"2024-09-21T01:12:11.302339+0000","last_active":"2024-09-21T01:12:12.325130+0000","last_peered":"2024-09-21T01:12:12.325130+0000","last_clean":"2024-09-21T01:12:12.325130+0000","last_became_active":"2024-09-21T01:12:11.301890+0000","last_became_peered":"2024-09-21T01:12:11.301890+0000","last_unstale":"2024-09-21T01:12:12.325130+0000","last_undegraded":"2024-09-21T01:12:12.325130+0000","last_fullsized":"2024-09-21T01:12:12.325130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:34.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325398+0000","last_change":"2024-09-21T01:12:11.299171+0000","last_active":"2024-09-21T01:12:12.325398+0000","last_peered":"2024-09-21T01:12:12.325398+0000","last_clean":"2024-09-21T01:12:12.325398+0000","last_became_active":"2024-09-21T01:12:11.298764+0000","last_became_peered":"2024-09-21T01:12:11.298764+0000","last_unstale":"2024-09-21T01:12:12.325398+0000","last_undegraded":"2024-09-21T01:12:12.325398+0000","last_fullsized":"2024-09-21T01:12:12.325398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:02.078587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325383+0000","last_change":"2024-09-21T01:12:11.307909+0000","last_active":"2024-09-21T01:12:12.325383+0000","last_peered":"2024-09-21T01:12:12.325383+0000","last_clean":"2024-09-21T01:12:12.325383+0000","last_became_active":"2024-09-21T01:12:11.307546+0000","last_became_peered":"2024-09-21T01:12:11.307546+0000","last_unstale":"2024-09-21T01:12:12.325383+0000","last_undegraded":"2024-09-21T01:12:12.325383+0000","last_fullsized":"2024-09-21T01:12:12.325383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:48.683684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311471+0000","last_change":"2024-09-21T01:12:11.309402+0000","last_active":"2024-09-21T01:12:12.311471+0000","last_peered":"2024-09-21T01:12:12.311471+0000","last_clean":"2024-09-21T01:12:12.311471+0000","last_became_active":"2024-09-21T01:12:11.309019+0000","last_became_peered":"2024-09-21T01:12:11.309019+0000","last_unstale":"2024-09-21T01:12:12.311471+0000","last_undegraded":"2024-09-21T01:12:12.311471+0000","last_fullsized":"2024-09-21T01:12:12.311471+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:55.020239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325250+0000","last_change":"2024-09-21T01:12:11.308589+0000","last_active":"2024-09-21T01:12:12.325250+0000","last_peered":"2024-09-21T01:12:12.325250+0000","last_clean":"2024-09-21T01:12:12.325250+0000","last_became_active":"2024-09-21T01:12:11.308133+0000","last_became_peered":"2024-09-21T01:12:11.308133+0000","last_unstale":"2024-09-21T01:12:12.325250+0000","last_undegraded":"2024-09-21T01:12:12.325250+0000","last_fullsized":"2024-09-21T01:12:12.325250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:15.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.331462+0000","last_change":"2024-09-21T01:12:11.307861+0000","last_active":"2024-09-21T01:12:12.331462+0000","last_peered":"2024-09-21T01:12:12.331462+0000","last_clean":"2024-09-21T01:12:12.331462+0000","last_became_active":"2024-09-21T01:12:11.306693+0000","last_became_peered":"2024-09-21T01:12:11.306693+0000","last_unstale":"2024-09-21T01:12:12.331462+0000","last_undegraded":"2024-09-21T01:12:12.331462+0000","last_fullsized":"2024-09-21T01:12:12.331462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:06.000637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.326771+0000","last_change":"2024-09-21T01:12:11.311426+0000","last_active":"2024-09-21T01:12:12.326771+0000","last_peered":"2024-09-21T01:12:12.326771+0000","last_clean":"2024-09-21T01:12:12.326771+0000","last_became_active":"2024-09-21T01:12:11.309351+0000","last_became_peered":"2024-09-21T01:12:11.309351+0000","last_unstale":"2024-09-21T01:12:12.326771+0000","last_undegraded":"2024-09-21T01:12:12.326771+0000","last_fullsized":"2024-09-21T01:12:12.326771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:31.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311590+0000","last_change":"2024-09-21T01:12:11.312171+0000","last_active":"2024-09-21T01:12:12.311590+0000","last_peered":"2024-09-21T01:12:12.311590+0000","last_clean":"2024-09-21T01:12:12.311590+0000","last_became_active":"2024-09-21T01:12:11.311542+0000","last_became_peered":"2024-09-21T01:12:11.311542+0000","last_unstale":"2024-09-21T01:12:12.311590+0000","last_undegraded":"2024-09-21T01:12:12.311590+0000","last_fullsized":"2024-09-21T01:12:12.311590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:13.257463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325192+0000","last_change":"2024-09-21T01:12:11.301344+0000","last_active":"2024-09-21T01:12:12.325192+0000","last_peered":"2024-09-21T01:12:12.325192+0000","last_clean":"2024-09-21T01:12:12.325192+0000","last_became_active":"2024-09-21T01:12:11.300593+0000","last_became_peered":"2024-09-21T01:12:11.300593+0000","last_unstale":"2024-09-21T01:12:12.325192+0000","last_undegraded":"2024-09-21T01:12:12.325192+0000","last_fullsized":"2024-09-21T01:12:12.325192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:12.659972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311023+0000","last_change":"2024-09-21T01:12:11.298690+0000","last_active":"2024-09-21T01:12:12.311023+0000","last_peered":"2024-09-21T01:12:12.311023+0000","last_clean":"2024-09-21T01:12:12.311023+0000","last_became_active":"2024-09-21T01:12:11.298418+0000","last_became_peered":"2024-09-21T01:12:11.298418+0000","last_unstale":"2024-09-21T01:12:12.311023+0000","last_undegraded":"2024-09-21T01:12:12.311023+0000","last_fullsized":"2024-09-21T01:12:12.311023+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:08.311791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328826+0000","last_change":"2024-09-21T01:12:11.299382+0000","last_active":"2024-09-21T01:12:12.328826+0000","last_peered":"2024-09-21T01:12:12.328826+0000","last_clean":"2024-09-21T01:12:12.328826+0000","last_became_active":"2024-09-21T01:12:11.298428+0000","last_became_peered":"2024-09-21T01:12:11.298428+0000","last_unstale":"2024-09-21T01:12:12.328826+0000","last_undegraded":"2024-09-21T01:12:12.328826+0000","last_fullsized":"2024-09-21T01:12:12.328826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:02.472994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328617+0000","last_change":"2024-09-21T01:12:11.305018+0000","last_active":"2024-09-21T01:12:12.328617+0000","last_peered":"2024-09-21T01:12:12.328617+0000","last_clean":"2024-09-21T01:12:12.328617+0000","last_became_active":"2024-09-21T01:12:11.304607+0000","last_became_peered":"2024-09-21T01:12:11.304607+0000","last_unstale":"2024-09-21T01:12:12.328617+0000","last_undegraded":"2024-09-21T01:12:12.328617+0000","last_fullsized":"2024-09-21T01:12:12.328617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:39.552633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.330227+0000","last_change":"2024-09-21T01:12:11.308846+0000","last_active":"2024-09-21T01:12:12.330227+0000","last_peered":"2024-09-21T01:12:12.330227+0000","last_clean":"2024-09-21T01:12:12.330227+0000","last_became_active":"2024-09-21T01:12:11.308486+0000","last_became_peered":"2024-09-21T01:12:11.308486+0000","last_unstale":"2024-09-21T01:12:12.330227+0000","last_undegraded":"2024-09-21T01:12:12.330227+0000","last_fullsized":"2024-09-21T01:12:12.330227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:29.072947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.329067+0000","last_change":"2024-09-21T01:12:11.316277+0000","last_active":"2024-09-21T01:12:12.329067+0000","last_peered":"2024-09-21T01:12:12.329067+0000","last_clean":"2024-09-21T01:12:12.329067+0000","last_became_active":"2024-09-21T01:12:11.315364+0000","last_became_peered":"2024-09-21T01:12:11.315364+0000","last_unstale":"2024-09-21T01:12:12.329067+0000","last_undegraded":"2024-09-21T01:12:12.329067+0000","last_fullsized":"2024-09-21T01:12:12.329067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:50.281556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325254+0000","last_change":"2024-09-21T01:12:11.300761+0000","last_active":"2024-09-21T01:12:12.325254+0000","last_peered":"2024-09-21T01:12:12.325254+0000","last_clean":"2024-09-21T01:12:12.325254+0000","last_became_active":"2024-09-21T01:12:11.300343+0000","last_became_peered":"2024-09-21T01:12:11.300343+0000","last_unstale":"2024-09-21T01:12:12.325254+0000","last_undegraded":"2024-09-21T01:12:12.325254+0000","last_fullsized":"2024-09-21T01:12:12.325254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:29.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311900+0000","last_change":"2024-09-21T01:12:11.305370+0000","last_active":"2024-09-21T01:12:12.311900+0000","last_peered":"2024-09-21T01:12:12.311900+0000","last_clean":"2024-09-21T01:12:12.311900+0000","last_became_active":"2024-09-21T01:12:11.304991+0000","last_became_peered":"2024-09-21T01:12:11.304991+0000","last_unstale":"2024-09-21T01:12:12.311900+0000","last_undegraded":"2024-09-21T01:12:12.311900+0000","last_fullsized":"2024-09-21T01:12:12.311900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:12.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328197+0000","last_change":"2024-09-21T01:12:11.303981+0000","last_active":"2024-09-21T01:12:12.328197+0000","last_peered":"2024-09-21T01:12:12.328197+0000","last_clean":"2024-09-21T01:12:12.328197+0000","last_became_active":"2024-09-21T01:12:11.303602+0000","last_became_peered":"2024-09-21T01:12:11.303602+0000","last_unstale":"2024-09-21T01:12:12.328197+0000","last_undegraded":"2024-09-21T01:12:12.328197+0000","last_fullsized":"2024-09-21T01:12:12.328197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:24.513365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.310985+0000","last_change":"2024-09-21T01:12:11.302849+0000","last_active":"2024-09-21T01:12:12.310985+0000","last_peered":"2024-09-21T01:12:12.310985+0000","last_clean":"2024-09-21T01:12:12.310985+0000","last_became_active":"2024-09-21T01:12:11.302487+0000","last_became_peered":"2024-09-21T01:12:11.302487+0000","last_unstale":"2024-09-21T01:12:12.310985+0000","last_undegraded":"2024-09-21T01:12:12.310985+0000","last_fullsized":"2024-09-21T01:12:12.310985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:44.174213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.330509+0000","last_change":"2024-09-21T01:12:11.315578+0000","last_active":"2024-09-21T01:12:12.330509+0000","last_peered":"2024-09-21T01:12:12.330509+0000","last_clean":"2024-09-21T01:12:12.330509+0000","last_became_active":"2024-09-21T01:12:11.315174+0000","last_became_peered":"2024-09-21T01:12:11.315174+0000","last_unstale":"2024-09-21T01:12:12.330509+0000","last_undegraded":"2024-09-21T01:12:12.330509+0000","last_fullsized":"2024-09-21T01:12:12.330509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:46.172101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325366+0000","last_change":"2024-09-21T01:12:11.308086+0000","last_active":"2024-09-21T01:12:12.325366+0000","last_peered":"2024-09-21T01:12:12.325366+0000","last_clean":"2024-09-21T01:12:12.325366+0000","last_became_active":"2024-09-21T01:12:11.307248+0000","last_became_peered":"2024-09-21T01:12:11.307248+0000","last_unstale":"2024-09-21T01:12:12.325366+0000","last_undegraded":"2024-09-21T01:12:12.325366+0000","last_fullsized":"2024-09-21T01:12:12.325366+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:11.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325242+0000","last_change":"2024-09-21T01:12:11.301672+0000","last_active":"2024-09-21T01:12:12.325242+0000","last_peered":"2024-09-21T01:12:12.325242+0000","last_clean":"2024-09-21T01:12:12.325242+0000","last_became_active":"2024-09-21T01:12:11.298775+0000","last_became_peered":"2024-09-21T01:12:11.298775+0000","last_unstale":"2024-09-21T01:12:12.325242+0000","last_undegraded":"2024-09-21T01:12:12.325242+0000","last_fullsized":"2024-09-21T01:12:12.325242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:30.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.327545+0000","last_change":"2024-09-21T01:12:11.311947+0000","last_active":"2024-09-21T01:12:12.327545+0000","last_peered":"2024-09-21T01:12:12.327545+0000","last_clean":"2024-09-21T01:12:12.327545+0000","last_became_active":"2024-09-21T01:12:11.311616+0000","last_became_peered":"2024-09-21T01:12:11.311616+0000","last_unstale":"2024-09-21T01:12:12.327545+0000","last_undegraded":"2024-09-21T01:12:12.327545+0000","last_fullsized":"2024-09-21T01:12:12.327545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:25.727807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.312033+0000","last_change":"2024-09-21T01:12:11.312161+0000","last_active":"2024-09-21T01:12:12.312033+0000","last_peered":"2024-09-21T01:12:12.312033+0000","last_clean":"2024-09-21T01:12:12.312033+0000","last_became_active":"2024-09-21T01:12:11.311781+0000","last_became_peered":"2024-09-21T01:12:11.311781+0000","last_unstale":"2024-09-21T01:12:12.312033+0000","last_undegraded":"2024-09-21T01:12:12.312033+0000","last_fullsized":"2024-09-21T01:12:12.312033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:01.923801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.329639+0000","last_change":"2024-09-21T01:12:11.310698+0000","last_active":"2024-09-21T01:12:12.329639+0000","last_peered":"2024-09-21T01:12:12.329639+0000","last_clean":"2024-09-21T01:12:12.329639+0000","last_became_active":"2024-09-21T01:12:11.310226+0000","last_became_peered":"2024-09-21T01:12:11.310226+0000","last_unstale":"2024-09-21T01:12:12.329639+0000","last_undegraded":"2024-09-21T01:12:12.329639+0000","last_fullsized":"2024-09-21T01:12:12.329639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:27.428457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.310948+0000","last_change":"2024-09-21T01:12:11.294598+0000","last_active":"2024-09-21T01:12:12.310948+0000","last_peered":"2024-09-21T01:12:12.310948+0000","last_clean":"2024-09-21T01:12:12.310948+0000","last_became_active":"2024-09-21T01:12:11.293899+0000","last_became_peered":"2024-09-21T01:12:11.293899+0000","last_unstale":"2024-09-21T01:12:12.310948+0000","last_undegraded":"2024-09-21T01:12:12.310948+0000","last_fullsized":"2024-09-21T01:12:12.310948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.843199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328545+0000","last_change":"2024-09-21T01:12:11.295143+0000","last_active":"2024-09-21T01:12:12.328545+0000","last_peered":"2024-09-21T01:12:12.328545+0000","last_clean":"2024-09-21T01:12:12.328545+0000","last_became_active":"2024-09-21T01:12:11.294787+0000","last_became_peered":"2024-09-21T01:12:11.294787+0000","last_unstale":"2024-09-21T01:12:12.328545+0000","last_undegraded":"2024-09-21T01:12:12.328545+0000","last_fullsized":"2024-09-21T01:12:12.328545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:34.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311394+0000","last_change":"2024-09-21T01:12:11.307340+0000","last_active":"2024-09-21T01:12:12.311394+0000","last_peered":"2024-09-21T01:12:12.311394+0000","last_clean":"2024-09-21T01:12:12.311394+0000","last_became_active":"2024-09-21T01:12:11.306967+0000","last_became_peered":"2024-09-21T01:12:11.306967+0000","last_unstale":"2024-09-21T01:12:12.311394+0000","last_undegraded":"2024-09-21T01:12:12.311394+0000","last_fullsized":"2024-09-21T01:12:12.311394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:59.273742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311835+0000","last_change":"2024-09-21T01:12:11.307532+0000","last_active":"2024-09-21T01:12:12.311835+0000","last_peered":"2024-09-21T01:12:12.311835+0000","last_clean":"2024-09-21T01:12:12.311835+0000","last_became_active":"2024-09-21T01:12:11.307183+0000","last_became_peered":"2024-09-21T01:12:11.307183+0000","last_unstale":"2024-09-21T01:12:12.311835+0000","last_undegraded":"2024-09-21T01:12:12.311835+0000","last_fullsized":"2024-09-21T01:12:12.311835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:10.970723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328830+0000","last_change":"2024-09-21T01:12:11.308355+0000","last_active":"2024-09-21T01:12:12.328830+0000","last_peered":"2024-09-21T01:12:12.328830+0000","last_clean":"2024-09-21T01:12:12.328830+0000","last_became_active":"2024-09-21T01:12:11.307919+0000","last_became_peered":"2024-09-21T01:12:11.307919+0000","last_unstale":"2024-09-21T01:12:12.328830+0000","last_undegraded":"2024-09-21T01:12:12.328830+0000","last_fullsized":"2024-09-21T01:12:12.328830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:59.869646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324899+0000","last_change":"2024-09-21T01:12:11.298905+0000","last_active":"2024-09-21T01:12:12.324899+0000","last_peered":"2024-09-21T01:12:12.324899+0000","last_clean":"2024-09-21T01:12:12.324899+0000","last_became_active":"2024-09-21T01:12:11.298512+0000","last_became_peered":"2024-09-21T01:12:11.298512+0000","last_unstale":"2024-09-21T01:12:12.324899+0000","last_undegraded":"2024-09-21T01:12:12.324899+0000","last_fullsized":"2024-09-21T01:12:12.324899+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:05.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:29.295832+0000","last_change":"2024-09-21T01:12:09.294881+0000","last_active":"2024-09-21T01:12:29.295832+0000","last_peered":"2024-09-21T01:12:29.295832+0000","last_clean":"2024-09-21T01:12:29.295832+0000","last_became_active":"2024-09-21T01:12:09.294513+0000","last_became_peered":"2024-09-21T01:12:09.294513+0000","last_unstale":"2024-09-21T01:12:29.295832+0000","last_undegraded":"2024-09-21T01:12:29.295832+0000","last_fullsized":"2024-09-21T01:12:29.295832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:07.193879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325075+0000","last_change":"2024-09-21T01:12:11.300929+0000","last_active":"2024-09-21T01:12:12.325075+0000","last_peered":"2024-09-21T01:12:12.325075+0000","last_clean":"2024-09-21T01:12:12.325075+0000","last_became_active":"2024-09-21T01:12:11.299916+0000","last_became_peered":"2024-09-21T01:12:11.299916+0000","last_unstale":"2024-09-21T01:12:12.325075+0000","last_undegraded":"2024-09-21T01:12:12.325075+0000","last_fullsized":"2024-09-21T01:12:12.325075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:23.488659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.533198+0000","last_change":"2024-09-21T01:12:09.298594+0000","last_active":"2024-09-21T01:12:20.533198+0000","last_peered":"2024-09-21T01:12:20.533198+0000","last_clean":"2024-09-21T01:12:20.533198+0000","last_became_active":"2024-09-21T01:12:09.298130+0000","last_became_peered":"2024-09-21T01:12:09.298130+0000","last_unstale":"2024-09-21T01:12:20.533198+0000","last_undegraded":"2024-09-21T01:12:20.533198+0000","last_fullsized":"2024-09-21T01:12:20.533198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.964507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.531915+0000","last_change":"2024-09-21T01:12:09.295997+0000","last_active":"2024-09-21T01:12:20.531915+0000","last_peered":"2024-09-21T01:12:20.531915+0000","last_clean":"2024-09-21T01:12:20.531915+0000","last_became_active":"2024-09-21T01:12:09.295472+0000","last_became_peered":"2024-09-21T01:12:09.295472+0000","last_unstale":"2024-09-21T01:12:20.531915+0000","last_undegraded":"2024-09-21T01:12:20.531915+0000","last_fullsized":"2024-09-21T01:12:20.531915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:25.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325520+0000","last_change":"2024-09-21T01:12:11.306468+0000","last_active":"2024-09-21T01:12:12.325520+0000","last_peered":"2024-09-21T01:12:12.325520+0000","last_clean":"2024-09-21T01:12:12.325520+0000","last_became_active":"2024-09-21T01:12:11.304186+0000","last_became_peered":"2024-09-21T01:12:11.304186+0000","last_unstale":"2024-09-21T01:12:12.325520+0000","last_undegraded":"2024-09-21T01:12:12.325520+0000","last_fullsized":"2024-09-21T01:12:12.325520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:28.564879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325694+0000","last_change":"2024-09-21T01:12:09.295004+0000","last_active":"2024-09-21T01:12:12.325694+0000","last_peered":"2024-09-21T01:12:12.325694+0000","last_clean":"2024-09-21T01:12:12.325694+0000","last_became_active":"2024-09-21T01:12:09.294655+0000","last_became_peered":"2024-09-21T01:12:09.294655+0000","last_unstale":"2024-09-21T01:12:12.325694+0000","last_undegraded":"2024-09-21T01:12:12.325694+0000","last_fullsized":"2024-09-21T01:12:12.325694+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:35.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324479+0000","last_change":"2024-09-21T01:12:11.304252+0000","last_active":"2024-09-21T01:12:12.324479+0000","last_peered":"2024-09-21T01:12:12.324479+0000","last_clean":"2024-09-21T01:12:12.324479+0000","last_became_active":"2024-09-21T01:12:11.303876+0000","last_became_peered":"2024-09-21T01:12:11.303876+0000","last_unstale":"2024-09-21T01:12:12.324479+0000","last_undegraded":"2024-09-21T01:12:12.324479+0000","last_fullsized":"2024-09-21T01:12:12.324479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:48.460538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:29.295024+0000","last_change":"2024-09-21T01:12:09.298976+0000","last_active":"2024-09-21T01:12:29.295024+0000","last_peered":"2024-09-21T01:12:29.295024+0000","last_clean":"2024-09-21T01:12:29.295024+0000","last_became_active":"2024-09-21T01:12:09.298664+0000","last_became_peered":"2024-09-21T01:12:09.298664+0000","last_unstale":"2024-09-21T01:12:29.295024+0000","last_undegraded":"2024-09-21T01:12:29.295024+0000","last_fullsized":"2024-09-21T01:12:29.295024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:58.157391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.330872+0000","last_change":"2024-09-21T01:12:11.313400+0000","last_active":"2024-09-21T01:12:12.330872+0000","last_peered":"2024-09-21T01:12:12.330872+0000","last_clean":"2024-09-21T01:12:12.330872+0000","last_became_active":"2024-09-21T01:12:11.312940+0000","last_became_peered":"2024-09-21T01:12:11.312940+0000","last_unstale":"2024-09-21T01:12:12.330872+0000","last_undegraded":"2024-09-21T01:12:12.330872+0000","last_fullsized":"2024-09-21T01:12:12.330872+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:22.224157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.524326+0000","last_change":"2024-09-21T01:12:09.299266+0000","last_active":"2024-09-21T01:12:19.524326+0000","last_peered":"2024-09-21T01:12:19.524326+0000","last_clean":"2024-09-21T01:12:19.524326+0000","last_became_active":"2024-09-21T01:12:09.298932+0000","last_became_peered":"2024-09-21T01:12:09.298932+0000","last_unstale":"2024-09-21T01:12:19.524326+0000","last_undegraded":"2024-09-21T01:12:19.524326+0000","last_fullsized":"2024-09-21T01:12:19.524326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:51.546829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.329047+0000","last_change":"2024-09-21T01:12:11.296559+0000","last_active":"2024-09-21T01:12:12.329047+0000","last_peered":"2024-09-21T01:12:12.329047+0000","last_clean":"2024-09-21T01:12:12.329047+0000","last_became_active":"2024-09-21T01:12:11.296189+0000","last_became_peered":"2024-09-21T01:12:11.296189+0000","last_unstale":"2024-09-21T01:12:12.329047+0000","last_undegraded":"2024-09-21T01:12:12.329047+0000","last_fullsized":"2024-09-21T01:12:12.329047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:42.193216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.523238+0000","last_change":"2024-09-21T01:12:09.511908+0000","last_active":"2024-09-21T01:12:19.523238+0000","last_peered":"2024-09-21T01:12:19.523238+0000","last_clean":"2024-09-21T01:12:19.523238+0000","last_became_active":"2024-09-21T01:12:09.511550+0000","last_became_peered":"2024-09-21T01:12:09.511550+0000","last_unstale":"2024-09-21T01:12:19.523238+0000","last_undegraded":"2024-09-21T01:12:19.523238+0000","last_fullsized":"2024-09-21T01:12:19.523238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:08.743648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.331056+0000","last_change":"2024-09-21T01:12:11.316005+0000","last_active":"2024-09-21T01:12:12.331056+0000","last_peered":"2024-09-21T01:12:12.331056+0000","last_clean":"2024-09-21T01:12:12.331056+0000","last_became_active":"2024-09-21T01:12:11.315245+0000","last_became_peered":"2024-09-21T01:12:11.315245+0000","last_unstale":"2024-09-21T01:12:12.331056+0000","last_undegraded":"2024-09-21T01:12:12.331056+0000","last_fullsized":"2024-09-21T01:12:12.331056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:50.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'21","reported_seq":65,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:30.296831+0000","last_change":"2024-09-21T01:12:09.300010+0000","last_active":"2024-09-21T01:12:30.296831+0000","last_peered":"2024-09-21T01:12:30.296831+0000","last_clean":"2024-09-21T01:12:30.296831+0000","last_became_active":"2024-09-21T01:12:09.299652+0000","last_became_peered":"2024-09-21T01:12:09.299652+0000","last_unstale":"2024-09-21T01:12:30.296831+0000","last_undegraded":"2024-09-21T01:12:30.296831+0000","last_fullsized":"2024-09-21T01:12:30.296831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:18.610597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45203,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":56,"num_write":22,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325322+0000","last_change":"2024-09-21T01:12:11.308675+0000","last_active":"2024-09-21T01:12:12.325322+0000","last_peered":"2024-09-21T01:12:12.325322+0000","last_clean":"2024-09-21T01:12:12.325322+0000","last_became_active":"2024-09-21T01:12:11.308317+0000","last_became_peered":"2024-09-21T01:12:11.308317+0000","last_unstale":"2024-09-21T01:12:12.325322+0000","last_undegraded":"2024-09-21T01:12:12.325322+0000","last_fullsized":"2024-09-21T01:12:12.325322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:56.081404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.534313+0000","last_change":"2024-09-21T01:12:09.293716+0000","last_active":"2024-09-21T01:12:20.534313+0000","last_peered":"2024-09-21T01:12:20.534313+0000","last_clean":"2024-09-21T01:12:20.534313+0000","last_became_active":"2024-09-21T01:12:09.293205+0000","last_became_peered":"2024-09-21T01:12:09.293205+0000","last_unstale":"2024-09-21T01:12:20.534313+0000","last_undegraded":"2024-09-21T01:12:20.534313+0000","last_fullsized":"2024-09-21T01:12:20.534313+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:29.955953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.310664+0000","last_change":"2024-09-21T01:12:11.302736+0000","last_active":"2024-09-21T01:12:12.310664+0000","last_peered":"2024-09-21T01:12:12.310664+0000","last_clean":"2024-09-21T01:12:12.310664+0000","last_became_active":"2024-09-21T01:12:11.302357+0000","last_became_peered":"2024-09-21T01:12:11.302357+0000","last_unstale":"2024-09-21T01:12:12.310664+0000","last_undegraded":"2024-09-21T01:12:12.310664+0000","last_fullsized":"2024-09-21T01:12:12.310664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:34.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.524739+0000","last_change":"2024-09-21T01:12:09.295258+0000","last_active":"2024-09-21T01:12:19.524739+0000","last_peered":"2024-09-21T01:12:19.524739+0000","last_clean":"2024-09-21T01:12:19.524739+0000","last_became_active":"2024-09-21T01:12:09.294872+0000","last_became_peered":"2024-09-21T01:12:09.294872+0000","last_unstale":"2024-09-21T01:12:19.524739+0000","last_undegraded":"2024-09-21T01:12:19.524739+0000","last_fullsized":"2024-09-21T01:12:19.524739+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.216960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.312062+0000","last_change":"2024-09-21T01:12:11.303413+0000","last_active":"2024-09-21T01:12:12.312062+0000","last_peered":"2024-09-21T01:12:12.312062+0000","last_clean":"2024-09-21T01:12:12.312062+0000","last_became_active":"2024-09-21T01:12:11.303002+0000","last_became_peered":"2024-09-21T01:12:11.303002+0000","last_unstale":"2024-09-21T01:12:12.312062+0000","last_undegraded":"2024-09-21T01:12:12.312062+0000","last_fullsized":"2024-09-21T01:12:12.312062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:55.984699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:29.295130+0000","last_change":"2024-09-21T01:12:09.297392+0000","last_active":"2024-09-21T01:12:29.295130+0000","last_peered":"2024-09-21T01:12:29.295130+0000","last_clean":"2024-09-21T01:12:29.295130+0000","last_became_active":"2024-09-21T01:12:09.296882+0000","last_became_peered":"2024-09-21T01:12:09.296882+0000","last_unstale":"2024-09-21T01:12:29.295130+0000","last_undegraded":"2024-09-21T01:12:29.295130+0000","last_fullsized":"2024-09-21T01:12:29.295130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.598362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311164+0000","last_change":"2024-09-21T01:12:11.308021+0000","last_active":"2024-09-21T01:12:12.311164+0000","last_peered":"2024-09-21T01:12:12.311164+0000","last_clean":"2024-09-21T01:12:12.311164+0000","last_became_active":"2024-09-21T01:12:11.307643+0000","last_became_peered":"2024-09-21T01:12:11.307643+0000","last_unstale":"2024-09-21T01:12:12.311164+0000","last_undegraded":"2024-09-21T01:12:12.311164+0000","last_fullsized":"2024-09-21T01:12:12.311164+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:55.569855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.534585+0000","last_change":"2024-09-21T01:12:09.512120+0000","last_active":"2024-09-21T01:12:20.534585+0000","last_peered":"2024-09-21T01:12:20.534585+0000","last_clean":"2024-09-21T01:12:20.534585+0000","last_became_active":"2024-09-21T01:12:09.511631+0000","last_became_peered":"2024-09-21T01:12:09.511631+0000","last_unstale":"2024-09-21T01:12:20.534585+0000","last_undegraded":"2024-09-21T01:12:20.534585+0000","last_fullsized":"2024-09-21T01:12:20.534585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:13.187219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324670+0000","last_change":"2024-09-21T01:12:11.301633+0000","last_active":"2024-09-21T01:12:12.324670+0000","last_peered":"2024-09-21T01:12:12.324670+0000","last_clean":"2024-09-21T01:12:12.324670+0000","last_became_active":"2024-09-21T01:12:11.300638+0000","last_became_peered":"2024-09-21T01:12:11.300638+0000","last_unstale":"2024-09-21T01:12:12.324670+0000","last_undegraded":"2024-09-21T01:12:12.324670+0000","last_fullsized":"2024-09-21T01:12:12.324670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:42.245596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:21.278913+0000","last_change":"2024-09-21T01:12:09.297694+0000","last_active":"2024-09-21T01:12:21.278913+0000","last_peered":"2024-09-21T01:12:21.278913+0000","last_clean":"2024-09-21T01:12:21.278913+0000","last_became_active":"2024-09-21T01:12:09.297127+0000","last_became_peered":"2024-09-21T01:12:09.297127+0000","last_unstale":"2024-09-21T01:12:21.278913+0000","last_undegraded":"2024-09-21T01:12:21.278913+0000","last_fullsized":"2024-09-21T01:12:21.278913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:35.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328336+0000","last_change":"2024-09-21T01:12:11.303510+0000","last_active":"2024-09-21T01:12:12.328336+0000","last_peered":"2024-09-21T01:12:12.328336+0000","last_clean":"2024-09-21T01:12:12.328336+0000","last_became_active":"2024-09-21T01:12:11.303148+0000","last_became_peered":"2024-09-21T01:12:11.303148+0000","last_unstale":"2024-09-21T01:12:12.328336+0000","last_undegraded":"2024-09-21T01:12:12.328336+0000","last_fullsized":"2024-09-21T01:12:12.328336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:59.338185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325431+0000","last_change":"2024-09-21T01:12:09.293490+0000","last_active":"2024-09-21T01:12:12.325431+0000","last_peered":"2024-09-21T01:12:12.325431+0000","last_clean":"2024-09-21T01:12:12.325431+0000","last_became_active":"2024-09-21T01:12:09.293151+0000","last_became_peered":"2024-09-21T01:12:09.293151+0000","last_unstale":"2024-09-21T01:12:12.325431+0000","last_undegraded":"2024-09-21T01:12:12.325431+0000","last_fullsized":"2024-09-21T01:12:12.325431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:25.153547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.312026+0000","last_change":"2024-09-21T01:12:11.311313+0000","last_active":"2024-09-21T01:12:12.312026+0000","last_peered":"2024-09-21T01:12:12.312026+0000","last_clean":"2024-09-21T01:12:12.312026+0000","last_became_active":"2024-09-21T01:12:11.310908+0000","last_became_peered":"2024-09-21T01:12:11.310908+0000","last_unstale":"2024-09-21T01:12:12.312026+0000","last_undegraded":"2024-09-21T01:12:12.312026+0000","last_fullsized":"2024-09-21T01:12:12.312026+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:15.070802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.333166+0000","last_change":"2024-09-21T01:12:09.298861+0000","last_active":"2024-09-21T01:12:12.333166+0000","last_peered":"2024-09-21T01:12:12.333166+0000","last_clean":"2024-09-21T01:12:12.333166+0000","last_became_active":"2024-09-21T01:12:09.298504+0000","last_became_peered":"2024-09-21T01:12:09.298504+0000","last_unstale":"2024-09-21T01:12:12.333166+0000","last_undegraded":"2024-09-21T01:12:12.333166+0000","last_fullsized":"2024-09-21T01:12:12.333166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:10.446269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.312002+0000","last_change":"2024-09-21T01:12:11.309656+0000","last_active":"2024-09-21T01:12:12.312002+0000","last_peered":"2024-09-21T01:12:12.312002+0000","last_clean":"2024-09-21T01:12:12.312002+0000","last_became_active":"2024-09-21T01:12:11.308515+0000","last_became_peered":"2024-09-21T01:12:11.308515+0000","last_unstale":"2024-09-21T01:12:12.312002+0000","last_undegraded":"2024-09-21T01:12:12.312002+0000","last_fullsized":"2024-09-21T01:12:12.312002+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:38.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.534738+0000","last_change":"2024-09-21T01:12:09.511434+0000","last_active":"2024-09-21T01:12:20.534738+0000","last_peered":"2024-09-21T01:12:20.534738+0000","last_clean":"2024-09-21T01:12:20.534738+0000","last_became_active":"2024-09-21T01:12:09.511043+0000","last_became_peered":"2024-09-21T01:12:09.511043+0000","last_unstale":"2024-09-21T01:12:20.534738+0000","last_undegraded":"2024-09-21T01:12:20.534738+0000","last_fullsized":"2024-09-21T01:12:20.534738+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:23.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311875+0000","last_change":"2024-09-21T01:12:11.311989+0000","last_active":"2024-09-21T01:12:12.311875+0000","last_peered":"2024-09-21T01:12:12.311875+0000","last_clean":"2024-09-21T01:12:12.311875+0000","last_became_active":"2024-09-21T01:12:11.310338+0000","last_became_peered":"2024-09-21T01:12:11.310338+0000","last_unstale":"2024-09-21T01:12:12.311875+0000","last_undegraded":"2024-09-21T01:12:12.311875+0000","last_fullsized":"2024-09-21T01:12:12.311875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:12.675575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":91,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311439+0000","last_change":"2024-09-21T01:11:01.703479+0000","last_active":"2024-09-21T01:12:12.311439+0000","last_peered":"2024-09-21T01:12:12.311439+0000","last_clean":"2024-09-21T01:12:12.311439+0000","last_became_active":"2024-09-21T01:11:01.697351+0000","last_became_peered":"2024-09-21T01:11:01.697351+0000","last_unstale":"2024-09-21T01:12:12.311439+0000","last_undegraded":"2024-09-21T01:12:12.311439+0000","last_fullsized":"2024-09-21T01:12:12.311439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_clean_scrub_stamp":"2024-09-21T01:07:43.096984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:18.858448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:21.278568+0000","last_change":"2024-09-21T01:12:09.295468+0000","last_active":"2024-09-21T01:12:21.278568+0000","last_peered":"2024-09-21T01:12:21.278568+0000","last_clean":"2024-09-21T01:12:21.278568+0000","last_became_active":"2024-09-21T01:12:09.295092+0000","last_became_peered":"2024-09-21T01:12:09.295092+0000","last_unstale":"2024-09-21T01:12:21.278568+0000","last_undegraded":"2024-09-21T01:12:21.278568+0000","last_fullsized":"2024-09-21T01:12:21.278568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:08.153176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.326410+0000","last_change":"2024-09-21T01:12:11.308460+0000","last_active":"2024-09-21T01:12:12.326410+0000","last_peered":"2024-09-21T01:12:12.326410+0000","last_clean":"2024-09-21T01:12:12.326410+0000","last_became_active":"2024-09-21T01:12:11.307764+0000","last_became_peered":"2024-09-21T01:12:11.307764+0000","last_unstale":"2024-09-21T01:12:12.326410+0000","last_undegraded":"2024-09-21T01:12:12.326410+0000","last_fullsized":"2024-09-21T01:12:12.326410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:32.094902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.533649+0000","last_change":"2024-09-21T01:12:09.296477+0000","last_active":"2024-09-21T01:12:20.533649+0000","last_peered":"2024-09-21T01:12:20.533649+0000","last_clean":"2024-09-21T01:12:20.533649+0000","last_became_active":"2024-09-21T01:12:09.296153+0000","last_became_peered":"2024-09-21T01:12:09.296153+0000","last_unstale":"2024-09-21T01:12:20.533649+0000","last_undegraded":"2024-09-21T01:12:20.533649+0000","last_fullsized":"2024-09-21T01:12:20.533649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:42.380668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.310531+0000","last_change":"2024-09-21T01:12:11.297826+0000","last_active":"2024-09-21T01:12:12.310531+0000","last_peered":"2024-09-21T01:12:12.310531+0000","last_clean":"2024-09-21T01:12:12.310531+0000","last_became_active":"2024-09-21T01:12:11.297430+0000","last_became_peered":"2024-09-21T01:12:11.297430+0000","last_unstale":"2024-09-21T01:12:12.310531+0000","last_undegraded":"2024-09-21T01:12:12.310531+0000","last_fullsized":"2024-09-21T01:12:12.310531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:09.130500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:31.297385+0000","last_change":"2024-09-21T01:12:09.511173+0000","last_active":"2024-09-21T01:12:31.297385+0000","last_peered":"2024-09-21T01:12:31.297385+0000","last_clean":"2024-09-21T01:12:31.297385+0000","last_became_active":"2024-09-21T01:12:09.510840+0000","last_became_peered":"2024-09-21T01:12:09.510840+0000","last_unstale":"2024-09-21T01:12:31.297385+0000","last_undegraded":"2024-09-21T01:12:31.297385+0000","last_fullsized":"2024-09-21T01:12:31.297385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:22.161708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325424+0000","last_change":"2024-09-21T01:12:11.302741+0000","last_active":"2024-09-21T01:12:12.325424+0000","last_peered":"2024-09-21T01:12:12.325424+0000","last_clean":"2024-09-21T01:12:12.325424+0000","last_became_active":"2024-09-21T01:12:11.302401+0000","last_became_peered":"2024-09-21T01:12:11.302401+0000","last_unstale":"2024-09-21T01:12:12.325424+0000","last_undegraded":"2024-09-21T01:12:12.325424+0000","last_fullsized":"2024-09-21T01:12:12.325424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:27.087975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311984+0000","last_change":"2024-09-21T01:12:09.295447+0000","last_active":"2024-09-21T01:12:12.311984+0000","last_peered":"2024-09-21T01:12:12.311984+0000","last_clean":"2024-09-21T01:12:12.311984+0000","last_became_active":"2024-09-21T01:12:09.295057+0000","last_became_peered":"2024-09-21T01:12:09.295057+0000","last_unstale":"2024-09-21T01:12:12.311984+0000","last_undegraded":"2024-09-21T01:12:12.311984+0000","last_fullsized":"2024-09-21T01:12:12.311984+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:59.389877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325587+0000","last_change":"2024-09-21T01:12:11.304636+0000","last_active":"2024-09-21T01:12:12.325587+0000","last_peered":"2024-09-21T01:12:12.325587+0000","last_clean":"2024-09-21T01:12:12.325587+0000","last_became_active":"2024-09-21T01:12:11.303318+0000","last_became_peered":"2024-09-21T01:12:11.303318+0000","last_unstale":"2024-09-21T01:12:12.325587+0000","last_undegraded":"2024-09-21T01:12:12.325587+0000","last_fullsized":"2024-09-21T01:12:12.325587+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:39.377686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324801+0000","last_change":"2024-09-21T01:12:09.512826+0000","last_active":"2024-09-21T01:12:12.324801+0000","last_peered":"2024-09-21T01:12:12.324801+0000","last_clean":"2024-09-21T01:12:12.324801+0000","last_became_active":"2024-09-21T01:12:09.512429+0000","last_became_peered":"2024-09-21T01:12:09.512429+0000","last_unstale":"2024-09-21T01:12:12.324801+0000","last_undegraded":"2024-09-21T01:12:12.324801+0000","last_fullsized":"2024-09-21T01:12:12.324801+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:50.730842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.326292+0000","last_change":"2024-09-21T01:12:11.305558+0000","last_active":"2024-09-21T01:12:12.326292+0000","last_peered":"2024-09-21T01:12:12.326292+0000","last_clean":"2024-09-21T01:12:12.326292+0000","last_became_active":"2024-09-21T01:12:11.304934+0000","last_became_peered":"2024-09-21T01:12:11.304934+0000","last_unstale":"2024-09-21T01:12:12.326292+0000","last_undegraded":"2024-09-21T01:12:12.326292+0000","last_fullsized":"2024-09-21T01:12:12.326292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:52.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.523631+0000","last_change":"2024-09-21T01:12:09.511384+0000","last_active":"2024-09-21T01:12:19.523631+0000","last_peered":"2024-09-21T01:12:19.523631+0000","last_clean":"2024-09-21T01:12:19.523631+0000","last_became_active":"2024-09-21T01:12:09.511006+0000","last_became_peered":"2024-09-21T01:12:09.511006+0000","last_unstale":"2024-09-21T01:12:19.523631+0000","last_undegraded":"2024-09-21T01:12:19.523631+0000","last_fullsized":"2024-09-21T01:12:19.523631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:56.580855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311066+0000","last_change":"2024-09-21T01:12:11.304912+0000","last_active":"2024-09-21T01:12:12.311066+0000","last_peered":"2024-09-21T01:12:12.311066+0000","last_clean":"2024-09-21T01:12:12.311066+0000","last_became_active":"2024-09-21T01:12:11.304536+0000","last_became_peered":"2024-09-21T01:12:11.304536+0000","last_unstale":"2024-09-21T01:12:12.311066+0000","last_undegraded":"2024-09-21T01:12:12.311066+0000","last_fullsized":"2024-09-21T01:12:12.311066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:45.037231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'5","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:25.324031+0000","last_change":"2024-09-21T01:12:09.294680+0000","last_active":"2024-09-21T01:12:25.324031+0000","last_peered":"2024-09-21T01:12:25.324031+0000","last_clean":"2024-09-21T01:12:25.324031+0000","last_became_active":"2024-09-21T01:12:09.294289+0000","last_became_peered":"2024-09-21T01:12:09.294289+0000","last_unstale":"2024-09-21T01:12:25.324031+0000","last_undegraded":"2024-09-21T01:12:25.324031+0000","last_fullsized":"2024-09-21T01:12:25.324031+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.824781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.327487+0000","last_change":"2024-09-21T01:12:11.305192+0000","last_active":"2024-09-21T01:12:12.327487+0000","last_peered":"2024-09-21T01:12:12.327487+0000","last_clean":"2024-09-21T01:12:12.327487+0000","last_became_active":"2024-09-21T01:12:11.304761+0000","last_became_peered":"2024-09-21T01:12:11.304761+0000","last_unstale":"2024-09-21T01:12:12.327487+0000","last_undegraded":"2024-09-21T01:12:12.327487+0000","last_fullsized":"2024-09-21T01:12:12.327487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:58.429511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.523804+0000","last_change":"2024-09-21T01:12:09.455476+0000","last_active":"2024-09-21T01:12:19.523804+0000","last_peered":"2024-09-21T01:12:19.523804+0000","last_clean":"2024-09-21T01:12:19.523804+0000","last_became_active":"2024-09-21T01:12:09.454981+0000","last_became_peered":"2024-09-21T01:12:09.454981+0000","last_unstale":"2024-09-21T01:12:19.523804+0000","last_undegraded":"2024-09-21T01:12:19.523804+0000","last_fullsized":"2024-09-21T01:12:19.523804+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:27.790928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328756+0000","last_change":"2024-09-21T01:12:11.300631+0000","last_active":"2024-09-21T01:12:12.328756+0000","last_peered":"2024-09-21T01:12:12.328756+0000","last_clean":"2024-09-21T01:12:12.328756+0000","last_became_active":"2024-09-21T01:12:11.300179+0000","last_became_peered":"2024-09-21T01:12:11.300179+0000","last_unstale":"2024-09-21T01:12:12.328756+0000","last_undegraded":"2024-09-21T01:12:12.328756+0000","last_fullsized":"2024-09-21T01:12:12.328756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:23.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.524123+0000","last_change":"2024-09-21T01:12:09.511406+0000","last_active":"2024-09-21T01:12:19.524123+0000","last_peered":"2024-09-21T01:12:19.524123+0000","last_clean":"2024-09-21T01:12:19.524123+0000","last_became_active":"2024-09-21T01:12:09.511117+0000","last_became_peered":"2024-09-21T01:12:09.511117+0000","last_unstale":"2024-09-21T01:12:19.524123+0000","last_undegraded":"2024-09-21T01:12:19.524123+0000","last_fullsized":"2024-09-21T01:12:19.524123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:18.100466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324510+0000","last_change":"2024-09-21T01:12:11.306933+0000","last_active":"2024-09-21T01:12:12.324510+0000","last_peered":"2024-09-21T01:12:12.324510+0000","last_clean":"2024-09-21T01:12:12.324510+0000","last_became_active":"2024-09-21T01:12:11.306516+0000","last_became_peered":"2024-09-21T01:12:11.306516+0000","last_unstale":"2024-09-21T01:12:12.324510+0000","last_undegraded":"2024-09-21T01:12:12.324510+0000","last_fullsized":"2024-09-21T01:12:12.324510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:40.524953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.524251+0000","last_change":"2024-09-21T01:12:09.297506+0000","last_active":"2024-09-21T01:12:19.524251+0000","last_peered":"2024-09-21T01:12:19.524251+0000","last_clean":"2024-09-21T01:12:19.524251+0000","last_became_active":"2024-09-21T01:12:09.297139+0000","last_became_peered":"2024-09-21T01:12:09.297139+0000","last_unstale":"2024-09-21T01:12:19.524251+0000","last_undegraded":"2024-09-21T01:12:19.524251+0000","last_fullsized":"2024-09-21T01:12:19.524251+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:05.641171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.329135+0000","last_change":"2024-09-21T01:12:11.314053+0000","last_active":"2024-09-21T01:12:12.329135+0000","last_peered":"2024-09-21T01:12:12.329135+0000","last_clean":"2024-09-21T01:12:12.329135+0000","last_became_active":"2024-09-21T01:12:11.313681+0000","last_became_peered":"2024-09-21T01:12:11.313681+0000","last_unstale":"2024-09-21T01:12:12.329135+0000","last_undegraded":"2024-09-21T01:12:12.329135+0000","last_fullsized":"2024-09-21T01:12:12.329135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.108030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311676+0000","last_change":"2024-09-21T01:12:09.298602+0000","last_active":"2024-09-21T01:12:12.311676+0000","last_peered":"2024-09-21T01:12:12.311676+0000","last_clean":"2024-09-21T01:12:12.311676+0000","last_became_active":"2024-09-21T01:12:09.297295+0000","last_became_peered":"2024-09-21T01:12:09.297295+0000","last_unstale":"2024-09-21T01:12:12.311676+0000","last_undegraded":"2024-09-21T01:12:12.311676+0000","last_fullsized":"2024-09-21T01:12:12.311676+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:27.253290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325685+0000","last_change":"2024-09-21T01:12:11.306120+0000","last_active":"2024-09-21T01:12:12.325685+0000","last_peered":"2024-09-21T01:12:12.325685+0000","last_clean":"2024-09-21T01:12:12.325685+0000","last_became_active":"2024-09-21T01:12:11.305771+0000","last_became_peered":"2024-09-21T01:12:11.305771+0000","last_unstale":"2024-09-21T01:12:12.325685+0000","last_undegraded":"2024-09-21T01:12:12.325685+0000","last_fullsized":"2024-09-21T01:12:12.325685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:38.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.524965+0000","last_change":"2024-09-21T01:12:09.293697+0000","last_active":"2024-09-21T01:12:19.524965+0000","last_peered":"2024-09-21T01:12:19.524965+0000","last_clean":"2024-09-21T01:12:19.524965+0000","last_became_active":"2024-09-21T01:12:09.293320+0000","last_became_peered":"2024-09-21T01:12:09.293320+0000","last_unstale":"2024-09-21T01:12:19.524965+0000","last_undegraded":"2024-09-21T01:12:19.524965+0000","last_fullsized":"2024-09-21T01:12:19.524965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:42.427416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311421+0000","last_change":"2024-09-21T01:12:11.312392+0000","last_active":"2024-09-21T01:12:12.311421+0000","last_peered":"2024-09-21T01:12:12.311421+0000","last_clean":"2024-09-21T01:12:12.311421+0000","last_became_active":"2024-09-21T01:12:11.311120+0000","last_became_peered":"2024-09-21T01:12:11.311120+0000","last_unstale":"2024-09-21T01:12:12.311421+0000","last_undegraded":"2024-09-21T01:12:12.311421+0000","last_fullsized":"2024-09-21T01:12:12.311421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:23.292367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324977+0000","last_change":"2024-09-21T01:12:11.301350+0000","last_active":"2024-09-21T01:12:12.324977+0000","last_peered":"2024-09-21T01:12:12.324977+0000","last_clean":"2024-09-21T01:12:12.324977+0000","last_became_active":"2024-09-21T01:12:11.299746+0000","last_became_peered":"2024-09-21T01:12:11.299746+0000","last_unstale":"2024-09-21T01:12:12.324977+0000","last_undegraded":"2024-09-21T01:12:12.324977+0000","last_fullsized":"2024-09-21T01:12:12.324977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:57.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.331919+0000","last_change":"2024-09-21T01:12:09.296499+0000","last_active":"2024-09-21T01:12:12.331919+0000","last_peered":"2024-09-21T01:12:12.331919+0000","last_clean":"2024-09-21T01:12:12.331919+0000","last_became_active":"2024-09-21T01:12:09.296000+0000","last_became_peered":"2024-09-21T01:12:09.296000+0000","last_unstale":"2024-09-21T01:12:12.331919+0000","last_undegraded":"2024-09-21T01:12:12.331919+0000","last_fullsized":"2024-09-21T01:12:12.331919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:37.278200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.330640+0000","last_change":"2024-09-21T01:12:11.314014+0000","last_active":"2024-09-21T01:12:12.330640+0000","last_peered":"2024-09-21T01:12:12.330640+0000","last_clean":"2024-09-21T01:12:12.330640+0000","last_became_active":"2024-09-21T01:12:11.312592+0000","last_became_peered":"2024-09-21T01:12:11.312592+0000","last_unstale":"2024-09-21T01:12:12.330640+0000","last_undegraded":"2024-09-21T01:12:12.330640+0000","last_fullsized":"2024-09-21T01:12:12.330640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.074667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.534177+0000","last_change":"2024-09-21T01:12:09.297088+0000","last_active":"2024-09-21T01:12:20.534177+0000","last_peered":"2024-09-21T01:12:20.534177+0000","last_clean":"2024-09-21T01:12:20.534177+0000","last_became_active":"2024-09-21T01:12:09.296707+0000","last_became_peered":"2024-09-21T01:12:09.296707+0000","last_unstale":"2024-09-21T01:12:20.534177+0000","last_undegraded":"2024-09-21T01:12:20.534177+0000","last_fullsized":"2024-09-21T01:12:20.534177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:50.138586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.329019+0000","last_change":"2024-09-21T01:12:11.300991+0000","last_active":"2024-09-21T01:12:12.329019+0000","last_peered":"2024-09-21T01:12:12.329019+0000","last_clean":"2024-09-21T01:12:12.329019+0000","last_became_active":"2024-09-21T01:12:11.299934+0000","last_became_peered":"2024-09-21T01:12:11.299934+0000","last_unstale":"2024-09-21T01:12:12.329019+0000","last_undegraded":"2024-09-21T01:12:12.329019+0000","last_fullsized":"2024-09-21T01:12:12.329019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:34.300051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.331160+0000","last_change":"2024-09-21T01:12:09.511289+0000","last_active":"2024-09-21T01:12:12.331160+0000","last_peered":"2024-09-21T01:12:12.331160+0000","last_clean":"2024-09-21T01:12:12.331160+0000","last_became_active":"2024-09-21T01:12:09.510879+0000","last_became_peered":"2024-09-21T01:12:09.510879+0000","last_unstale":"2024-09-21T01:12:12.331160+0000","last_undegraded":"2024-09-21T01:12:12.331160+0000","last_fullsized":"2024-09-21T01:12:12.331160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:37.950305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.326220+0000","last_change":"2024-09-21T01:12:11.312100+0000","last_active":"2024-09-21T01:12:12.326220+0000","last_peered":"2024-09-21T01:12:12.326220+0000","last_clean":"2024-09-21T01:12:12.326220+0000","last_became_active":"2024-09-21T01:12:11.311731+0000","last_became_peered":"2024-09-21T01:12:11.311731+0000","last_unstale":"2024-09-21T01:12:12.326220+0000","last_undegraded":"2024-09-21T01:12:12.326220+0000","last_fullsized":"2024-09-21T01:12:12.326220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:40.459020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.534071+0000","last_change":"2024-09-21T01:12:09.294759+0000","last_active":"2024-09-21T01:12:20.534071+0000","last_peered":"2024-09-21T01:12:20.534071+0000","last_clean":"2024-09-21T01:12:20.534071+0000","last_became_active":"2024-09-21T01:12:09.294391+0000","last_became_peered":"2024-09-21T01:12:09.294391+0000","last_unstale":"2024-09-21T01:12:20.534071+0000","last_undegraded":"2024-09-21T01:12:20.534071+0000","last_fullsized":"2024-09-21T01:12:20.534071+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:05.981058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49204,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":86,"num_read_kb":97,"num_write":143,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":156150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776144,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":378966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1454080,"data_stored":999853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103194,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":806912,"data_stored":379202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299423,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36132,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709020,"statfs":{"total":95995035648,"available":95958036480,"internally_reserved":0,"allocated":806912,"data_stored":379122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495651,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28388,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716764,"statfs":{"total":95995035648,"available":95965966336,"internally_reserved":0,"allocated":1396736,"data_stored":970935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626473,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36120,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709032,"statfs":{"total":95995035648,"available":95958048768,"internally_reserved":0,"allocated":794624,"data_stored":378591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32564,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712588,"statfs":{"total":95995035648,"available":95961690112,"internally_reserved":0,"allocated":1413120,"data_stored":970345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40284,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704868,"statfs":{"total":95995035648,"available":95953784832,"internally_reserved":0,"allocated":798720,"data_stored":379419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149750,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":378902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":424937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":423587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":379862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":45203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":55091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":47172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:12:36.932 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:12:37.178 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:37.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.668+0000 7f882cbb3640 1 -- 172.21.15.148:0/788491680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88281094a0 msgr2=0x7f88281098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:37.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.668+0000 7f882cbb3640 1 --2- 172.21.15.148:0/788491680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88281094a0 0x7f88281098b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f881c009900 tx=0x7f881c02a410 comp rx=0 tx=0).stop 2024-09-21T01:12:37.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.668+0000 7f882cbb3640 1 -- 172.21.15.148:0/788491680 shutdown_connections 2024-09-21T01:12:37.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.668+0000 7f882cbb3640 1 --2- 172.21.15.148:0/788491680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88281094a0 0x7f88281098b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:37.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.668+0000 7f882cbb3640 1 --2- 172.21.15.148:0/788491680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8828109df0 0x7f8828110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:37.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.668+0000 7f882cbb3640 1 --2- 172.21.15.148:0/788491680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8828103b60 0x7f8828103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:37.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.668+0000 7f882cbb3640 1 -- 172.21.15.148:0/788491680 >> 172.21.15.148:0/788491680 conn(0x7f882807b850 msgr2=0x7f882807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:37.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.668+0000 7f882cbb3640 1 -- 172.21.15.148:0/788491680 shutdown_connections 2024-09-21T01:12:37.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.668+0000 7f882cbb3640 1 -- 172.21.15.148:0/788491680 wait complete. 2024-09-21T01:12:37.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f882cbb3640 1 Processor -- start 2024-09-21T01:12:37.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f882cbb3640 1 -- start start 2024-09-21T01:12:37.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f882cbb3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8828103b60 0x7f882819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:37.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f882cbb3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88281094a0 0x7f882819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:37.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f882cbb3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8828109df0 0x7f882819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:37.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f882cbb3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8828113ab0 con 0x7f88281094a0 2024-09-21T01:12:37.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f882cbb3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8828113930 con 0x7f8828103b60 2024-09-21T01:12:37.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f882cbb3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8828113c30 con 0x7f8828109df0 2024-09-21T01:12:37.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f8825d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88281094a0 0x7f882819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f8825d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88281094a0 0x7f882819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46760/0 (socket says 172.21.15.148:46760) 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f8825d9b640 1 -- 172.21.15.148:0/866063832 learned_addr learned my addr 172.21.15.148:0/866063832 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f882659c640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8828103b60 0x7f882819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.669+0000 7f8826d9d640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8828109df0 0x7f882819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f8825d9b640 1 -- 172.21.15.148:0/866063832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8828109df0 msgr2=0x7f882819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f8825d9b640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8828109df0 0x7f882819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f8825d9b640 1 -- 172.21.15.148:0/866063832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8828103b60 msgr2=0x7f882819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f8825d9b640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8828103b60 0x7f882819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f8825d9b640 1 -- 172.21.15.148:0/866063832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88281a0450 con 0x7f88281094a0 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f8825d9b640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88281094a0 0x7f882819aa80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f881c02a930 tx=0x7f881c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f88177fe640 1 -- 172.21.15.148:0/866063832 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c03f030 con 0x7f88281094a0 2024-09-21T01:12:37.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f88177fe640 1 -- 172.21.15.148:0/866063832 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f881c003aa0 con 0x7f88281094a0 2024-09-21T01:12:37.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f882cbb3640 1 -- 172.21.15.148:0/866063832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88281a06e0 con 0x7f88281094a0 2024-09-21T01:12:37.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f88177fe640 1 -- 172.21.15.148:0/866063832 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c035070 con 0x7f88281094a0 2024-09-21T01:12:37.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.670+0000 7f882cbb3640 1 -- 172.21.15.148:0/866063832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88281a6ea0 con 0x7f88281094a0 2024-09-21T01:12:37.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.671+0000 7f882cbb3640 1 -- 172.21.15.148:0/866063832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8828104de0 con 0x7f88281094a0 2024-09-21T01:12:37.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.672+0000 7f88177fe640 1 -- 172.21.15.148:0/866063832 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f881c042030 con 0x7f88281094a0 2024-09-21T01:12:37.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.673+0000 7f88177fe640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f88100b65a0 0x7f88100b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:37.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.673+0000 7f882659c640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f88100b65a0 0x7f88100b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:37.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.673+0000 7f88177fe640 1 -- 172.21.15.148:0/866063832 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f881c107de0 con 0x7f88281094a0 2024-09-21T01:12:37.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.674+0000 7f882659c640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f88100b65a0 0x7f88100b8ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f881800bbe0 tx=0x7f881800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.676+0000 7f88177fe640 1 -- 172.21.15.148:0/866063832 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f881c0ce6c0 con 0x7f88281094a0 2024-09-21T01:12:37.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.848+0000 7f882cbb3640 1 -- 172.21.15.148:0/866063832 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8828063800 con 0x7f88100b65a0 2024-09-21T01:12:37.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.853+0000 7f88177fe640 1 -- 172.21.15.148:0/866063832 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258697 (secure 0 0 0) 0x7f8828063800 con 0x7f88100b65a0 2024-09-21T01:12:37.856 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:37.857 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 -- 172.21.15.148:0/866063832 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f88100b65a0 msgr2=0x7f88100b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f88100b65a0 0x7f88100b8ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f881800bbe0 tx=0x7f881800b390 comp rx=0 tx=0).stop 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 -- 172.21.15.148:0/866063832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88281094a0 msgr2=0x7f882819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88281094a0 0x7f882819aa80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f881c02a930 tx=0x7f881c004270 comp rx=0 tx=0).stop 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 -- 172.21.15.148:0/866063832 shutdown_connections 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f88100b65a0 0x7f88100b8ab0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88281094a0 0x7f882819aa80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8828109df0 0x7f882819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 --2- 172.21.15.148:0/866063832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8828103b60 0x7f882819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 -- 172.21.15.148:0/866063832 >> 172.21.15.148:0/866063832 conn(0x7f882807b850 msgr2=0x7f8828105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 -- 172.21.15.148:0/866063832 shutdown_connections 2024-09-21T01:12:37.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:37.856+0000 7f882cbb3640 1 -- 172.21.15.148:0/866063832 wait complete. 2024-09-21T01:12:38.584 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-21T01:12:36.315521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648344,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":188,"num_read_kb":180,"num_write":279,"num_write_kb":2254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385556,"kb_used_data":11348,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556268,"statfs":{"total":1151940427776,"available":1151545618432,"internally_reserved":0,"allocated":11620352,"data_stored":6468564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52866,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":103,"num_read_kb":108,"num_write":54,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003099"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328637+0000","last_change":"2024-09-21T01:12:11.314815+0000","last_active":"2024-09-21T01:12:12.328637+0000","last_peered":"2024-09-21T01:12:12.328637+0000","last_clean":"2024-09-21T01:12:12.328637+0000","last_became_active":"2024-09-21T01:12:11.314139+0000","last_became_peered":"2024-09-21T01:12:11.314139+0000","last_unstale":"2024-09-21T01:12:12.328637+0000","last_undegraded":"2024-09-21T01:12:12.328637+0000","last_fullsized":"2024-09-21T01:12:12.328637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.538846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328669+0000","last_change":"2024-09-21T01:12:11.309915+0000","last_active":"2024-09-21T01:12:12.328669+0000","last_peered":"2024-09-21T01:12:12.328669+0000","last_clean":"2024-09-21T01:12:12.328669+0000","last_became_active":"2024-09-21T01:12:11.309551+0000","last_became_peered":"2024-09-21T01:12:11.309551+0000","last_unstale":"2024-09-21T01:12:12.328669+0000","last_undegraded":"2024-09-21T01:12:12.328669+0000","last_fullsized":"2024-09-21T01:12:12.328669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.568041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328664+0000","last_change":"2024-09-21T01:12:11.306393+0000","last_active":"2024-09-21T01:12:12.328664+0000","last_peered":"2024-09-21T01:12:12.328664+0000","last_clean":"2024-09-21T01:12:12.328664+0000","last_became_active":"2024-09-21T01:12:11.306035+0000","last_became_peered":"2024-09-21T01:12:11.306035+0000","last_unstale":"2024-09-21T01:12:12.328664+0000","last_undegraded":"2024-09-21T01:12:12.328664+0000","last_fullsized":"2024-09-21T01:12:12.328664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:20.528141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325130+0000","last_change":"2024-09-21T01:12:11.302339+0000","last_active":"2024-09-21T01:12:12.325130+0000","last_peered":"2024-09-21T01:12:12.325130+0000","last_clean":"2024-09-21T01:12:12.325130+0000","last_became_active":"2024-09-21T01:12:11.301890+0000","last_became_peered":"2024-09-21T01:12:11.301890+0000","last_unstale":"2024-09-21T01:12:12.325130+0000","last_undegraded":"2024-09-21T01:12:12.325130+0000","last_fullsized":"2024-09-21T01:12:12.325130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:34.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325398+0000","last_change":"2024-09-21T01:12:11.299171+0000","last_active":"2024-09-21T01:12:12.325398+0000","last_peered":"2024-09-21T01:12:12.325398+0000","last_clean":"2024-09-21T01:12:12.325398+0000","last_became_active":"2024-09-21T01:12:11.298764+0000","last_became_peered":"2024-09-21T01:12:11.298764+0000","last_unstale":"2024-09-21T01:12:12.325398+0000","last_undegraded":"2024-09-21T01:12:12.325398+0000","last_fullsized":"2024-09-21T01:12:12.325398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:02.078587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325383+0000","last_change":"2024-09-21T01:12:11.307909+0000","last_active":"2024-09-21T01:12:12.325383+0000","last_peered":"2024-09-21T01:12:12.325383+0000","last_clean":"2024-09-21T01:12:12.325383+0000","last_became_active":"2024-09-21T01:12:11.307546+0000","last_became_peered":"2024-09-21T01:12:11.307546+0000","last_unstale":"2024-09-21T01:12:12.325383+0000","last_undegraded":"2024-09-21T01:12:12.325383+0000","last_fullsized":"2024-09-21T01:12:12.325383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:48.683684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311471+0000","last_change":"2024-09-21T01:12:11.309402+0000","last_active":"2024-09-21T01:12:12.311471+0000","last_peered":"2024-09-21T01:12:12.311471+0000","last_clean":"2024-09-21T01:12:12.311471+0000","last_became_active":"2024-09-21T01:12:11.309019+0000","last_became_peered":"2024-09-21T01:12:11.309019+0000","last_unstale":"2024-09-21T01:12:12.311471+0000","last_undegraded":"2024-09-21T01:12:12.311471+0000","last_fullsized":"2024-09-21T01:12:12.311471+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:55.020239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325250+0000","last_change":"2024-09-21T01:12:11.308589+0000","last_active":"2024-09-21T01:12:12.325250+0000","last_peered":"2024-09-21T01:12:12.325250+0000","last_clean":"2024-09-21T01:12:12.325250+0000","last_became_active":"2024-09-21T01:12:11.308133+0000","last_became_peered":"2024-09-21T01:12:11.308133+0000","last_unstale":"2024-09-21T01:12:12.325250+0000","last_undegraded":"2024-09-21T01:12:12.325250+0000","last_fullsized":"2024-09-21T01:12:12.325250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:15.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.331462+0000","last_change":"2024-09-21T01:12:11.307861+0000","last_active":"2024-09-21T01:12:12.331462+0000","last_peered":"2024-09-21T01:12:12.331462+0000","last_clean":"2024-09-21T01:12:12.331462+0000","last_became_active":"2024-09-21T01:12:11.306693+0000","last_became_peered":"2024-09-21T01:12:11.306693+0000","last_unstale":"2024-09-21T01:12:12.331462+0000","last_undegraded":"2024-09-21T01:12:12.331462+0000","last_fullsized":"2024-09-21T01:12:12.331462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:06.000637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.326771+0000","last_change":"2024-09-21T01:12:11.311426+0000","last_active":"2024-09-21T01:12:12.326771+0000","last_peered":"2024-09-21T01:12:12.326771+0000","last_clean":"2024-09-21T01:12:12.326771+0000","last_became_active":"2024-09-21T01:12:11.309351+0000","last_became_peered":"2024-09-21T01:12:11.309351+0000","last_unstale":"2024-09-21T01:12:12.326771+0000","last_undegraded":"2024-09-21T01:12:12.326771+0000","last_fullsized":"2024-09-21T01:12:12.326771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:31.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311590+0000","last_change":"2024-09-21T01:12:11.312171+0000","last_active":"2024-09-21T01:12:12.311590+0000","last_peered":"2024-09-21T01:12:12.311590+0000","last_clean":"2024-09-21T01:12:12.311590+0000","last_became_active":"2024-09-21T01:12:11.311542+0000","last_became_peered":"2024-09-21T01:12:11.311542+0000","last_unstale":"2024-09-21T01:12:12.311590+0000","last_undegraded":"2024-09-21T01:12:12.311590+0000","last_fullsized":"2024-09-21T01:12:12.311590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:13.257463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325192+0000","last_change":"2024-09-21T01:12:11.301344+0000","last_active":"2024-09-21T01:12:12.325192+0000","last_peered":"2024-09-21T01:12:12.325192+0000","last_clean":"2024-09-21T01:12:12.325192+0000","last_became_active":"2024-09-21T01:12:11.300593+0000","last_became_peered":"2024-09-21T01:12:11.300593+0000","last_unstale":"2024-09-21T01:12:12.325192+0000","last_undegraded":"2024-09-21T01:12:12.325192+0000","last_fullsized":"2024-09-21T01:12:12.325192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:12.659972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311023+0000","last_change":"2024-09-21T01:12:11.298690+0000","last_active":"2024-09-21T01:12:12.311023+0000","last_peered":"2024-09-21T01:12:12.311023+0000","last_clean":"2024-09-21T01:12:12.311023+0000","last_became_active":"2024-09-21T01:12:11.298418+0000","last_became_peered":"2024-09-21T01:12:11.298418+0000","last_unstale":"2024-09-21T01:12:12.311023+0000","last_undegraded":"2024-09-21T01:12:12.311023+0000","last_fullsized":"2024-09-21T01:12:12.311023+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:08.311791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328826+0000","last_change":"2024-09-21T01:12:11.299382+0000","last_active":"2024-09-21T01:12:12.328826+0000","last_peered":"2024-09-21T01:12:12.328826+0000","last_clean":"2024-09-21T01:12:12.328826+0000","last_became_active":"2024-09-21T01:12:11.298428+0000","last_became_peered":"2024-09-21T01:12:11.298428+0000","last_unstale":"2024-09-21T01:12:12.328826+0000","last_undegraded":"2024-09-21T01:12:12.328826+0000","last_fullsized":"2024-09-21T01:12:12.328826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:02.472994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328617+0000","last_change":"2024-09-21T01:12:11.305018+0000","last_active":"2024-09-21T01:12:12.328617+0000","last_peered":"2024-09-21T01:12:12.328617+0000","last_clean":"2024-09-21T01:12:12.328617+0000","last_became_active":"2024-09-21T01:12:11.304607+0000","last_became_peered":"2024-09-21T01:12:11.304607+0000","last_unstale":"2024-09-21T01:12:12.328617+0000","last_undegraded":"2024-09-21T01:12:12.328617+0000","last_fullsized":"2024-09-21T01:12:12.328617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:39.552633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.330227+0000","last_change":"2024-09-21T01:12:11.308846+0000","last_active":"2024-09-21T01:12:12.330227+0000","last_peered":"2024-09-21T01:12:12.330227+0000","last_clean":"2024-09-21T01:12:12.330227+0000","last_became_active":"2024-09-21T01:12:11.308486+0000","last_became_peered":"2024-09-21T01:12:11.308486+0000","last_unstale":"2024-09-21T01:12:12.330227+0000","last_undegraded":"2024-09-21T01:12:12.330227+0000","last_fullsized":"2024-09-21T01:12:12.330227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:29.072947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.329067+0000","last_change":"2024-09-21T01:12:11.316277+0000","last_active":"2024-09-21T01:12:12.329067+0000","last_peered":"2024-09-21T01:12:12.329067+0000","last_clean":"2024-09-21T01:12:12.329067+0000","last_became_active":"2024-09-21T01:12:11.315364+0000","last_became_peered":"2024-09-21T01:12:11.315364+0000","last_unstale":"2024-09-21T01:12:12.329067+0000","last_undegraded":"2024-09-21T01:12:12.329067+0000","last_fullsized":"2024-09-21T01:12:12.329067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:50.281556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325254+0000","last_change":"2024-09-21T01:12:11.300761+0000","last_active":"2024-09-21T01:12:12.325254+0000","last_peered":"2024-09-21T01:12:12.325254+0000","last_clean":"2024-09-21T01:12:12.325254+0000","last_became_active":"2024-09-21T01:12:11.300343+0000","last_became_peered":"2024-09-21T01:12:11.300343+0000","last_unstale":"2024-09-21T01:12:12.325254+0000","last_undegraded":"2024-09-21T01:12:12.325254+0000","last_fullsized":"2024-09-21T01:12:12.325254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:29.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311900+0000","last_change":"2024-09-21T01:12:11.305370+0000","last_active":"2024-09-21T01:12:12.311900+0000","last_peered":"2024-09-21T01:12:12.311900+0000","last_clean":"2024-09-21T01:12:12.311900+0000","last_became_active":"2024-09-21T01:12:11.304991+0000","last_became_peered":"2024-09-21T01:12:11.304991+0000","last_unstale":"2024-09-21T01:12:12.311900+0000","last_undegraded":"2024-09-21T01:12:12.311900+0000","last_fullsized":"2024-09-21T01:12:12.311900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:12.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328197+0000","last_change":"2024-09-21T01:12:11.303981+0000","last_active":"2024-09-21T01:12:12.328197+0000","last_peered":"2024-09-21T01:12:12.328197+0000","last_clean":"2024-09-21T01:12:12.328197+0000","last_became_active":"2024-09-21T01:12:11.303602+0000","last_became_peered":"2024-09-21T01:12:11.303602+0000","last_unstale":"2024-09-21T01:12:12.328197+0000","last_undegraded":"2024-09-21T01:12:12.328197+0000","last_fullsized":"2024-09-21T01:12:12.328197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:24.513365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.310985+0000","last_change":"2024-09-21T01:12:11.302849+0000","last_active":"2024-09-21T01:12:12.310985+0000","last_peered":"2024-09-21T01:12:12.310985+0000","last_clean":"2024-09-21T01:12:12.310985+0000","last_became_active":"2024-09-21T01:12:11.302487+0000","last_became_peered":"2024-09-21T01:12:11.302487+0000","last_unstale":"2024-09-21T01:12:12.310985+0000","last_undegraded":"2024-09-21T01:12:12.310985+0000","last_fullsized":"2024-09-21T01:12:12.310985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:44.174213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.330509+0000","last_change":"2024-09-21T01:12:11.315578+0000","last_active":"2024-09-21T01:12:12.330509+0000","last_peered":"2024-09-21T01:12:12.330509+0000","last_clean":"2024-09-21T01:12:12.330509+0000","last_became_active":"2024-09-21T01:12:11.315174+0000","last_became_peered":"2024-09-21T01:12:11.315174+0000","last_unstale":"2024-09-21T01:12:12.330509+0000","last_undegraded":"2024-09-21T01:12:12.330509+0000","last_fullsized":"2024-09-21T01:12:12.330509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:46.172101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325366+0000","last_change":"2024-09-21T01:12:11.308086+0000","last_active":"2024-09-21T01:12:12.325366+0000","last_peered":"2024-09-21T01:12:12.325366+0000","last_clean":"2024-09-21T01:12:12.325366+0000","last_became_active":"2024-09-21T01:12:11.307248+0000","last_became_peered":"2024-09-21T01:12:11.307248+0000","last_unstale":"2024-09-21T01:12:12.325366+0000","last_undegraded":"2024-09-21T01:12:12.325366+0000","last_fullsized":"2024-09-21T01:12:12.325366+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:11.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325242+0000","last_change":"2024-09-21T01:12:11.301672+0000","last_active":"2024-09-21T01:12:12.325242+0000","last_peered":"2024-09-21T01:12:12.325242+0000","last_clean":"2024-09-21T01:12:12.325242+0000","last_became_active":"2024-09-21T01:12:11.298775+0000","last_became_peered":"2024-09-21T01:12:11.298775+0000","last_unstale":"2024-09-21T01:12:12.325242+0000","last_undegraded":"2024-09-21T01:12:12.325242+0000","last_fullsized":"2024-09-21T01:12:12.325242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:30.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.327545+0000","last_change":"2024-09-21T01:12:11.311947+0000","last_active":"2024-09-21T01:12:12.327545+0000","last_peered":"2024-09-21T01:12:12.327545+0000","last_clean":"2024-09-21T01:12:12.327545+0000","last_became_active":"2024-09-21T01:12:11.311616+0000","last_became_peered":"2024-09-21T01:12:11.311616+0000","last_unstale":"2024-09-21T01:12:12.327545+0000","last_undegraded":"2024-09-21T01:12:12.327545+0000","last_fullsized":"2024-09-21T01:12:12.327545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:25.727807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.312033+0000","last_change":"2024-09-21T01:12:11.312161+0000","last_active":"2024-09-21T01:12:12.312033+0000","last_peered":"2024-09-21T01:12:12.312033+0000","last_clean":"2024-09-21T01:12:12.312033+0000","last_became_active":"2024-09-21T01:12:11.311781+0000","last_became_peered":"2024-09-21T01:12:11.311781+0000","last_unstale":"2024-09-21T01:12:12.312033+0000","last_undegraded":"2024-09-21T01:12:12.312033+0000","last_fullsized":"2024-09-21T01:12:12.312033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:01.923801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.329639+0000","last_change":"2024-09-21T01:12:11.310698+0000","last_active":"2024-09-21T01:12:12.329639+0000","last_peered":"2024-09-21T01:12:12.329639+0000","last_clean":"2024-09-21T01:12:12.329639+0000","last_became_active":"2024-09-21T01:12:11.310226+0000","last_became_peered":"2024-09-21T01:12:11.310226+0000","last_unstale":"2024-09-21T01:12:12.329639+0000","last_undegraded":"2024-09-21T01:12:12.329639+0000","last_fullsized":"2024-09-21T01:12:12.329639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:27.428457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.310948+0000","last_change":"2024-09-21T01:12:11.294598+0000","last_active":"2024-09-21T01:12:12.310948+0000","last_peered":"2024-09-21T01:12:12.310948+0000","last_clean":"2024-09-21T01:12:12.310948+0000","last_became_active":"2024-09-21T01:12:11.293899+0000","last_became_peered":"2024-09-21T01:12:11.293899+0000","last_unstale":"2024-09-21T01:12:12.310948+0000","last_undegraded":"2024-09-21T01:12:12.310948+0000","last_fullsized":"2024-09-21T01:12:12.310948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.843199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328545+0000","last_change":"2024-09-21T01:12:11.295143+0000","last_active":"2024-09-21T01:12:12.328545+0000","last_peered":"2024-09-21T01:12:12.328545+0000","last_clean":"2024-09-21T01:12:12.328545+0000","last_became_active":"2024-09-21T01:12:11.294787+0000","last_became_peered":"2024-09-21T01:12:11.294787+0000","last_unstale":"2024-09-21T01:12:12.328545+0000","last_undegraded":"2024-09-21T01:12:12.328545+0000","last_fullsized":"2024-09-21T01:12:12.328545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:34.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311394+0000","last_change":"2024-09-21T01:12:11.307340+0000","last_active":"2024-09-21T01:12:12.311394+0000","last_peered":"2024-09-21T01:12:12.311394+0000","last_clean":"2024-09-21T01:12:12.311394+0000","last_became_active":"2024-09-21T01:12:11.306967+0000","last_became_peered":"2024-09-21T01:12:11.306967+0000","last_unstale":"2024-09-21T01:12:12.311394+0000","last_undegraded":"2024-09-21T01:12:12.311394+0000","last_fullsized":"2024-09-21T01:12:12.311394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:59.273742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311835+0000","last_change":"2024-09-21T01:12:11.307532+0000","last_active":"2024-09-21T01:12:12.311835+0000","last_peered":"2024-09-21T01:12:12.311835+0000","last_clean":"2024-09-21T01:12:12.311835+0000","last_became_active":"2024-09-21T01:12:11.307183+0000","last_became_peered":"2024-09-21T01:12:11.307183+0000","last_unstale":"2024-09-21T01:12:12.311835+0000","last_undegraded":"2024-09-21T01:12:12.311835+0000","last_fullsized":"2024-09-21T01:12:12.311835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:10.970723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328830+0000","last_change":"2024-09-21T01:12:11.308355+0000","last_active":"2024-09-21T01:12:12.328830+0000","last_peered":"2024-09-21T01:12:12.328830+0000","last_clean":"2024-09-21T01:12:12.328830+0000","last_became_active":"2024-09-21T01:12:11.307919+0000","last_became_peered":"2024-09-21T01:12:11.307919+0000","last_unstale":"2024-09-21T01:12:12.328830+0000","last_undegraded":"2024-09-21T01:12:12.328830+0000","last_fullsized":"2024-09-21T01:12:12.328830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:59.869646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324899+0000","last_change":"2024-09-21T01:12:11.298905+0000","last_active":"2024-09-21T01:12:12.324899+0000","last_peered":"2024-09-21T01:12:12.324899+0000","last_clean":"2024-09-21T01:12:12.324899+0000","last_became_active":"2024-09-21T01:12:11.298512+0000","last_became_peered":"2024-09-21T01:12:11.298512+0000","last_unstale":"2024-09-21T01:12:12.324899+0000","last_undegraded":"2024-09-21T01:12:12.324899+0000","last_fullsized":"2024-09-21T01:12:12.324899+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:05.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:34.303328+0000","last_change":"2024-09-21T01:12:09.294881+0000","last_active":"2024-09-21T01:12:34.303328+0000","last_peered":"2024-09-21T01:12:34.303328+0000","last_clean":"2024-09-21T01:12:34.303328+0000","last_became_active":"2024-09-21T01:12:09.294513+0000","last_became_peered":"2024-09-21T01:12:09.294513+0000","last_unstale":"2024-09-21T01:12:34.303328+0000","last_undegraded":"2024-09-21T01:12:34.303328+0000","last_fullsized":"2024-09-21T01:12:34.303328+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:07.193879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325075+0000","last_change":"2024-09-21T01:12:11.300929+0000","last_active":"2024-09-21T01:12:12.325075+0000","last_peered":"2024-09-21T01:12:12.325075+0000","last_clean":"2024-09-21T01:12:12.325075+0000","last_became_active":"2024-09-21T01:12:11.299916+0000","last_became_peered":"2024-09-21T01:12:11.299916+0000","last_unstale":"2024-09-21T01:12:12.325075+0000","last_undegraded":"2024-09-21T01:12:12.325075+0000","last_fullsized":"2024-09-21T01:12:12.325075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:27:23.488659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.533198+0000","last_change":"2024-09-21T01:12:09.298594+0000","last_active":"2024-09-21T01:12:20.533198+0000","last_peered":"2024-09-21T01:12:20.533198+0000","last_clean":"2024-09-21T01:12:20.533198+0000","last_became_active":"2024-09-21T01:12:09.298130+0000","last_became_peered":"2024-09-21T01:12:09.298130+0000","last_unstale":"2024-09-21T01:12:20.533198+0000","last_undegraded":"2024-09-21T01:12:20.533198+0000","last_fullsized":"2024-09-21T01:12:20.533198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.964507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.531915+0000","last_change":"2024-09-21T01:12:09.295997+0000","last_active":"2024-09-21T01:12:20.531915+0000","last_peered":"2024-09-21T01:12:20.531915+0000","last_clean":"2024-09-21T01:12:20.531915+0000","last_became_active":"2024-09-21T01:12:09.295472+0000","last_became_peered":"2024-09-21T01:12:09.295472+0000","last_unstale":"2024-09-21T01:12:20.531915+0000","last_undegraded":"2024-09-21T01:12:20.531915+0000","last_fullsized":"2024-09-21T01:12:20.531915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:25.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325520+0000","last_change":"2024-09-21T01:12:11.306468+0000","last_active":"2024-09-21T01:12:12.325520+0000","last_peered":"2024-09-21T01:12:12.325520+0000","last_clean":"2024-09-21T01:12:12.325520+0000","last_became_active":"2024-09-21T01:12:11.304186+0000","last_became_peered":"2024-09-21T01:12:11.304186+0000","last_unstale":"2024-09-21T01:12:12.325520+0000","last_undegraded":"2024-09-21T01:12:12.325520+0000","last_fullsized":"2024-09-21T01:12:12.325520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:28.564879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325694+0000","last_change":"2024-09-21T01:12:09.295004+0000","last_active":"2024-09-21T01:12:12.325694+0000","last_peered":"2024-09-21T01:12:12.325694+0000","last_clean":"2024-09-21T01:12:12.325694+0000","last_became_active":"2024-09-21T01:12:09.294655+0000","last_became_peered":"2024-09-21T01:12:09.294655+0000","last_unstale":"2024-09-21T01:12:12.325694+0000","last_undegraded":"2024-09-21T01:12:12.325694+0000","last_fullsized":"2024-09-21T01:12:12.325694+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:35.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324479+0000","last_change":"2024-09-21T01:12:11.304252+0000","last_active":"2024-09-21T01:12:12.324479+0000","last_peered":"2024-09-21T01:12:12.324479+0000","last_clean":"2024-09-21T01:12:12.324479+0000","last_became_active":"2024-09-21T01:12:11.303876+0000","last_became_peered":"2024-09-21T01:12:11.303876+0000","last_unstale":"2024-09-21T01:12:12.324479+0000","last_undegraded":"2024-09-21T01:12:12.324479+0000","last_fullsized":"2024-09-21T01:12:12.324479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:48.460538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:34.302529+0000","last_change":"2024-09-21T01:12:09.298976+0000","last_active":"2024-09-21T01:12:34.302529+0000","last_peered":"2024-09-21T01:12:34.302529+0000","last_clean":"2024-09-21T01:12:34.302529+0000","last_became_active":"2024-09-21T01:12:09.298664+0000","last_became_peered":"2024-09-21T01:12:09.298664+0000","last_unstale":"2024-09-21T01:12:34.302529+0000","last_undegraded":"2024-09-21T01:12:34.302529+0000","last_fullsized":"2024-09-21T01:12:34.302529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:58.157391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.330872+0000","last_change":"2024-09-21T01:12:11.313400+0000","last_active":"2024-09-21T01:12:12.330872+0000","last_peered":"2024-09-21T01:12:12.330872+0000","last_clean":"2024-09-21T01:12:12.330872+0000","last_became_active":"2024-09-21T01:12:11.312940+0000","last_became_peered":"2024-09-21T01:12:11.312940+0000","last_unstale":"2024-09-21T01:12:12.330872+0000","last_undegraded":"2024-09-21T01:12:12.330872+0000","last_fullsized":"2024-09-21T01:12:12.330872+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:22.224157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.524326+0000","last_change":"2024-09-21T01:12:09.299266+0000","last_active":"2024-09-21T01:12:19.524326+0000","last_peered":"2024-09-21T01:12:19.524326+0000","last_clean":"2024-09-21T01:12:19.524326+0000","last_became_active":"2024-09-21T01:12:09.298932+0000","last_became_peered":"2024-09-21T01:12:09.298932+0000","last_unstale":"2024-09-21T01:12:19.524326+0000","last_undegraded":"2024-09-21T01:12:19.524326+0000","last_fullsized":"2024-09-21T01:12:19.524326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:51.546829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.329047+0000","last_change":"2024-09-21T01:12:11.296559+0000","last_active":"2024-09-21T01:12:12.329047+0000","last_peered":"2024-09-21T01:12:12.329047+0000","last_clean":"2024-09-21T01:12:12.329047+0000","last_became_active":"2024-09-21T01:12:11.296189+0000","last_became_peered":"2024-09-21T01:12:11.296189+0000","last_unstale":"2024-09-21T01:12:12.329047+0000","last_undegraded":"2024-09-21T01:12:12.329047+0000","last_fullsized":"2024-09-21T01:12:12.329047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:42.193216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.523238+0000","last_change":"2024-09-21T01:12:09.511908+0000","last_active":"2024-09-21T01:12:19.523238+0000","last_peered":"2024-09-21T01:12:19.523238+0000","last_clean":"2024-09-21T01:12:19.523238+0000","last_became_active":"2024-09-21T01:12:09.511550+0000","last_became_peered":"2024-09-21T01:12:09.511550+0000","last_unstale":"2024-09-21T01:12:19.523238+0000","last_undegraded":"2024-09-21T01:12:19.523238+0000","last_fullsized":"2024-09-21T01:12:19.523238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:08.743648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.331056+0000","last_change":"2024-09-21T01:12:11.316005+0000","last_active":"2024-09-21T01:12:12.331056+0000","last_peered":"2024-09-21T01:12:12.331056+0000","last_clean":"2024-09-21T01:12:12.331056+0000","last_became_active":"2024-09-21T01:12:11.315245+0000","last_became_peered":"2024-09-21T01:12:11.315245+0000","last_unstale":"2024-09-21T01:12:12.331056+0000","last_undegraded":"2024-09-21T01:12:12.331056+0000","last_fullsized":"2024-09-21T01:12:12.331056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:50.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'25","reported_seq":80,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:35.304461+0000","last_change":"2024-09-21T01:12:09.300010+0000","last_active":"2024-09-21T01:12:35.304461+0000","last_peered":"2024-09-21T01:12:35.304461+0000","last_clean":"2024-09-21T01:12:35.304461+0000","last_became_active":"2024-09-21T01:12:09.299652+0000","last_became_peered":"2024-09-21T01:12:09.299652+0000","last_unstale":"2024-09-21T01:12:35.304461+0000","last_undegraded":"2024-09-21T01:12:35.304461+0000","last_fullsized":"2024-09-21T01:12:35.304461+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:18.610597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53741,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":70,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325322+0000","last_change":"2024-09-21T01:12:11.308675+0000","last_active":"2024-09-21T01:12:12.325322+0000","last_peered":"2024-09-21T01:12:12.325322+0000","last_clean":"2024-09-21T01:12:12.325322+0000","last_became_active":"2024-09-21T01:12:11.308317+0000","last_became_peered":"2024-09-21T01:12:11.308317+0000","last_unstale":"2024-09-21T01:12:12.325322+0000","last_undegraded":"2024-09-21T01:12:12.325322+0000","last_fullsized":"2024-09-21T01:12:12.325322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:56.081404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.534313+0000","last_change":"2024-09-21T01:12:09.293716+0000","last_active":"2024-09-21T01:12:20.534313+0000","last_peered":"2024-09-21T01:12:20.534313+0000","last_clean":"2024-09-21T01:12:20.534313+0000","last_became_active":"2024-09-21T01:12:09.293205+0000","last_became_peered":"2024-09-21T01:12:09.293205+0000","last_unstale":"2024-09-21T01:12:20.534313+0000","last_undegraded":"2024-09-21T01:12:20.534313+0000","last_fullsized":"2024-09-21T01:12:20.534313+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:29.955953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.310664+0000","last_change":"2024-09-21T01:12:11.302736+0000","last_active":"2024-09-21T01:12:12.310664+0000","last_peered":"2024-09-21T01:12:12.310664+0000","last_clean":"2024-09-21T01:12:12.310664+0000","last_became_active":"2024-09-21T01:12:11.302357+0000","last_became_peered":"2024-09-21T01:12:11.302357+0000","last_unstale":"2024-09-21T01:12:12.310664+0000","last_undegraded":"2024-09-21T01:12:12.310664+0000","last_fullsized":"2024-09-21T01:12:12.310664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:34.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.524739+0000","last_change":"2024-09-21T01:12:09.295258+0000","last_active":"2024-09-21T01:12:19.524739+0000","last_peered":"2024-09-21T01:12:19.524739+0000","last_clean":"2024-09-21T01:12:19.524739+0000","last_became_active":"2024-09-21T01:12:09.294872+0000","last_became_peered":"2024-09-21T01:12:09.294872+0000","last_unstale":"2024-09-21T01:12:19.524739+0000","last_undegraded":"2024-09-21T01:12:19.524739+0000","last_fullsized":"2024-09-21T01:12:19.524739+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.216960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.312062+0000","last_change":"2024-09-21T01:12:11.303413+0000","last_active":"2024-09-21T01:12:12.312062+0000","last_peered":"2024-09-21T01:12:12.312062+0000","last_clean":"2024-09-21T01:12:12.312062+0000","last_became_active":"2024-09-21T01:12:11.303002+0000","last_became_peered":"2024-09-21T01:12:11.303002+0000","last_unstale":"2024-09-21T01:12:12.312062+0000","last_undegraded":"2024-09-21T01:12:12.312062+0000","last_fullsized":"2024-09-21T01:12:12.312062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:55.984699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:34.302299+0000","last_change":"2024-09-21T01:12:09.297392+0000","last_active":"2024-09-21T01:12:34.302299+0000","last_peered":"2024-09-21T01:12:34.302299+0000","last_clean":"2024-09-21T01:12:34.302299+0000","last_became_active":"2024-09-21T01:12:09.296882+0000","last_became_peered":"2024-09-21T01:12:09.296882+0000","last_unstale":"2024-09-21T01:12:34.302299+0000","last_undegraded":"2024-09-21T01:12:34.302299+0000","last_fullsized":"2024-09-21T01:12:34.302299+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.598362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311164+0000","last_change":"2024-09-21T01:12:11.308021+0000","last_active":"2024-09-21T01:12:12.311164+0000","last_peered":"2024-09-21T01:12:12.311164+0000","last_clean":"2024-09-21T01:12:12.311164+0000","last_became_active":"2024-09-21T01:12:11.307643+0000","last_became_peered":"2024-09-21T01:12:11.307643+0000","last_unstale":"2024-09-21T01:12:12.311164+0000","last_undegraded":"2024-09-21T01:12:12.311164+0000","last_fullsized":"2024-09-21T01:12:12.311164+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:55.569855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.534585+0000","last_change":"2024-09-21T01:12:09.512120+0000","last_active":"2024-09-21T01:12:20.534585+0000","last_peered":"2024-09-21T01:12:20.534585+0000","last_clean":"2024-09-21T01:12:20.534585+0000","last_became_active":"2024-09-21T01:12:09.511631+0000","last_became_peered":"2024-09-21T01:12:09.511631+0000","last_unstale":"2024-09-21T01:12:20.534585+0000","last_undegraded":"2024-09-21T01:12:20.534585+0000","last_fullsized":"2024-09-21T01:12:20.534585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:13.187219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324670+0000","last_change":"2024-09-21T01:12:11.301633+0000","last_active":"2024-09-21T01:12:12.324670+0000","last_peered":"2024-09-21T01:12:12.324670+0000","last_clean":"2024-09-21T01:12:12.324670+0000","last_became_active":"2024-09-21T01:12:11.300638+0000","last_became_peered":"2024-09-21T01:12:11.300638+0000","last_unstale":"2024-09-21T01:12:12.324670+0000","last_undegraded":"2024-09-21T01:12:12.324670+0000","last_fullsized":"2024-09-21T01:12:12.324670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:42.245596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:21.278913+0000","last_change":"2024-09-21T01:12:09.297694+0000","last_active":"2024-09-21T01:12:21.278913+0000","last_peered":"2024-09-21T01:12:21.278913+0000","last_clean":"2024-09-21T01:12:21.278913+0000","last_became_active":"2024-09-21T01:12:09.297127+0000","last_became_peered":"2024-09-21T01:12:09.297127+0000","last_unstale":"2024-09-21T01:12:21.278913+0000","last_undegraded":"2024-09-21T01:12:21.278913+0000","last_fullsized":"2024-09-21T01:12:21.278913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:35.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328336+0000","last_change":"2024-09-21T01:12:11.303510+0000","last_active":"2024-09-21T01:12:12.328336+0000","last_peered":"2024-09-21T01:12:12.328336+0000","last_clean":"2024-09-21T01:12:12.328336+0000","last_became_active":"2024-09-21T01:12:11.303148+0000","last_became_peered":"2024-09-21T01:12:11.303148+0000","last_unstale":"2024-09-21T01:12:12.328336+0000","last_undegraded":"2024-09-21T01:12:12.328336+0000","last_fullsized":"2024-09-21T01:12:12.328336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:59.338185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325431+0000","last_change":"2024-09-21T01:12:09.293490+0000","last_active":"2024-09-21T01:12:12.325431+0000","last_peered":"2024-09-21T01:12:12.325431+0000","last_clean":"2024-09-21T01:12:12.325431+0000","last_became_active":"2024-09-21T01:12:09.293151+0000","last_became_peered":"2024-09-21T01:12:09.293151+0000","last_unstale":"2024-09-21T01:12:12.325431+0000","last_undegraded":"2024-09-21T01:12:12.325431+0000","last_fullsized":"2024-09-21T01:12:12.325431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:25.153547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.312026+0000","last_change":"2024-09-21T01:12:11.311313+0000","last_active":"2024-09-21T01:12:12.312026+0000","last_peered":"2024-09-21T01:12:12.312026+0000","last_clean":"2024-09-21T01:12:12.312026+0000","last_became_active":"2024-09-21T01:12:11.310908+0000","last_became_peered":"2024-09-21T01:12:11.310908+0000","last_unstale":"2024-09-21T01:12:12.312026+0000","last_undegraded":"2024-09-21T01:12:12.312026+0000","last_fullsized":"2024-09-21T01:12:12.312026+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:15.070802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.333166+0000","last_change":"2024-09-21T01:12:09.298861+0000","last_active":"2024-09-21T01:12:12.333166+0000","last_peered":"2024-09-21T01:12:12.333166+0000","last_clean":"2024-09-21T01:12:12.333166+0000","last_became_active":"2024-09-21T01:12:09.298504+0000","last_became_peered":"2024-09-21T01:12:09.298504+0000","last_unstale":"2024-09-21T01:12:12.333166+0000","last_undegraded":"2024-09-21T01:12:12.333166+0000","last_fullsized":"2024-09-21T01:12:12.333166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:10.446269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.312002+0000","last_change":"2024-09-21T01:12:11.309656+0000","last_active":"2024-09-21T01:12:12.312002+0000","last_peered":"2024-09-21T01:12:12.312002+0000","last_clean":"2024-09-21T01:12:12.312002+0000","last_became_active":"2024-09-21T01:12:11.308515+0000","last_became_peered":"2024-09-21T01:12:11.308515+0000","last_unstale":"2024-09-21T01:12:12.312002+0000","last_undegraded":"2024-09-21T01:12:12.312002+0000","last_fullsized":"2024-09-21T01:12:12.312002+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:38.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.534738+0000","last_change":"2024-09-21T01:12:09.511434+0000","last_active":"2024-09-21T01:12:20.534738+0000","last_peered":"2024-09-21T01:12:20.534738+0000","last_clean":"2024-09-21T01:12:20.534738+0000","last_became_active":"2024-09-21T01:12:09.511043+0000","last_became_peered":"2024-09-21T01:12:09.511043+0000","last_unstale":"2024-09-21T01:12:20.534738+0000","last_undegraded":"2024-09-21T01:12:20.534738+0000","last_fullsized":"2024-09-21T01:12:20.534738+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:23.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311875+0000","last_change":"2024-09-21T01:12:11.311989+0000","last_active":"2024-09-21T01:12:12.311875+0000","last_peered":"2024-09-21T01:12:12.311875+0000","last_clean":"2024-09-21T01:12:12.311875+0000","last_became_active":"2024-09-21T01:12:11.310338+0000","last_became_peered":"2024-09-21T01:12:11.310338+0000","last_unstale":"2024-09-21T01:12:12.311875+0000","last_undegraded":"2024-09-21T01:12:12.311875+0000","last_fullsized":"2024-09-21T01:12:12.311875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:12.675575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":91,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311439+0000","last_change":"2024-09-21T01:11:01.703479+0000","last_active":"2024-09-21T01:12:12.311439+0000","last_peered":"2024-09-21T01:12:12.311439+0000","last_clean":"2024-09-21T01:12:12.311439+0000","last_became_active":"2024-09-21T01:11:01.697351+0000","last_became_peered":"2024-09-21T01:11:01.697351+0000","last_unstale":"2024-09-21T01:12:12.311439+0000","last_undegraded":"2024-09-21T01:12:12.311439+0000","last_fullsized":"2024-09-21T01:12:12.311439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_clean_scrub_stamp":"2024-09-21T01:07:43.096984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:18.858448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:21.278568+0000","last_change":"2024-09-21T01:12:09.295468+0000","last_active":"2024-09-21T01:12:21.278568+0000","last_peered":"2024-09-21T01:12:21.278568+0000","last_clean":"2024-09-21T01:12:21.278568+0000","last_became_active":"2024-09-21T01:12:09.295092+0000","last_became_peered":"2024-09-21T01:12:09.295092+0000","last_unstale":"2024-09-21T01:12:21.278568+0000","last_undegraded":"2024-09-21T01:12:21.278568+0000","last_fullsized":"2024-09-21T01:12:21.278568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:08.153176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.326410+0000","last_change":"2024-09-21T01:12:11.308460+0000","last_active":"2024-09-21T01:12:12.326410+0000","last_peered":"2024-09-21T01:12:12.326410+0000","last_clean":"2024-09-21T01:12:12.326410+0000","last_became_active":"2024-09-21T01:12:11.307764+0000","last_became_peered":"2024-09-21T01:12:11.307764+0000","last_unstale":"2024-09-21T01:12:12.326410+0000","last_undegraded":"2024-09-21T01:12:12.326410+0000","last_fullsized":"2024-09-21T01:12:12.326410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:32.094902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.533649+0000","last_change":"2024-09-21T01:12:09.296477+0000","last_active":"2024-09-21T01:12:20.533649+0000","last_peered":"2024-09-21T01:12:20.533649+0000","last_clean":"2024-09-21T01:12:20.533649+0000","last_became_active":"2024-09-21T01:12:09.296153+0000","last_became_peered":"2024-09-21T01:12:09.296153+0000","last_unstale":"2024-09-21T01:12:20.533649+0000","last_undegraded":"2024-09-21T01:12:20.533649+0000","last_fullsized":"2024-09-21T01:12:20.533649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:42.380668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.310531+0000","last_change":"2024-09-21T01:12:11.297826+0000","last_active":"2024-09-21T01:12:12.310531+0000","last_peered":"2024-09-21T01:12:12.310531+0000","last_clean":"2024-09-21T01:12:12.310531+0000","last_became_active":"2024-09-21T01:12:11.297430+0000","last_became_peered":"2024-09-21T01:12:11.297430+0000","last_unstale":"2024-09-21T01:12:12.310531+0000","last_undegraded":"2024-09-21T01:12:12.310531+0000","last_fullsized":"2024-09-21T01:12:12.310531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:09.130500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:31.297385+0000","last_change":"2024-09-21T01:12:09.511173+0000","last_active":"2024-09-21T01:12:31.297385+0000","last_peered":"2024-09-21T01:12:31.297385+0000","last_clean":"2024-09-21T01:12:31.297385+0000","last_became_active":"2024-09-21T01:12:09.510840+0000","last_became_peered":"2024-09-21T01:12:09.510840+0000","last_unstale":"2024-09-21T01:12:31.297385+0000","last_undegraded":"2024-09-21T01:12:31.297385+0000","last_fullsized":"2024-09-21T01:12:31.297385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:22.161708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325424+0000","last_change":"2024-09-21T01:12:11.302741+0000","last_active":"2024-09-21T01:12:12.325424+0000","last_peered":"2024-09-21T01:12:12.325424+0000","last_clean":"2024-09-21T01:12:12.325424+0000","last_became_active":"2024-09-21T01:12:11.302401+0000","last_became_peered":"2024-09-21T01:12:11.302401+0000","last_unstale":"2024-09-21T01:12:12.325424+0000","last_undegraded":"2024-09-21T01:12:12.325424+0000","last_fullsized":"2024-09-21T01:12:12.325424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:27.087975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311984+0000","last_change":"2024-09-21T01:12:09.295447+0000","last_active":"2024-09-21T01:12:12.311984+0000","last_peered":"2024-09-21T01:12:12.311984+0000","last_clean":"2024-09-21T01:12:12.311984+0000","last_became_active":"2024-09-21T01:12:09.295057+0000","last_became_peered":"2024-09-21T01:12:09.295057+0000","last_unstale":"2024-09-21T01:12:12.311984+0000","last_undegraded":"2024-09-21T01:12:12.311984+0000","last_fullsized":"2024-09-21T01:12:12.311984+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:59.389877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325587+0000","last_change":"2024-09-21T01:12:11.304636+0000","last_active":"2024-09-21T01:12:12.325587+0000","last_peered":"2024-09-21T01:12:12.325587+0000","last_clean":"2024-09-21T01:12:12.325587+0000","last_became_active":"2024-09-21T01:12:11.303318+0000","last_became_peered":"2024-09-21T01:12:11.303318+0000","last_unstale":"2024-09-21T01:12:12.325587+0000","last_undegraded":"2024-09-21T01:12:12.325587+0000","last_fullsized":"2024-09-21T01:12:12.325587+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:39.377686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324801+0000","last_change":"2024-09-21T01:12:09.512826+0000","last_active":"2024-09-21T01:12:12.324801+0000","last_peered":"2024-09-21T01:12:12.324801+0000","last_clean":"2024-09-21T01:12:12.324801+0000","last_became_active":"2024-09-21T01:12:09.512429+0000","last_became_peered":"2024-09-21T01:12:09.512429+0000","last_unstale":"2024-09-21T01:12:12.324801+0000","last_undegraded":"2024-09-21T01:12:12.324801+0000","last_fullsized":"2024-09-21T01:12:12.324801+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:50.730842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.326292+0000","last_change":"2024-09-21T01:12:11.305558+0000","last_active":"2024-09-21T01:12:12.326292+0000","last_peered":"2024-09-21T01:12:12.326292+0000","last_clean":"2024-09-21T01:12:12.326292+0000","last_became_active":"2024-09-21T01:12:11.304934+0000","last_became_peered":"2024-09-21T01:12:11.304934+0000","last_unstale":"2024-09-21T01:12:12.326292+0000","last_undegraded":"2024-09-21T01:12:12.326292+0000","last_fullsized":"2024-09-21T01:12:12.326292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:52.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.523631+0000","last_change":"2024-09-21T01:12:09.511384+0000","last_active":"2024-09-21T01:12:19.523631+0000","last_peered":"2024-09-21T01:12:19.523631+0000","last_clean":"2024-09-21T01:12:19.523631+0000","last_became_active":"2024-09-21T01:12:09.511006+0000","last_became_peered":"2024-09-21T01:12:09.511006+0000","last_unstale":"2024-09-21T01:12:19.523631+0000","last_undegraded":"2024-09-21T01:12:19.523631+0000","last_fullsized":"2024-09-21T01:12:19.523631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:56.580855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311066+0000","last_change":"2024-09-21T01:12:11.304912+0000","last_active":"2024-09-21T01:12:12.311066+0000","last_peered":"2024-09-21T01:12:12.311066+0000","last_clean":"2024-09-21T01:12:12.311066+0000","last_became_active":"2024-09-21T01:12:11.304536+0000","last_became_peered":"2024-09-21T01:12:11.304536+0000","last_unstale":"2024-09-21T01:12:12.311066+0000","last_undegraded":"2024-09-21T01:12:12.311066+0000","last_fullsized":"2024-09-21T01:12:12.311066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:45.037231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'8","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:32.325276+0000","last_change":"2024-09-21T01:12:09.294680+0000","last_active":"2024-09-21T01:12:32.325276+0000","last_peered":"2024-09-21T01:12:32.325276+0000","last_clean":"2024-09-21T01:12:32.325276+0000","last_became_active":"2024-09-21T01:12:09.294289+0000","last_became_peered":"2024-09-21T01:12:09.294289+0000","last_unstale":"2024-09-21T01:12:32.325276+0000","last_undegraded":"2024-09-21T01:12:32.325276+0000","last_fullsized":"2024-09-21T01:12:32.325276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.824781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.327487+0000","last_change":"2024-09-21T01:12:11.305192+0000","last_active":"2024-09-21T01:12:12.327487+0000","last_peered":"2024-09-21T01:12:12.327487+0000","last_clean":"2024-09-21T01:12:12.327487+0000","last_became_active":"2024-09-21T01:12:11.304761+0000","last_became_peered":"2024-09-21T01:12:11.304761+0000","last_unstale":"2024-09-21T01:12:12.327487+0000","last_undegraded":"2024-09-21T01:12:12.327487+0000","last_fullsized":"2024-09-21T01:12:12.327487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:58.429511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.523804+0000","last_change":"2024-09-21T01:12:09.455476+0000","last_active":"2024-09-21T01:12:19.523804+0000","last_peered":"2024-09-21T01:12:19.523804+0000","last_clean":"2024-09-21T01:12:19.523804+0000","last_became_active":"2024-09-21T01:12:09.454981+0000","last_became_peered":"2024-09-21T01:12:09.454981+0000","last_unstale":"2024-09-21T01:12:19.523804+0000","last_undegraded":"2024-09-21T01:12:19.523804+0000","last_fullsized":"2024-09-21T01:12:19.523804+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:27.790928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.328756+0000","last_change":"2024-09-21T01:12:11.300631+0000","last_active":"2024-09-21T01:12:12.328756+0000","last_peered":"2024-09-21T01:12:12.328756+0000","last_clean":"2024-09-21T01:12:12.328756+0000","last_became_active":"2024-09-21T01:12:11.300179+0000","last_became_peered":"2024-09-21T01:12:11.300179+0000","last_unstale":"2024-09-21T01:12:12.328756+0000","last_undegraded":"2024-09-21T01:12:12.328756+0000","last_fullsized":"2024-09-21T01:12:12.328756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:23.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.524123+0000","last_change":"2024-09-21T01:12:09.511406+0000","last_active":"2024-09-21T01:12:19.524123+0000","last_peered":"2024-09-21T01:12:19.524123+0000","last_clean":"2024-09-21T01:12:19.524123+0000","last_became_active":"2024-09-21T01:12:09.511117+0000","last_became_peered":"2024-09-21T01:12:09.511117+0000","last_unstale":"2024-09-21T01:12:19.524123+0000","last_undegraded":"2024-09-21T01:12:19.524123+0000","last_fullsized":"2024-09-21T01:12:19.524123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:18.100466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324510+0000","last_change":"2024-09-21T01:12:11.306933+0000","last_active":"2024-09-21T01:12:12.324510+0000","last_peered":"2024-09-21T01:12:12.324510+0000","last_clean":"2024-09-21T01:12:12.324510+0000","last_became_active":"2024-09-21T01:12:11.306516+0000","last_became_peered":"2024-09-21T01:12:11.306516+0000","last_unstale":"2024-09-21T01:12:12.324510+0000","last_undegraded":"2024-09-21T01:12:12.324510+0000","last_fullsized":"2024-09-21T01:12:12.324510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:40.524953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.524251+0000","last_change":"2024-09-21T01:12:09.297506+0000","last_active":"2024-09-21T01:12:19.524251+0000","last_peered":"2024-09-21T01:12:19.524251+0000","last_clean":"2024-09-21T01:12:19.524251+0000","last_became_active":"2024-09-21T01:12:09.297139+0000","last_became_peered":"2024-09-21T01:12:09.297139+0000","last_unstale":"2024-09-21T01:12:19.524251+0000","last_undegraded":"2024-09-21T01:12:19.524251+0000","last_fullsized":"2024-09-21T01:12:19.524251+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:05.641171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.329135+0000","last_change":"2024-09-21T01:12:11.314053+0000","last_active":"2024-09-21T01:12:12.329135+0000","last_peered":"2024-09-21T01:12:12.329135+0000","last_clean":"2024-09-21T01:12:12.329135+0000","last_became_active":"2024-09-21T01:12:11.313681+0000","last_became_peered":"2024-09-21T01:12:11.313681+0000","last_unstale":"2024-09-21T01:12:12.329135+0000","last_undegraded":"2024-09-21T01:12:12.329135+0000","last_fullsized":"2024-09-21T01:12:12.329135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.108030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311676+0000","last_change":"2024-09-21T01:12:09.298602+0000","last_active":"2024-09-21T01:12:12.311676+0000","last_peered":"2024-09-21T01:12:12.311676+0000","last_clean":"2024-09-21T01:12:12.311676+0000","last_became_active":"2024-09-21T01:12:09.297295+0000","last_became_peered":"2024-09-21T01:12:09.297295+0000","last_unstale":"2024-09-21T01:12:12.311676+0000","last_undegraded":"2024-09-21T01:12:12.311676+0000","last_fullsized":"2024-09-21T01:12:12.311676+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:27.253290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.325685+0000","last_change":"2024-09-21T01:12:11.306120+0000","last_active":"2024-09-21T01:12:12.325685+0000","last_peered":"2024-09-21T01:12:12.325685+0000","last_clean":"2024-09-21T01:12:12.325685+0000","last_became_active":"2024-09-21T01:12:11.305771+0000","last_became_peered":"2024-09-21T01:12:11.305771+0000","last_unstale":"2024-09-21T01:12:12.325685+0000","last_undegraded":"2024-09-21T01:12:12.325685+0000","last_fullsized":"2024-09-21T01:12:12.325685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:38.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:19.524965+0000","last_change":"2024-09-21T01:12:09.293697+0000","last_active":"2024-09-21T01:12:19.524965+0000","last_peered":"2024-09-21T01:12:19.524965+0000","last_clean":"2024-09-21T01:12:19.524965+0000","last_became_active":"2024-09-21T01:12:09.293320+0000","last_became_peered":"2024-09-21T01:12:09.293320+0000","last_unstale":"2024-09-21T01:12:19.524965+0000","last_undegraded":"2024-09-21T01:12:19.524965+0000","last_fullsized":"2024-09-21T01:12:19.524965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:42.427416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.311421+0000","last_change":"2024-09-21T01:12:11.312392+0000","last_active":"2024-09-21T01:12:12.311421+0000","last_peered":"2024-09-21T01:12:12.311421+0000","last_clean":"2024-09-21T01:12:12.311421+0000","last_became_active":"2024-09-21T01:12:11.311120+0000","last_became_peered":"2024-09-21T01:12:11.311120+0000","last_unstale":"2024-09-21T01:12:12.311421+0000","last_undegraded":"2024-09-21T01:12:12.311421+0000","last_fullsized":"2024-09-21T01:12:12.311421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:23.292367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.324977+0000","last_change":"2024-09-21T01:12:11.301350+0000","last_active":"2024-09-21T01:12:12.324977+0000","last_peered":"2024-09-21T01:12:12.324977+0000","last_clean":"2024-09-21T01:12:12.324977+0000","last_became_active":"2024-09-21T01:12:11.299746+0000","last_became_peered":"2024-09-21T01:12:11.299746+0000","last_unstale":"2024-09-21T01:12:12.324977+0000","last_undegraded":"2024-09-21T01:12:12.324977+0000","last_fullsized":"2024-09-21T01:12:12.324977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:57.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.331919+0000","last_change":"2024-09-21T01:12:09.296499+0000","last_active":"2024-09-21T01:12:12.331919+0000","last_peered":"2024-09-21T01:12:12.331919+0000","last_clean":"2024-09-21T01:12:12.331919+0000","last_became_active":"2024-09-21T01:12:09.296000+0000","last_became_peered":"2024-09-21T01:12:09.296000+0000","last_unstale":"2024-09-21T01:12:12.331919+0000","last_undegraded":"2024-09-21T01:12:12.331919+0000","last_fullsized":"2024-09-21T01:12:12.331919+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:37.278200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.330640+0000","last_change":"2024-09-21T01:12:11.314014+0000","last_active":"2024-09-21T01:12:12.330640+0000","last_peered":"2024-09-21T01:12:12.330640+0000","last_clean":"2024-09-21T01:12:12.330640+0000","last_became_active":"2024-09-21T01:12:11.312592+0000","last_became_peered":"2024-09-21T01:12:11.312592+0000","last_unstale":"2024-09-21T01:12:12.330640+0000","last_undegraded":"2024-09-21T01:12:12.330640+0000","last_fullsized":"2024-09-21T01:12:12.330640+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.074667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.534177+0000","last_change":"2024-09-21T01:12:09.297088+0000","last_active":"2024-09-21T01:12:20.534177+0000","last_peered":"2024-09-21T01:12:20.534177+0000","last_clean":"2024-09-21T01:12:20.534177+0000","last_became_active":"2024-09-21T01:12:09.296707+0000","last_became_peered":"2024-09-21T01:12:09.296707+0000","last_unstale":"2024-09-21T01:12:20.534177+0000","last_undegraded":"2024-09-21T01:12:20.534177+0000","last_fullsized":"2024-09-21T01:12:20.534177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:50.138586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.329019+0000","last_change":"2024-09-21T01:12:11.300991+0000","last_active":"2024-09-21T01:12:12.329019+0000","last_peered":"2024-09-21T01:12:12.329019+0000","last_clean":"2024-09-21T01:12:12.329019+0000","last_became_active":"2024-09-21T01:12:11.299934+0000","last_became_peered":"2024-09-21T01:12:11.299934+0000","last_unstale":"2024-09-21T01:12:12.329019+0000","last_undegraded":"2024-09-21T01:12:12.329019+0000","last_fullsized":"2024-09-21T01:12:12.329019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:34.300051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.331160+0000","last_change":"2024-09-21T01:12:09.511289+0000","last_active":"2024-09-21T01:12:12.331160+0000","last_peered":"2024-09-21T01:12:12.331160+0000","last_clean":"2024-09-21T01:12:12.331160+0000","last_became_active":"2024-09-21T01:12:09.510879+0000","last_became_peered":"2024-09-21T01:12:09.510879+0000","last_unstale":"2024-09-21T01:12:12.331160+0000","last_undegraded":"2024-09-21T01:12:12.331160+0000","last_fullsized":"2024-09-21T01:12:12.331160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:37.950305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:12.326220+0000","last_change":"2024-09-21T01:12:11.312100+0000","last_active":"2024-09-21T01:12:12.326220+0000","last_peered":"2024-09-21T01:12:12.326220+0000","last_clean":"2024-09-21T01:12:12.326220+0000","last_became_active":"2024-09-21T01:12:11.311731+0000","last_became_peered":"2024-09-21T01:12:11.311731+0000","last_unstale":"2024-09-21T01:12:12.326220+0000","last_undegraded":"2024-09-21T01:12:12.326220+0000","last_fullsized":"2024-09-21T01:12:12.326220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:40.459020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:12:20.534071+0000","last_change":"2024-09-21T01:12:09.294759+0000","last_active":"2024-09-21T01:12:20.534071+0000","last_peered":"2024-09-21T01:12:20.534071+0000","last_clean":"2024-09-21T01:12:20.534071+0000","last_became_active":"2024-09-21T01:12:09.294391+0000","last_became_peered":"2024-09-21T01:12:09.294391+0000","last_unstale":"2024-09-21T01:12:20.534071+0000","last_undegraded":"2024-09-21T01:12:20.534071+0000","last_fullsized":"2024-09-21T01:12:20.534071+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:05.981058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57742,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":112,"num_read_kb":116,"num_write":154,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":164688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776145,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":378966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36788,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708364,"statfs":{"total":95995035648,"available":95957364736,"internally_reserved":0,"allocated":1478656,"data_stored":1024579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":806912,"data_stored":379202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36132,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709020,"statfs":{"total":95995035648,"available":95958036480,"internally_reserved":0,"allocated":806912,"data_stored":379122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716760,"statfs":{"total":95995035648,"available":95965962240,"internally_reserved":0,"allocated":1400832,"data_stored":971052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626473,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36120,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709032,"statfs":{"total":95995035648,"available":95958048768,"internally_reserved":0,"allocated":794624,"data_stored":378591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790000,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32564,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712588,"statfs":{"total":95995035648,"available":95961690112,"internally_reserved":0,"allocated":1413120,"data_stored":970345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40284,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704868,"statfs":{"total":95995035648,"available":95953784832,"internally_reserved":0,"allocated":798720,"data_stored":379419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149751,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":378902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":424937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":423587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":379862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":45203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":55091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":55710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:12:38.588 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T01:12:38.588 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T01:12:38.589 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T01:12:38.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:38 smithi181 ceph-mon[34811]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:12:38.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:38 smithi181 ceph-mon[34811]: pgmap v296: 97 pgs: 97 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T01:12:38.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:38 smithi157 ceph-mon[34140]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:12:38.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:38 smithi157 ceph-mon[34140]: pgmap v296: 97 pgs: 97 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T01:12:38.833 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:38.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:38 smithi148 ceph-mon[31000]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:12:38.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:38 smithi148 ceph-mon[31000]: pgmap v296: 97 pgs: 97 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T01:12:39.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.309+0000 7f0996d29640 1 -- 172.21.15.148:0/3888075159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0990103720 msgr2=0x7f0990103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:39.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.309+0000 7f0996d29640 1 --2- 172.21.15.148:0/3888075159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0990103720 0x7f0990103b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f097c009900 tx=0x7f097c02a480 comp rx=0 tx=0).stop 2024-09-21T01:12:39.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.309+0000 7f0996d29640 1 -- 172.21.15.148:0/3888075159 shutdown_connections 2024-09-21T01:12:39.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.309+0000 7f0996d29640 1 --2- 172.21.15.148:0/3888075159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0990103720 0x7f0990103b30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:39.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.309+0000 7f0996d29640 1 --2- 172.21.15.148:0/3888075159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09901040c0 0x7f099010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:39.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.309+0000 7f0996d29640 1 --2- 172.21.15.148:0/3888075159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0990102690 0x7f0990102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:39.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.309+0000 7f0996d29640 1 -- 172.21.15.148:0/3888075159 >> 172.21.15.148:0/3888075159 conn(0x7f09900fe020 msgr2=0x7f09901004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:39.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.309+0000 7f0996d29640 1 -- 172.21.15.148:0/3888075159 shutdown_connections 2024-09-21T01:12:39.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.309+0000 7f0996d29640 1 -- 172.21.15.148:0/3888075159 wait complete. 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f0996d29640 1 Processor -- start 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f0996d29640 1 -- start start 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f0996d29640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0990102690 0x7f099006c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f0996d29640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0990103720 0x7f09901a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f0996d29640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09901040c0 0x7f09901a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f0996d29640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f099010e2e0 con 0x7f0990103720 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f0996d29640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f099010e160 con 0x7f09901040c0 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f0996d29640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f099010e460 con 0x7f0990102690 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f098ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0990103720 0x7f09901a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f098ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0990103720 0x7f09901a11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46770/0 (socket says 172.21.15.148:46770) 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f098ffff640 1 -- 172.21.15.148:0/3678658570 learned_addr learned my addr 172.21.15.148:0/3678658570 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:39.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f0994ac5640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0990102690 0x7f099006c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f09952c6640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09901040c0 0x7f09901a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f098ffff640 1 -- 172.21.15.148:0/3678658570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0990102690 msgr2=0x7f099006c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f098ffff640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0990102690 0x7f099006c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f098ffff640 1 -- 172.21.15.148:0/3678658570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09901040c0 msgr2=0x7f09901a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f098ffff640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09901040c0 0x7f09901a3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f098ffff640 1 -- 172.21.15.148:0/3678658570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09901a3c40 con 0x7f0990103720 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.310+0000 7f0994ac5640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0990102690 0x7f099006c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.311+0000 7f098ffff640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0990103720 0x7f09901a11b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f097c006010 tx=0x7f097c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.311+0000 7f098dffb640 1 -- 172.21.15.148:0/3678658570 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c03f030 con 0x7f0990103720 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.311+0000 7f0996d29640 1 -- 172.21.15.148:0/3678658570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09901a3ed0 con 0x7f0990103720 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.311+0000 7f098dffb640 1 -- 172.21.15.148:0/3678658570 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f097c003aa0 con 0x7f0990103720 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.311+0000 7f098dffb640 1 -- 172.21.15.148:0/3678658570 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c035070 con 0x7f0990103720 2024-09-21T01:12:39.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.311+0000 7f0996d29640 1 -- 172.21.15.148:0/3678658570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09901a42d0 con 0x7f0990103720 2024-09-21T01:12:39.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.312+0000 7f0996d29640 1 -- 172.21.15.148:0/3678658570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0990109850 con 0x7f0990103720 2024-09-21T01:12:39.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.314+0000 7f098dffb640 1 -- 172.21.15.148:0/3678658570 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f097c042030 con 0x7f0990103720 2024-09-21T01:12:39.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.314+0000 7f098dffb640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f09800b65a0 0x7f09800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:39.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.314+0000 7f0994ac5640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f09800b65a0 0x7f09800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:39.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.314+0000 7f098dffb640 1 -- 172.21.15.148:0/3678658570 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f097c107fb0 con 0x7f0990103720 2024-09-21T01:12:39.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.315+0000 7f0994ac5640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f09800b65a0 0x7f09800b8ab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f098400afb0 tx=0x7f098400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:39.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.318+0000 7f098dffb640 1 -- 172.21.15.148:0/3678658570 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f097c0ce790 con 0x7f0990103720 2024-09-21T01:12:39.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.563+0000 7f0996d29640 1 -- 172.21.15.148:0/3678658570 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f099002e640 con 0x7f0990103720 2024-09-21T01:12:39.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.565+0000 7f098dffb640 1 -- 172.21.15.148:0/3678658570 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f097c0d2b70 con 0x7f0990103720 2024-09-21T01:12:39.566 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2024-09-21T01:12:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCHHe5mJFOnIRAAF1FvS1k1UdgqhaFV/ntVnQ== 2024-09-21T01:12:39.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 -- 172.21.15.148:0/3678658570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f09800b65a0 msgr2=0x7f09800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:39.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f09800b65a0 0x7f09800b8ab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f098400afb0 tx=0x7f098400a2d0 comp rx=0 tx=0).stop 2024-09-21T01:12:39.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 -- 172.21.15.148:0/3678658570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0990103720 msgr2=0x7f09901a11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:39.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0990103720 0x7f09901a11b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f097c006010 tx=0x7f097c031a50 comp rx=0 tx=0).stop 2024-09-21T01:12:39.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 -- 172.21.15.148:0/3678658570 shutdown_connections 2024-09-21T01:12:39.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f09800b65a0 0x7f09800b8ab0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:39.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0990103720 0x7f09901a11b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:39.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09901040c0 0x7f09901a3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:39.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 --2- 172.21.15.148:0/3678658570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0990102690 0x7f099006c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:39.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 -- 172.21.15.148:0/3678658570 >> 172.21.15.148:0/3678658570 conn(0x7f09900fe020 msgr2=0x7f0990106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:39.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 -- 172.21.15.148:0/3678658570 shutdown_connections 2024-09-21T01:12:39.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:39.568+0000 7f0996d29640 1 -- 172.21.15.148:0/3678658570 wait complete. 2024-09-21T01:12:39.814 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:39 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3678658570' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T01:12:39.814 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:39 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3678658570' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T01:12:39.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:39 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3678658570' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T01:12:39.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:39 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3678658570' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T01:12:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:39 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3678658570' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T01:12:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:39 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3678658570' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T01:12:40.362 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:12:40.362 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T01:12:40.362 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T01:12:40.400 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T01:12:40.684 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:40.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:40 smithi148 ceph-mon[31000]: pgmap v297: 97 pgs: 97 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T01:12:40.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:40 smithi181 ceph-mon[34811]: pgmap v297: 97 pgs: 97 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T01:12:40.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:40 smithi157 ceph-mon[34140]: pgmap v297: 97 pgs: 97 active+clean; 633 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T01:12:41.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.109+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/3296233461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dd8103160 msgr2=0x7f3dd8103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:41.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.109+0000 7f3ddd8a1640 1 --2- 172.21.15.148:0/3296233461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dd8103160 0x7f3dd8103570 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009900 tx=0x7f3dc002a410 comp rx=0 tx=0).stop 2024-09-21T01:12:41.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.109+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/3296233461 shutdown_connections 2024-09-21T01:12:41.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.109+0000 7f3ddd8a1640 1 --2- 172.21.15.148:0/3296233461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dd8105ac0 0x7f3dd810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:41.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.109+0000 7f3ddd8a1640 1 --2- 172.21.15.148:0/3296233461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd8105170 0x7f3dd8105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:41.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.109+0000 7f3ddd8a1640 1 --2- 172.21.15.148:0/3296233461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dd8103160 0x7f3dd8103570 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:41.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.109+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/3296233461 >> 172.21.15.148:0/3296233461 conn(0x7f3dd8077c60 msgr2=0x7f3dd80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:41.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.110+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/3296233461 shutdown_connections 2024-09-21T01:12:41.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.110+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/3296233461 wait complete. 2024-09-21T01:12:41.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.110+0000 7f3ddd8a1640 1 Processor -- start 2024-09-21T01:12:41.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.110+0000 7f3ddd8a1640 1 -- start start 2024-09-21T01:12:41.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3ddd8a1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd8103160 0x7f3dd819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3ddd8a1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dd8105170 0x7f3dd819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3ddd8a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dd8105ac0 0x7f3dd819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3ddd8a1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd81129c0 con 0x7f3dd8105170 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3ddd8a1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8112840 con 0x7f3dd8103160 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3ddd8a1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8112b40 con 0x7f3dd8105ac0 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd67fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dd8105170 0x7f3dd819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd67fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dd8105170 0x7f3dd819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46784/0 (socket says 172.21.15.148:46784) 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd67fc640 1 -- 172.21.15.148:0/1756091546 learned_addr learned my addr 172.21.15.148:0/1756091546 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dd8105ac0 0x7f3dd819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd6ffd640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd8103160 0x7f3dd819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd67fc640 1 -- 172.21.15.148:0/1756091546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dd8105ac0 msgr2=0x7f3dd819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd67fc640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dd8105ac0 0x7f3dd819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd67fc640 1 -- 172.21.15.148:0/1756091546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd8103160 msgr2=0x7f3dd819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd67fc640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd8103160 0x7f3dd819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd67fc640 1 -- 172.21.15.148:0/1756091546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd81a03b0 con 0x7f3dd8105170 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.111+0000 7f3dd67fc640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dd8105170 0x7f3dd819a9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c970 tx=0x7f3dc800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.112+0000 7f3ddc89f640 1 -- 172.21.15.148:0/1756091546 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8007bb0 con 0x7f3dd8105170 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.112+0000 7f3ddc89f640 1 -- 172.21.15.148:0/1756091546 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dc8007d50 con 0x7f3dd8105170 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.112+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/1756091546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd81a06a0 con 0x7f3dd8105170 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.112+0000 7f3ddc89f640 1 -- 172.21.15.148:0/1756091546 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800f450 con 0x7f3dd8105170 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.112+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/1756091546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd81a6e00 con 0x7f3dd8105170 2024-09-21T01:12:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.113+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/1756091546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd8103570 con 0x7f3dd8105170 2024-09-21T01:12:41.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.114+0000 7f3ddc89f640 1 -- 172.21.15.148:0/1756091546 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f3dc8004eb0 con 0x7f3dd8105170 2024-09-21T01:12:41.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.115+0000 7f3ddc89f640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3dc40b6620 0x7f3dc40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:41.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.115+0000 7f3dd6ffd640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3dc40b6620 0x7f3dc40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:41.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.115+0000 7f3ddc89f640 1 -- 172.21.15.148:0/1756091546 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f3dc80e72d0 con 0x7f3dd8105170 2024-09-21T01:12:41.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.115+0000 7f3dd6ffd640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3dc40b6620 0x7f3dc40b8b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0031440 tx=0x7f3dc0009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:41.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.118+0000 7f3ddc89f640 1 -- 172.21.15.148:0/1756091546 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3dc8014030 con 0x7f3dd8105170 2024-09-21T01:12:41.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.299+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/1756091546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f3dd819b570 con 0x7f3dd8105170 2024-09-21T01:12:41.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.299+0000 7f3ddc89f640 1 -- 172.21.15.148:0/1756091546 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v53) ==== 86+0+133 (secure 0 0 0) 0x7f3dd819b570 con 0x7f3dd8105170 2024-09-21T01:12:41.300 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:41.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.301+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/1756091546 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3dc40b6620 msgr2=0x7f3dc40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:41.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.301+0000 7f3ddd8a1640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3dc40b6620 0x7f3dc40b8b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0031440 tx=0x7f3dc0009560 comp rx=0 tx=0).stop 2024-09-21T01:12:41.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.301+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/1756091546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dd8105170 msgr2=0x7f3dd819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:41.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.301+0000 7f3ddd8a1640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dd8105170 0x7f3dd819a9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c970 tx=0x7f3dc800ce30 comp rx=0 tx=0).stop 2024-09-21T01:12:41.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.302+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/1756091546 shutdown_connections 2024-09-21T01:12:41.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.302+0000 7f3ddd8a1640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3dc40b6620 0x7f3dc40b8b30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:41.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.302+0000 7f3ddd8a1640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dd8105170 0x7f3dd819a9e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:41.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.302+0000 7f3ddd8a1640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dd8105ac0 0x7f3dd819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:41.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.302+0000 7f3ddd8a1640 1 --2- 172.21.15.148:0/1756091546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3dd8103160 0x7f3dd819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:41.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.302+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/1756091546 >> 172.21.15.148:0/1756091546 conn(0x7f3dd8077c60 msgr2=0x7f3dd8101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:41.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.302+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/1756091546 shutdown_connections 2024-09-21T01:12:41.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:41.302+0000 7f3ddd8a1640 1 -- 172.21.15.148:0/1756091546 wait complete. 2024-09-21T01:12:41.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:41 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1756091546' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T01:12:41.884 INFO:teuthology.orchestra.run.smithi148.stdout:[{"version":53,"timestamp":"2024-09-21T01:12:01.899689+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T01:12:41.884 INFO:tasks.ceph_manager:config epoch is 53 2024-09-21T01:12:41.884 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T01:12:41.884 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T01:12:41.884 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T01:12:41.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:41 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1756091546' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T01:12:41.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:41 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1756091546' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T01:12:42.133 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:42.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.566+0000 7f95a21e4640 1 -- 172.21.15.148:0/3444633908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f959c1094a0 msgr2=0x7f959c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:42.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.566+0000 7f95a21e4640 1 --2- 172.21.15.148:0/3444633908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f959c1094a0 0x7f959c1098b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9584009900 tx=0x7f958402a410 comp rx=0 tx=0).stop 2024-09-21T01:12:42.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.566+0000 7f95a21e4640 1 -- 172.21.15.148:0/3444633908 shutdown_connections 2024-09-21T01:12:42.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.566+0000 7f95a21e4640 1 --2- 172.21.15.148:0/3444633908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f959c1094a0 0x7f959c1098b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:42.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.566+0000 7f95a21e4640 1 --2- 172.21.15.148:0/3444633908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f959c109df0 0x7f959c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:42.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.566+0000 7f95a21e4640 1 --2- 172.21.15.148:0/3444633908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959c103b60 0x7f959c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.566+0000 7f95a21e4640 1 -- 172.21.15.148:0/3444633908 >> 172.21.15.148:0/3444633908 conn(0x7f959c07b850 msgr2=0x7f959c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.566+0000 7f95a21e4640 1 -- 172.21.15.148:0/3444633908 shutdown_connections 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.566+0000 7f95a21e4640 1 -- 172.21.15.148:0/3444633908 wait complete. 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.567+0000 7f95a21e4640 1 Processor -- start 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.567+0000 7f95a21e4640 1 -- start start 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.567+0000 7f95a21e4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959c103b60 0x7f959c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f95a21e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f959c1094a0 0x7f959c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f95a21e4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f959c109df0 0x7f959c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f95a21e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f959c113ab0 con 0x7f959c1094a0 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f95a21e4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f959c113930 con 0x7f959c103b60 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f95a21e4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f959c113c30 con 0x7f959c109df0 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f959c1094a0 0x7f959c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f959c1094a0 0x7f959c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46804/0 (socket says 172.21.15.148:46804) 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959affd640 1 -- 172.21.15.148:0/1832735273 learned_addr learned my addr 172.21.15.148:0/1832735273 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959b7fe640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959c103b60 0x7f959c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959bfff640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f959c109df0 0x7f959c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959affd640 1 -- 172.21.15.148:0/1832735273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f959c109df0 msgr2=0x7f959c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959affd640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f959c109df0 0x7f959c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959affd640 1 -- 172.21.15.148:0/1832735273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959c103b60 msgr2=0x7f959c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959affd640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959c103b60 0x7f959c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959affd640 1 -- 172.21.15.148:0/1832735273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c1a87c0 con 0x7f959c1094a0 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959bfff640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f959c109df0 0x7f959c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f959affd640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f959c1094a0 0x7f959c075c50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f958402a930 tx=0x7f9584004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f9598ff9640 1 -- 172.21.15.148:0/1832735273 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958403f030 con 0x7f959c1094a0 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f9598ff9640 1 -- 172.21.15.148:0/1832735273 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9584003cb0 con 0x7f959c1094a0 2024-09-21T01:12:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f95a21e4640 1 -- 172.21.15.148:0/1832735273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959c1a8a50 con 0x7f959c1094a0 2024-09-21T01:12:42.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f9598ff9640 1 -- 172.21.15.148:0/1832735273 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584035070 con 0x7f959c1094a0 2024-09-21T01:12:42.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.568+0000 7f95a21e4640 1 -- 172.21.15.148:0/1832735273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c1a8f80 con 0x7f959c1094a0 2024-09-21T01:12:42.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.569+0000 7f95a21e4640 1 -- 172.21.15.148:0/1832735273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959c103f70 con 0x7f959c1094a0 2024-09-21T01:12:42.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.571+0000 7f9598ff9640 1 -- 172.21.15.148:0/1832735273 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f9584042030 con 0x7f959c1094a0 2024-09-21T01:12:42.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.572+0000 7f9598ff9640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f95880b6620 0x7f95880b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:42.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.572+0000 7f959b7fe640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f95880b6620 0x7f95880b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:42.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.572+0000 7f9598ff9640 1 -- 172.21.15.148:0/1832735273 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f9584107d50 con 0x7f959c1094a0 2024-09-21T01:12:42.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.572+0000 7f959b7fe640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f95880b6620 0x7f95880b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f958c0058c0 tx=0x7f958c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:42.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.575+0000 7f9598ff9640 1 -- 172.21.15.148:0/1832735273 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f95840ce5b0 con 0x7f959c1094a0 2024-09-21T01:12:42.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.803+0000 7f95a21e4640 1 -- 172.21.15.148:0/1832735273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f959c02e640 con 0x7f959c1094a0 2024-09-21T01:12:42.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.807+0000 7f9598ff9640 1 -- 172.21.15.148:0/1832735273 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296446 (secure 0 0 0) 0x7f95840d2990 con 0x7f959c1094a0 2024-09-21T01:12:42.812 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:42.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.810+0000 7f95a21e4640 1 -- 172.21.15.148:0/1832735273 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f95880b6620 msgr2=0x7f95880b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:42.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.810+0000 7f95a21e4640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f95880b6620 0x7f95880b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f958c0058c0 tx=0x7f958c00a2d0 comp rx=0 tx=0).stop 2024-09-21T01:12:42.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.810+0000 7f95a21e4640 1 -- 172.21.15.148:0/1832735273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f959c1094a0 msgr2=0x7f959c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:42.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.810+0000 7f95a21e4640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f959c1094a0 0x7f959c075c50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f958402a930 tx=0x7f9584004270 comp rx=0 tx=0).stop 2024-09-21T01:12:42.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.810+0000 7f95a21e4640 1 -- 172.21.15.148:0/1832735273 shutdown_connections 2024-09-21T01:12:42.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.810+0000 7f95a21e4640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f95880b6620 0x7f95880b8b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:42.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.810+0000 7f95a21e4640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f959c1094a0 0x7f959c075c50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:42.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.810+0000 7f95a21e4640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f959c109df0 0x7f959c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:42.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.810+0000 7f95a21e4640 1 --2- 172.21.15.148:0/1832735273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f959c103b60 0x7f959c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:42.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.810+0000 7f95a21e4640 1 -- 172.21.15.148:0/1832735273 >> 172.21.15.148:0/1832735273 conn(0x7f959c07b850 msgr2=0x7f959c1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:42.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.811+0000 7f95a21e4640 1 -- 172.21.15.148:0/1832735273 shutdown_connections 2024-09-21T01:12:42.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:42.811+0000 7f95a21e4640 1 -- 172.21.15.148:0/1832735273 wait complete. 2024-09-21T01:12:43.448 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":1101840134},{"type":"v1","addr":"172.21.15.148:6801","nonce":1101840134}]},"active_addr":"172.21.15.148:6801/1101840134","active_change":"2024-09-21T01:04:54.215901+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24143,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.148:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":930323899}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":1645736268}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":3923660309}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":3888291474}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":1090219100}]}]} 2024-09-21T01:12:43.454 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T01:12:43.454 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T01:12:43.454 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:12:43.700 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:43.943 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:43 smithi148 ceph-mon[31000]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-21T01:12:43.943 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:43 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1832735273' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T01:12:43.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:43 smithi181 ceph-mon[34811]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-21T01:12:43.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:43 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1832735273' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T01:12:43.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:43 smithi157 ceph-mon[34140]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-21T01:12:43.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:43 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1832735273' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T01:12:44.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.132+0000 7f0efe035640 1 -- 172.21.15.148:0/3663184578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef81094a0 msgr2=0x7f0ef81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:44.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.132+0000 7f0efe035640 1 --2- 172.21.15.148:0/3663184578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef81094a0 0x7f0ef81098b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009ca0 tx=0x7f0eec02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:12:44.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.132+0000 7f0efe035640 1 -- 172.21.15.148:0/3663184578 shutdown_connections 2024-09-21T01:12:44.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.132+0000 7f0efe035640 1 --2- 172.21.15.148:0/3663184578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef81094a0 0x7f0ef81098b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:44.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.132+0000 7f0efe035640 1 --2- 172.21.15.148:0/3663184578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef8109df0 0x7f0ef8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:44.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.132+0000 7f0efe035640 1 --2- 172.21.15.148:0/3663184578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef8103b60 0x7f0ef8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:44.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.132+0000 7f0efe035640 1 -- 172.21.15.148:0/3663184578 >> 172.21.15.148:0/3663184578 conn(0x7f0ef807b850 msgr2=0x7f0ef807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:44.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.132+0000 7f0efe035640 1 -- 172.21.15.148:0/3663184578 shutdown_connections 2024-09-21T01:12:44.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.132+0000 7f0efe035640 1 -- 172.21.15.148:0/3663184578 wait complete. 2024-09-21T01:12:44.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0efe035640 1 Processor -- start 2024-09-21T01:12:44.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0efe035640 1 -- start start 2024-09-21T01:12:44.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0efe035640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef8103b60 0x7f0ef819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:44.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0efe035640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef81094a0 0x7f0ef819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:44.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0efe035640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef8109df0 0x7f0ef819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:44.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0efe035640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef8113ab0 con 0x7f0ef81094a0 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0efe035640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef8113930 con 0x7f0ef8103b60 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0efe035640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef8113c30 con 0x7f0ef8109df0 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0ef6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef81094a0 0x7f0ef819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0ef6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef81094a0 0x7f0ef819aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46818/0 (socket says 172.21.15.148:46818) 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.133+0000 7f0ef6ffd640 1 -- 172.21.15.148:0/65132258 learned_addr learned my addr 172.21.15.148:0/65132258 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef77fe640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef8103b60 0x7f0ef819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef7fff640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef8109df0 0x7f0ef819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef6ffd640 1 -- 172.21.15.148:0/65132258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef8109df0 msgr2=0x7f0ef819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef6ffd640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef8109df0 0x7f0ef819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef6ffd640 1 -- 172.21.15.148:0/65132258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef8103b60 msgr2=0x7f0ef819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef6ffd640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef8103b60 0x7f0ef819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:44.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef6ffd640 1 -- 172.21.15.148:0/65132258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef81a0370 con 0x7f0ef81094a0 2024-09-21T01:12:44.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef7fff640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef8109df0 0x7f0ef819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:44.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef6ffd640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef81094a0 0x7f0ef819aa60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0eec02ade0 tx=0x7f0eec031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:44.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef4ff9640 1 -- 172.21.15.148:0/65132258 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec003d20 con 0x7f0ef81094a0 2024-09-21T01:12:44.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0efe035640 1 -- 172.21.15.148:0/65132258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef81a0600 con 0x7f0ef81094a0 2024-09-21T01:12:44.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef4ff9640 1 -- 172.21.15.148:0/65132258 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0eec0044f0 con 0x7f0ef81094a0 2024-09-21T01:12:44.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0ef4ff9640 1 -- 172.21.15.148:0/65132258 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec02fd40 con 0x7f0ef81094a0 2024-09-21T01:12:44.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.134+0000 7f0efe035640 1 -- 172.21.15.148:0/65132258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef81a0b40 con 0x7f0ef81094a0 2024-09-21T01:12:44.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.135+0000 7f0efe035640 1 -- 172.21.15.148:0/65132258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef8103f70 con 0x7f0ef81094a0 2024-09-21T01:12:44.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.137+0000 7f0ef4ff9640 1 -- 172.21.15.148:0/65132258 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f0eec004040 con 0x7f0ef81094a0 2024-09-21T01:12:44.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.137+0000 7f0ef4ff9640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65d0 0x7f0ee00b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:44.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.137+0000 7f0ef77fe640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65d0 0x7f0ee00b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:44.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.137+0000 7f0ef4ff9640 1 -- 172.21.15.148:0/65132258 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f0eec108940 con 0x7f0ef81094a0 2024-09-21T01:12:44.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.138+0000 7f0ef77fe640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65d0 0x7f0ee00b8ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8005fd0 tx=0x7f0ee8005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:44.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.141+0000 7f0ef4ff9640 1 -- 172.21.15.148:0/65132258 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0eec0cf220 con 0x7f0ef81094a0 2024-09-21T01:12:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.321+0000 7f0efe035640 1 -- 172.21.15.148:0/65132258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ef810bbc0 con 0x7f0ef81094a0 2024-09-21T01:12:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.323+0000 7f0ef4ff9640 1 -- 172.21.15.148:0/65132258 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22386 (secure 0 0 0) 0x7f0eec0d3600 con 0x7f0ef81094a0 2024-09-21T01:12:44.324 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:44.324 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:11.894328+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 -- 172.21.15.148:0/65132258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65d0 msgr2=0x7f0ee00b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65d0 0x7f0ee00b8ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8005fd0 tx=0x7f0ee8005e20 comp rx=0 tx=0).stop 2024-09-21T01:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 -- 172.21.15.148:0/65132258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef81094a0 msgr2=0x7f0ef819aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef81094a0 0x7f0ef819aa60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0eec02ade0 tx=0x7f0eec031a10 comp rx=0 tx=0).stop 2024-09-21T01:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 -- 172.21.15.148:0/65132258 shutdown_connections 2024-09-21T01:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65d0 0x7f0ee00b8ae0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef81094a0 0x7f0ef819aa60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef8109df0 0x7f0ef819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 --2- 172.21.15.148:0/65132258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef8103b60 0x7f0ef819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 -- 172.21.15.148:0/65132258 >> 172.21.15.148:0/65132258 conn(0x7f0ef807b850 msgr2=0x7f0ef8105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 -- 172.21.15.148:0/65132258 shutdown_connections 2024-09-21T01:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:44.325+0000 7f0efe035640 1 -- 172.21.15.148:0/65132258 wait complete. 2024-09-21T01:12:44.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:44 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/65132258' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:44.934 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T01:12:44.934 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:12:44.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:44 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/65132258' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:44.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:44 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/65132258' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:45.182 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:45.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.641+0000 7fb81aff0640 1 -- 172.21.15.148:0/3659309552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8141049d0 msgr2=0x7fb814104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.641+0000 7fb81aff0640 1 --2- 172.21.15.148:0/3659309552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8141049d0 0x7fb814104de0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb808009900 tx=0x7fb80802a410 comp rx=0 tx=0).stop 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.641+0000 7fb81aff0640 1 -- 172.21.15.148:0/3659309552 shutdown_connections 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.641+0000 7fb81aff0640 1 --2- 172.21.15.148:0/3659309552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb81410de30 0x7fb814110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.641+0000 7fb81aff0640 1 --2- 172.21.15.148:0/3659309552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb814105320 0x7fb81410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.641+0000 7fb81aff0640 1 --2- 172.21.15.148:0/3659309552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8141049d0 0x7fb814104de0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.641+0000 7fb81aff0640 1 -- 172.21.15.148:0/3659309552 >> 172.21.15.148:0/3659309552 conn(0x7fb814079740 msgr2=0x7fb814079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.641+0000 7fb81aff0640 1 -- 172.21.15.148:0/3659309552 shutdown_connections 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.641+0000 7fb81aff0640 1 -- 172.21.15.148:0/3659309552 wait complete. 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81aff0640 1 Processor -- start 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81aff0640 1 -- start start 2024-09-21T01:12:45.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81aff0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8141049d0 0x7fb814102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81aff0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb814105320 0x7fb814102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81aff0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb81410de30 0x7fb814103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81aff0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb814113ab0 con 0x7fb81410de30 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81aff0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb814113930 con 0x7fb814105320 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81aff0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb814113c30 con 0x7fb8141049d0 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81958d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb81410de30 0x7fb814103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81958d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb81410de30 0x7fb814103190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46840/0 (socket says 172.21.15.148:46840) 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81958d640 1 -- 172.21.15.148:0/1682567897 learned_addr learned my addr 172.21.15.148:0/1682567897 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb813fff640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb814105320 0x7fb814102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb818d8c640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8141049d0 0x7fb814102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81958d640 1 -- 172.21.15.148:0/1682567897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8141049d0 msgr2=0x7fb814102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81958d640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8141049d0 0x7fb814102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81958d640 1 -- 172.21.15.148:0/1682567897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb814105320 msgr2=0x7fb814102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:45.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81958d640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb814105320 0x7fb814102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.642+0000 7fb81958d640 1 -- 172.21.15.148:0/1682567897 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8141a8860 con 0x7fb81410de30 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.643+0000 7fb81958d640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb81410de30 0x7fb814103190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00eb10 tx=0x7fb80c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.643+0000 7fb811ffb640 1 -- 172.21.15.148:0/1682567897 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c004b20 con 0x7fb81410de30 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.643+0000 7fb81aff0640 1 -- 172.21.15.148:0/1682567897 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8141a8b50 con 0x7fb81410de30 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.643+0000 7fb811ffb640 1 -- 172.21.15.148:0/1682567897 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb80c004cc0 con 0x7fb81410de30 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.643+0000 7fb811ffb640 1 -- 172.21.15.148:0/1682567897 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c010690 con 0x7fb81410de30 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.643+0000 7fb81aff0640 1 -- 172.21.15.148:0/1682567897 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8141a90e0 con 0x7fb81410de30 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.644+0000 7fb81aff0640 1 -- 172.21.15.148:0/1682567897 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb814104de0 con 0x7fb81410de30 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.645+0000 7fb811ffb640 1 -- 172.21.15.148:0/1682567897 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fb80c005000 con 0x7fb81410de30 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.646+0000 7fb811ffb640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb8040b65a0 0x7fb8040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.646+0000 7fb818d8c640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb8040b65a0 0x7fb8040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.646+0000 7fb811ffb640 1 -- 172.21.15.148:0/1682567897 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fb80c0e79d0 con 0x7fb81410de30 2024-09-21T01:12:45.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.647+0000 7fb818d8c640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb8040b65a0 0x7fb8040b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb808009230 tx=0x7fb808031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:45.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.649+0000 7fb811ffb640 1 -- 172.21.15.148:0/1682567897 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb80c056710 con 0x7fb81410de30 2024-09-21T01:12:45.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.827+0000 7fb81aff0640 1 -- 172.21.15.148:0/1682567897 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb814103a10 con 0x7fb81410de30 2024-09-21T01:12:45.828 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:45 smithi148 ceph-mon[31000]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-21T01:12:45.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.829+0000 7fb811ffb640 1 -- 172.21.15.148:0/1682567897 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22386 (secure 0 0 0) 0x7fb814103a10 con 0x7fb81410de30 2024-09-21T01:12:45.830 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:12:45.830 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:11.894328+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:12:45.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 -- 172.21.15.148:0/1682567897 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb8040b65a0 msgr2=0x7fb8040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:45.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb8040b65a0 0x7fb8040b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb808009230 tx=0x7fb808031400 comp rx=0 tx=0).stop 2024-09-21T01:12:45.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 -- 172.21.15.148:0/1682567897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb81410de30 msgr2=0x7fb814103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:45.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb81410de30 0x7fb814103190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00eb10 tx=0x7fb80c00c2d0 comp rx=0 tx=0).stop 2024-09-21T01:12:45.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 -- 172.21.15.148:0/1682567897 shutdown_connections 2024-09-21T01:12:45.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb8040b65a0 0x7fb8040b8ab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:45.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb81410de30 0x7fb814103190 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:45.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb814105320 0x7fb814102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:45.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 --2- 172.21.15.148:0/1682567897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8141049d0 0x7fb814102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:45.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 -- 172.21.15.148:0/1682567897 >> 172.21.15.148:0/1682567897 conn(0x7fb814079740 msgr2=0x7fb8141068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:45.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 -- 172.21.15.148:0/1682567897 shutdown_connections 2024-09-21T01:12:45.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:45.831+0000 7fb81aff0640 1 -- 172.21.15.148:0/1682567897 wait complete. 2024-09-21T01:12:45.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:45 smithi181 ceph-mon[34811]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-21T01:12:45.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:45 smithi157 ceph-mon[34140]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-21T01:12:46.593 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T01:12:46.593 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T01:12:46.594 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T01:12:46.594 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T01:12:46.594 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T01:12:46.595 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T01:12:46.595 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T01:12:46.596 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T01:12:46.596 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T01:12:46.597 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T01:12:46.597 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T01:12:46.597 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T01:12:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:46 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1682567897' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:46.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:46 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1682567897' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:46.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:46 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1682567897' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:12:47.241 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:47.251 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:47.328 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:47.335 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:47.337 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:47.343 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:47.345 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:47.345 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:47.693 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:47 smithi148 ceph-mon[31000]: pgmap v300: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T01:12:47.777 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:47.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:47 smithi181 ceph-mon[34811]: pgmap v300: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T01:12:47.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:47 smithi157 ceph-mon[34140]: pgmap v300: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T01:12:48.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.433+0000 7f17f1045640 1 -- 172.21.15.148:0/653327260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec10de30 msgr2=0x7f17ec110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:48.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.433+0000 7f17f1045640 1 --2- 172.21.15.148:0/653327260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec10de30 0x7f17ec110320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009ca0 tx=0x7f17e402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.433+0000 7f17f1045640 1 -- 172.21.15.148:0/653327260 shutdown_connections 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.433+0000 7f17f1045640 1 --2- 172.21.15.148:0/653327260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec10de30 0x7f17ec110320 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.433+0000 7f17f1045640 1 --2- 172.21.15.148:0/653327260 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17ec105320 0x7f17ec10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.433+0000 7f17f1045640 1 --2- 172.21.15.148:0/653327260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17ec1049d0 0x7f17ec104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.433+0000 7f17f1045640 1 -- 172.21.15.148:0/653327260 >> 172.21.15.148:0/653327260 conn(0x7f17ec079740 msgr2=0x7f17ec079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.434+0000 7f17f1045640 1 -- 172.21.15.148:0/653327260 shutdown_connections 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.434+0000 7f17f1045640 1 -- 172.21.15.148:0/653327260 wait complete. 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.434+0000 7f17f1045640 1 Processor -- start 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.435+0000 7f17f1045640 1 -- start start 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.435+0000 7f17f1045640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17ec1049d0 0x7f17ec19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.435+0000 7f17f1045640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17ec105320 0x7f17ec19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.435+0000 7f17f1045640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec10de30 0x7f17ec19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:48.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.435+0000 7f17f1045640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec113ab0 con 0x7f17ec10de30 2024-09-21T01:12:48.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.435+0000 7f17f1045640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec113930 con 0x7f17ec1049d0 2024-09-21T01:12:48.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.435+0000 7f17f1045640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec113c30 con 0x7f17ec105320 2024-09-21T01:12:48.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.435+0000 7f17ea59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17ec105320 0x7f17ec19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:48.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17ea59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17ec105320 0x7f17ec19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:52734/0 (socket says 172.21.15.148:52734) 2024-09-21T01:12:48.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17ea59c640 1 -- 172.21.15.148:0/2127405428 learned_addr learned my addr 172.21.15.148:0/2127405428 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:48.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17ead9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17ec1049d0 0x7f17ec19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:48.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17eb59e640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec10de30 0x7f17ec19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:48.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17ea59c640 1 -- 172.21.15.148:0/2127405428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17ec1049d0 msgr2=0x7f17ec19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:48.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17ea59c640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17ec1049d0 0x7f17ec19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:48.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17ea59c640 1 -- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec10de30 msgr2=0x7f17ec19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:48.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17ea59c640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec10de30 0x7f17ec19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:48.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17ea59c640 1 -- 172.21.15.148:0/2127405428 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec1a0330 con 0x7f17ec105320 2024-09-21T01:12:48.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17ead9d640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17ec1049d0 0x7f17ec19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:12:48.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.436+0000 7f17ea59c640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17ec105320 0x7f17ec19aa20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17e000c8c0 tx=0x7f17e000cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:48.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.437+0000 7f17d3fff640 1 -- 172.21.15.148:0/2127405428 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0007bb0 con 0x7f17ec105320 2024-09-21T01:12:48.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.437+0000 7f17d3fff640 1 -- 172.21.15.148:0/2127405428 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17e0007d50 con 0x7f17ec105320 2024-09-21T01:12:48.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.437+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec1a0620 con 0x7f17ec105320 2024-09-21T01:12:48.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.437+0000 7f17d3fff640 1 -- 172.21.15.148:0/2127405428 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e00187c0 con 0x7f17ec105320 2024-09-21T01:12:48.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.437+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec1a6e40 con 0x7f17ec105320 2024-09-21T01:12:48.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.438+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f17ec100fe0 con 0x7f17ec105320 2024-09-21T01:12:48.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.440+0000 7f17d3fff640 1 -- 172.21.15.148:0/2127405428 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f17e000fa20 con 0x7f17ec105320 2024-09-21T01:12:48.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.440+0000 7f17d3fff640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f17d40b65d0 0x7f17d40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:48.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.441+0000 7f17ead9d640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f17d40b65d0 0x7f17d40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:48.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.441+0000 7f17d3fff640 1 -- 172.21.15.148:0/2127405428 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f17e00e7920 con 0x7f17ec105320 2024-09-21T01:12:48.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.441+0000 7f17d3fff640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] conn(0x7f17d40bfd60 0x7f17d40c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:48.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.441+0000 7f17d3fff640 1 -- 172.21.15.148:0/2127405428 --> [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17e001ee50 con 0x7f17d40bfd60 2024-09-21T01:12:48.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.441+0000 7f17d3fff640 1 -- 172.21.15.148:0/2127405428 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f17e00e7e00 con 0x7f17ec105320 2024-09-21T01:12:48.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.441+0000 7f17eb59e640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] conn(0x7f17d40bfd60 0x7f17d40c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:48.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.441+0000 7f17ead9d640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f17d40b65d0 0x7f17d40b8ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0058c0 tx=0x7f17dc00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:48.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.441+0000 7f17eb59e640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] conn(0x7f17d40bfd60 0x7f17d40c21b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:48.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.443+0000 7f17d3fff640 1 -- 172.21.15.148:0/2127405428 <== osd.0 v2:172.21.15.148:6802/2331338222 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f17e001ee50 con 0x7f17d40bfd60 2024-09-21T01:12:48.444 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:48.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.457+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 --> [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f17ec06b390 con 0x7f17d40bfd60 2024-09-21T01:12:48.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17d3fff640 1 -- 172.21.15.148:0/2127405428 <== osd.0 v2:172.21.15.148:6802/2331338222 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f17ec06b390 con 0x7f17d40bfd60 2024-09-21T01:12:48.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] conn(0x7f17d40bfd60 msgr2=0x7f17d40c21b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:48.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17f1045640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] conn(0x7f17d40bfd60 0x7f17d40c21b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:48.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f17d40b65d0 msgr2=0x7f17d40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:48.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17f1045640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f17d40b65d0 0x7f17d40b8ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0058c0 tx=0x7f17dc00a2d0 comp rx=0 tx=0).stop 2024-09-21T01:12:48.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17ec105320 msgr2=0x7f17ec19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:48.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17f1045640 1 --2- 172.21.15.148:0/2127405428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17ec105320 0x7f17ec19aa20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17e000c8c0 tx=0x7f17e000cd80 comp rx=0 tx=0).stop 2024-09-21T01:12:48.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17eb59e640 1 -- 172.21.15.148:0/2127405428 reap_dead start 2024-09-21T01:12:48.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 shutdown_connections 2024-09-21T01:12:48.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 >> 172.21.15.148:0/2127405428 conn(0x7f17ec079740 msgr2=0x7f17ec0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:48.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 shutdown_connections 2024-09-21T01:12:48.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.458+0000 7f17f1045640 1 -- 172.21.15.148:0/2127405428 wait complete. 2024-09-21T01:12:49.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.534+0000 7f51957ec640 1 -- 172.21.15.148:0/3350254632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51901083a0 msgr2=0x7f51901087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:49.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.534+0000 7f51957ec640 1 --2- 172.21.15.148:0/3350254632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51901083a0 0x7f51901087b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5178009900 tx=0x7f517802a410 comp rx=0 tx=0).stop 2024-09-21T01:12:49.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.534+0000 7f51957ec640 1 -- 172.21.15.148:0/3350254632 shutdown_connections 2024-09-21T01:12:49.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.534+0000 7f51957ec640 1 --2- 172.21.15.148:0/3350254632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51901083a0 0x7f51901087b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:49.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.534+0000 7f51957ec640 1 --2- 172.21.15.148:0/3350254632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5190108cf0 0x7f519010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:49.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.534+0000 7f51957ec640 1 --2- 172.21.15.148:0/3350254632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5190102a60 0x7f5190102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:49.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.534+0000 7f51957ec640 1 -- 172.21.15.148:0/3350254632 >> 172.21.15.148:0/3350254632 conn(0x7f5190079730 msgr2=0x7f5190079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:49.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.535+0000 7f51957ec640 1 -- 172.21.15.148:0/3350254632 shutdown_connections 2024-09-21T01:12:49.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.535+0000 7f51957ec640 1 -- 172.21.15.148:0/3350254632 wait complete. 2024-09-21T01:12:49.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.535+0000 7f51957ec640 1 Processor -- start 2024-09-21T01:12:49.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.535+0000 7f51957ec640 1 -- start start 2024-09-21T01:12:49.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f51957ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5190102a60 0x7f5190199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f51957ec640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51901083a0 0x7f51901998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f51957ec640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5190108cf0 0x7f519019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f51957ec640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5190112960 con 0x7f5190102a60 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f51957ec640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f51901127e0 con 0x7f51901083a0 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f51957ec640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5190112ae0 con 0x7f5190108cf0 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5190102a60 0x7f5190199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5190102a60 0x7f5190199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46932/0 (socket says 172.21.15.148:46932) 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518effd640 1 -- 172.21.15.148:0/1294760625 learned_addr learned my addr 172.21.15.148:0/1294760625 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518f7fe640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5190108cf0 0x7f519019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f51867fc640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51901083a0 0x7f51901998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518effd640 1 -- 172.21.15.148:0/1294760625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5190108cf0 msgr2=0x7f519019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:49.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518effd640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5190108cf0 0x7f519019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518effd640 1 -- 172.21.15.148:0/1294760625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51901083a0 msgr2=0x7f51901998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518effd640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51901083a0 0x7f51901998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518effd640 1 -- 172.21.15.148:0/1294760625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519019f2a0 con 0x7f5190102a60 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f51867fc640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51901083a0 0x7f51901998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518effd640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5190102a60 0x7f5190199330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f518000d950 tx=0x7f518000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518cff9640 1 -- 172.21.15.148:0/1294760625 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180017070 con 0x7f5190102a60 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518cff9640 1 -- 172.21.15.148:0/1294760625 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5180009c30 con 0x7f5190102a60 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f519019f590 con 0x7f5190102a60 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.536+0000 7f518cff9640 1 -- 172.21.15.148:0/1294760625 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518000f620 con 0x7f5190102a60 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.537+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51901a5cf0 con 0x7f5190102a60 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.537+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5190063b50 con 0x7f5190102a60 2024-09-21T01:12:49.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.539+0000 7f518cff9640 1 -- 172.21.15.148:0/1294760625 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f5180010460 con 0x7f5190102a60 2024-09-21T01:12:49.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.540+0000 7f518cff9640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f517c0b65a0 0x7f517c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:49.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.540+0000 7f51867fc640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f517c0b65a0 0x7f517c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:49.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.540+0000 7f518cff9640 1 -- 172.21.15.148:0/1294760625 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f51800e74c0 con 0x7f5190102a60 2024-09-21T01:12:49.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.540+0000 7f518cff9640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] conn(0x7f517c0bfd30 0x7f517c0c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:49.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.540+0000 7f518cff9640 1 -- 172.21.15.148:0/1294760625 --> [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5180015e80 con 0x7f517c0bfd30 2024-09-21T01:12:49.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.540+0000 7f518cff9640 1 -- 172.21.15.148:0/1294760625 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f51800e79a0 con 0x7f5190102a60 2024-09-21T01:12:49.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.540+0000 7f518f7fe640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] conn(0x7f517c0bfd30 0x7f517c0c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:49.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.540+0000 7f51867fc640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f517c0b65a0 0x7f517c0b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f51780096c0 tx=0x7f5178031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:49.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.541+0000 7f518f7fe640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] conn(0x7f517c0bfd30 0x7f517c0c2180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:49.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.541+0000 7f518cff9640 1 -- 172.21.15.148:0/1294760625 <== osd.3 v2:172.21.15.148:6810/2214807650 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5180015e80 con 0x7f517c0bfd30 2024-09-21T01:12:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.555+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 --> [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5190063f50 con 0x7f517c0bfd30 2024-09-21T01:12:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f518cff9640 1 -- 172.21.15.148:0/1294760625 <== osd.3 v2:172.21.15.148:6810/2214807650 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5190063f50 con 0x7f517c0bfd30 2024-09-21T01:12:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] conn(0x7f517c0bfd30 msgr2=0x7f517c0c2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f51957ec640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] conn(0x7f517c0bfd30 0x7f517c0c2180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f517c0b65a0 msgr2=0x7f517c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f51957ec640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f517c0b65a0 0x7f517c0b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f51780096c0 tx=0x7f5178031400 comp rx=0 tx=0).stop 2024-09-21T01:12:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5190102a60 msgr2=0x7f5190199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f51957ec640 1 --2- 172.21.15.148:0/1294760625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5190102a60 0x7f5190199330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f518000d950 tx=0x7f518000de10 comp rx=0 tx=0).stop 2024-09-21T01:12:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f518f7fe640 1 -- 172.21.15.148:0/1294760625 reap_dead start 2024-09-21T01:12:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 shutdown_connections 2024-09-21T01:12:49.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 >> 172.21.15.148:0/1294760625 conn(0x7f5190079730 msgr2=0x7f5190104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:49.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 shutdown_connections 2024-09-21T01:12:49.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.556+0000 7f51957ec640 1 -- 172.21.15.148:0/1294760625 wait complete. 2024-09-21T01:12:49.956 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:49 smithi148 ceph-mon[31000]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:12:49.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:49 smithi181 ceph-mon[34811]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:12:49.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:49 smithi157 ceph-mon[34140]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:12:50.402 INFO:teuthology.orchestra.run.smithi148.stdout:34359738442 2024-09-21T01:12:50.403 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T01:12:50.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.759+0000 7f242e120640 1 -- 172.21.15.148:0/2506369701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2428102a60 msgr2=0x7f2428102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.759+0000 7f242e120640 1 --2- 172.21.15.148:0/2506369701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2428102a60 0x7f2428102e70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2418009900 tx=0x7f241802a410 comp rx=0 tx=0).stop 2024-09-21T01:12:50.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.759+0000 7f242e120640 1 -- 172.21.15.148:0/2506369701 shutdown_connections 2024-09-21T01:12:50.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.759+0000 7f242e120640 1 --2- 172.21.15.148:0/2506369701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2428108cf0 0x7f242810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.759+0000 7f242e120640 1 --2- 172.21.15.148:0/2506369701 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24281083a0 0x7f24281087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.759+0000 7f242e120640 1 --2- 172.21.15.148:0/2506369701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2428102a60 0x7f2428102e70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.759+0000 7f242e120640 1 -- 172.21.15.148:0/2506369701 >> 172.21.15.148:0/2506369701 conn(0x7f2428079730 msgr2=0x7f2428079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:50.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.759+0000 7f242e120640 1 -- 172.21.15.148:0/2506369701 shutdown_connections 2024-09-21T01:12:50.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.759+0000 7f242e120640 1 -- 172.21.15.148:0/2506369701 wait complete. 2024-09-21T01:12:50.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.760+0000 7f242e120640 1 Processor -- start 2024-09-21T01:12:50.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.760+0000 7f242e120640 1 -- start start 2024-09-21T01:12:50.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.760+0000 7f242e120640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2428102a60 0x7f242819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:50.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.760+0000 7f242e120640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281083a0 0x7f242819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:50.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.760+0000 7f242e120640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2428108cf0 0x7f242819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:50.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.760+0000 7f242e120640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2428112960 con 0x7f24281083a0 2024-09-21T01:12:50.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.760+0000 7f242e120640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f24281127e0 con 0x7f2428102a60 2024-09-21T01:12:50.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.760+0000 7f242e120640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2428112ae0 con 0x7f2428108cf0 2024-09-21T01:12:50.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2426ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281083a0 0x7f242819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:50.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2426ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281083a0 0x7f242819b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46946/0 (socket says 172.21.15.148:46946) 2024-09-21T01:12:50.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2426ffd640 1 -- 172.21.15.148:0/4097228882 learned_addr learned my addr 172.21.15.148:0/4097228882 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:50.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2427fff640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2428108cf0 0x7f242819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:50.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f24277fe640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2428102a60 0x7f242819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:50.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2426ffd640 1 -- 172.21.15.148:0/4097228882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2428108cf0 msgr2=0x7f242819bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2426ffd640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2428108cf0 0x7f242819bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2426ffd640 1 -- 172.21.15.148:0/4097228882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2428102a60 msgr2=0x7f242819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2426ffd640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2428102a60 0x7f242819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2426ffd640 1 -- 172.21.15.148:0/4097228882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24281a64c0 con 0x7f24281083a0 2024-09-21T01:12:50.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f24277fe640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2428102a60 0x7f242819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:50.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2426ffd640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281083a0 0x7f242819b770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f241000d770 tx=0x7f241000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:50.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2424ff9640 1 -- 172.21.15.148:0/4097228882 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410017070 con 0x7f24281083a0 2024-09-21T01:12:50.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2424ff9640 1 -- 172.21.15.148:0/4097228882 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2410009c30 con 0x7f24281083a0 2024-09-21T01:12:50.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24281a67b0 con 0x7f24281083a0 2024-09-21T01:12:50.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f2424ff9640 1 -- 172.21.15.148:0/4097228882 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241000f620 con 0x7f24281083a0 2024-09-21T01:12:50.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.761+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24281a6cf0 con 0x7f24281083a0 2024-09-21T01:12:50.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.762+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2428063b50 con 0x7f24281083a0 2024-09-21T01:12:50.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.764+0000 7f2424ff9640 1 -- 172.21.15.148:0/4097228882 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f241001a070 con 0x7f24281083a0 2024-09-21T01:12:50.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.764+0000 7f2424ff9640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24140b65d0 0x7f24140b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:50.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.765+0000 7f24277fe640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24140b65d0 0x7f24140b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:50.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.765+0000 7f2424ff9640 1 -- 172.21.15.148:0/4097228882 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f24100e72c0 con 0x7f24281083a0 2024-09-21T01:12:50.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.765+0000 7f2424ff9640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] conn(0x7f24140bfd60 0x7f24140c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:50.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.765+0000 7f2424ff9640 1 -- 172.21.15.148:0/4097228882 --> [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2410020e50 con 0x7f24140bfd60 2024-09-21T01:12:50.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.765+0000 7f2424ff9640 1 -- 172.21.15.148:0/4097228882 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f24100e77a0 con 0x7f24281083a0 2024-09-21T01:12:50.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.765+0000 7f24277fe640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24140b65d0 0x7f24140b8ae0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2418000c00 tx=0x7f2418031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:50.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.765+0000 7f2427fff640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] conn(0x7f24140bfd60 0x7f24140c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:50.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.766+0000 7f2427fff640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] conn(0x7f24140bfd60 0x7f24140c21b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:50.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.766+0000 7f2424ff9640 1 -- 172.21.15.148:0/4097228882 <== osd.10 v2:172.21.15.157:6824/3455888690 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2410020e50 con 0x7f24140bfd60 2024-09-21T01:12:50.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.780+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 --> [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2428063f50 con 0x7f24140bfd60 2024-09-21T01:12:50.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f2424ff9640 1 -- 172.21.15.148:0/4097228882 <== osd.10 v2:172.21.15.157:6824/3455888690 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2428063f50 con 0x7f24140bfd60 2024-09-21T01:12:50.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 >> [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] conn(0x7f24140bfd60 msgr2=0x7f24140c21b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f242e120640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] conn(0x7f24140bfd60 0x7f24140c21b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24140b65d0 msgr2=0x7f24140b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f242e120640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24140b65d0 0x7f24140b8ae0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2418000c00 tx=0x7f2418031400 comp rx=0 tx=0).stop 2024-09-21T01:12:50.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281083a0 msgr2=0x7f242819b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f242e120640 1 --2- 172.21.15.148:0/4097228882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24281083a0 0x7f242819b770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f241000d770 tx=0x7f241000dc30 comp rx=0 tx=0).stop 2024-09-21T01:12:50.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f2427fff640 1 -- 172.21.15.148:0/4097228882 reap_dead start 2024-09-21T01:12:50.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 shutdown_connections 2024-09-21T01:12:50.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 >> 172.21.15.148:0/4097228882 conn(0x7f2428079730 msgr2=0x7f24281014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:50.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 shutdown_connections 2024-09-21T01:12:50.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:49.781+0000 7f242e120640 1 -- 172.21.15.148:0/4097228882 wait complete. 2024-09-21T01:12:50.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.660+0000 7f383351d640 1 -- 172.21.15.148:0/137558535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f382c102b40 msgr2=0x7f382c102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.660+0000 7f383351d640 1 --2- 172.21.15.148:0/137558535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f382c102b40 0x7f382c102f50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3828009900 tx=0x7f382802a410 comp rx=0 tx=0).stop 2024-09-21T01:12:50.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.660+0000 7f383351d640 1 -- 172.21.15.148:0/137558535 shutdown_connections 2024-09-21T01:12:50.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.660+0000 7f383351d640 1 --2- 172.21.15.148:0/137558535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f382c108dd0 0x7f382c10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.660+0000 7f383351d640 1 --2- 172.21.15.148:0/137558535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f382c108480 0x7f382c108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.660+0000 7f383351d640 1 --2- 172.21.15.148:0/137558535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f382c102b40 0x7f382c102f50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.660+0000 7f383351d640 1 -- 172.21.15.148:0/137558535 >> 172.21.15.148:0/137558535 conn(0x7f382c079750 msgr2=0x7f382c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.660+0000 7f383351d640 1 -- 172.21.15.148:0/137558535 shutdown_connections 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.660+0000 7f383351d640 1 -- 172.21.15.148:0/137558535 wait complete. 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.661+0000 7f383351d640 1 Processor -- start 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.661+0000 7f383351d640 1 -- start start 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.661+0000 7f383351d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f382c102b40 0x7f382c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.661+0000 7f383351d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f382c108480 0x7f382c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.661+0000 7f383351d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f382c108dd0 0x7f382c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.661+0000 7f383351d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f382c1129a0 con 0x7f382c102b40 2024-09-21T01:12:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.661+0000 7f383351d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f382c112820 con 0x7f382c108dd0 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.661+0000 7f383351d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f382c112b20 con 0x7f382c108480 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38312b9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f382c102b40 0x7f382c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38312b9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f382c102b40 0x7f382c199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46912/0 (socket says 172.21.15.148:46912) 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38312b9640 1 -- 172.21.15.148:0/1343723098 learned_addr learned my addr 172.21.15.148:0/1343723098 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f3830ab8640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f382c108480 0x7f382c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f3831aba640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f382c108dd0 0x7f382c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38312b9640 1 -- 172.21.15.148:0/1343723098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f382c108480 msgr2=0x7f382c199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38312b9640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f382c108480 0x7f382c199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38312b9640 1 -- 172.21.15.148:0/1343723098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f382c108dd0 msgr2=0x7f382c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38312b9640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f382c108dd0 0x7f382c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38312b9640 1 -- 172.21.15.148:0/1343723098 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c19f2e0 con 0x7f382c102b40 2024-09-21T01:12:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f3831aba640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f382c108dd0 0x7f382c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38312b9640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f382c102b40 0x7f382c199370 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3828005940 tx=0x7f38280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38227fc640 1 -- 172.21.15.148:0/1343723098 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382803f030 con 0x7f382c102b40 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38227fc640 1 -- 172.21.15.148:0/1343723098 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3828003cb0 con 0x7f382c102b40 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382c19f570 con 0x7f382c102b40 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f38227fc640 1 -- 172.21.15.148:0/1343723098 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828035070 con 0x7f382c102b40 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.662+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382c1a5d30 con 0x7f382c102b40 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.663+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f382c063b50 con 0x7f382c102b40 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.665+0000 7f38227fc640 1 -- 172.21.15.148:0/1343723098 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f3828042030 con 0x7f382c102b40 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.665+0000 7f38227fc640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38180b6620 0x7f38180b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.666+0000 7f3830ab8640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38180b6620 0x7f38180b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.666+0000 7f38227fc640 1 -- 172.21.15.148:0/1343723098 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f3828107e00 con 0x7f382c102b40 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.666+0000 7f38227fc640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] conn(0x7f38180bfdb0 0x7f38180c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:50.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.666+0000 7f38227fc640 1 -- 172.21.15.148:0/1343723098 --> [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3828030e80 con 0x7f38180bfdb0 2024-09-21T01:12:50.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.666+0000 7f38227fc640 1 -- 172.21.15.148:0/1343723098 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f38281082e0 con 0x7f382c102b40 2024-09-21T01:12:50.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.666+0000 7f3830ab8640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38180b6620 0x7f38180b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f382c079de0 tx=0x7f381c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:50.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.666+0000 7f3831aba640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] conn(0x7f38180bfdb0 0x7f38180c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:50.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.666+0000 7f3831aba640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] conn(0x7f38180bfdb0 0x7f38180c2200 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:50.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.667+0000 7f38227fc640 1 -- 172.21.15.148:0/1343723098 <== osd.7 v2:172.21.15.157:6816/1505346368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3828030e80 con 0x7f38180bfdb0 2024-09-21T01:12:50.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.681+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 --> [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f382c063f50 con 0x7f38180bfdb0 2024-09-21T01:12:50.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.681+0000 7f38227fc640 1 -- 172.21.15.148:0/1343723098 <== osd.7 v2:172.21.15.157:6816/1505346368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f382c063f50 con 0x7f38180bfdb0 2024-09-21T01:12:50.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 >> [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] conn(0x7f38180bfdb0 msgr2=0x7f38180c2200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f383351d640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] conn(0x7f38180bfdb0 0x7f38180c2200 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38180b6620 msgr2=0x7f38180b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f383351d640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38180b6620 0x7f38180b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f382c079de0 tx=0x7f381c00b390 comp rx=0 tx=0).stop 2024-09-21T01:12:50.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f382c102b40 msgr2=0x7f382c199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:50.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f383351d640 1 --2- 172.21.15.148:0/1343723098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f382c102b40 0x7f382c199370 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3828005940 tx=0x7f38280042f0 comp rx=0 tx=0).stop 2024-09-21T01:12:50.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f3831aba640 1 -- 172.21.15.148:0/1343723098 reap_dead start 2024-09-21T01:12:50.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 shutdown_connections 2024-09-21T01:12:50.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 >> 172.21.15.148:0/1343723098 conn(0x7f382c079750 msgr2=0x7f382c1015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:50.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 shutdown_connections 2024-09-21T01:12:50.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:48.682+0000 7f383351d640 1 -- 172.21.15.148:0/1343723098 wait complete. 2024-09-21T01:12:51.802 INFO:teuthology.orchestra.run.smithi148.stdout:197568495655 2024-09-21T01:12:51.802 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T01:12:51.953 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:51 smithi148 ceph-mon[31000]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:12:51.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.952+0000 7fa681c93640 1 -- 172.21.15.148:0/4131106061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa67c1083a0 msgr2=0x7fa67c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.952+0000 7fa681c93640 1 --2- 172.21.15.148:0/4131106061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa67c1083a0 0x7fa67c1087b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa664009900 tx=0x7fa66402a410 comp rx=0 tx=0).stop 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.952+0000 7fa681c93640 1 -- 172.21.15.148:0/4131106061 shutdown_connections 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.952+0000 7fa681c93640 1 --2- 172.21.15.148:0/4131106061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa67c1083a0 0x7fa67c1087b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.952+0000 7fa681c93640 1 --2- 172.21.15.148:0/4131106061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa67c108cf0 0x7fa67c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.952+0000 7fa681c93640 1 --2- 172.21.15.148:0/4131106061 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c102a60 0x7fa67c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.952+0000 7fa681c93640 1 -- 172.21.15.148:0/4131106061 >> 172.21.15.148:0/4131106061 conn(0x7fa67c079730 msgr2=0x7fa67c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.952+0000 7fa681c93640 1 -- 172.21.15.148:0/4131106061 shutdown_connections 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.952+0000 7fa681c93640 1 -- 172.21.15.148:0/4131106061 wait complete. 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.953+0000 7fa681c93640 1 Processor -- start 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.953+0000 7fa681c93640 1 -- start start 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa681c93640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa67c102a60 0x7fa67c19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:51.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa681c93640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c1083a0 0x7fa67c19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa681c93640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa67c108cf0 0x7fa67c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa681c93640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c112960 con 0x7fa67c102a60 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa681c93640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c1127e0 con 0x7fa67c108cf0 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa681c93640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c112ae0 con 0x7fa67c1083a0 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa67c102a60 0x7fa67c19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa67c102a60 0x7fa67c19b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46982/0 (socket says 172.21.15.148:46982) 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67b7fe640 1 -- 172.21.15.148:0/4101006062 learned_addr learned my addr 172.21.15.148:0/4101006062 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa673fff640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c1083a0 0x7fa67c19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67bfff640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa67c108cf0 0x7fa67c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67b7fe640 1 -- 172.21.15.148:0/4101006062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c1083a0 msgr2=0x7fa67c19b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67b7fe640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c1083a0 0x7fa67c19b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67b7fe640 1 -- 172.21.15.148:0/4101006062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa67c108cf0 msgr2=0x7fa67c19bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67b7fe640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa67c108cf0 0x7fa67c19bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67b7fe640 1 -- 172.21.15.148:0/4101006062 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c1a6500 con 0x7fa67c102a60 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa673fff640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa67c1083a0 0x7fa67c19b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67bfff640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa67c108cf0 0x7fa67c19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.954+0000 7fa67b7fe640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa67c102a60 0x7fa67c19b270 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c970 tx=0x7fa66c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.955+0000 7fa6797fa640 1 -- 172.21.15.148:0/4101006062 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c007bb0 con 0x7fa67c102a60 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.955+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c1a67f0 con 0x7fa67c102a60 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.955+0000 7fa6797fa640 1 -- 172.21.15.148:0/4101006062 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa66c007d50 con 0x7fa67c102a60 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.955+0000 7fa6797fa640 1 -- 172.21.15.148:0/4101006062 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00f450 con 0x7fa67c102a60 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.955+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67c1a6d30 con 0x7fa67c102a60 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.955+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa67c063b10 con 0x7fa67c102a60 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.958+0000 7fa6797fa640 1 -- 172.21.15.148:0/4101006062 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fa66c004ee0 con 0x7fa67c102a60 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.959+0000 7fa6797fa640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa6680b65d0 0x7fa6680b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.959+0000 7fa673fff640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa6680b65d0 0x7fa6680b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.959+0000 7fa6797fa640 1 -- 172.21.15.148:0/4101006062 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fa66c0e7520 con 0x7fa67c102a60 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.959+0000 7fa6797fa640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] conn(0x7fa6680bfd60 0x7fa6680c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.959+0000 7fa6797fa640 1 -- 172.21.15.148:0/4101006062 --> [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa66c0047b0 con 0x7fa6680bfd60 2024-09-21T01:12:51.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.959+0000 7fa6797fa640 1 -- 172.21.15.148:0/4101006062 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fa66c0e7a00 con 0x7fa67c102a60 2024-09-21T01:12:51.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.960+0000 7fa67bfff640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] conn(0x7fa6680bfd60 0x7fa6680c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:51.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.960+0000 7fa673fff640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa6680b65d0 0x7fa6680b8ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa6640096c0 tx=0x7fa664031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:51.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.960+0000 7fa67bfff640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] conn(0x7fa6680bfd60 0x7fa6680c21b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:51.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.961+0000 7fa6797fa640 1 -- 172.21.15.148:0/4101006062 <== osd.11 v2:172.21.15.181:6824/2872762977 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa66c0047b0 con 0x7fa6680bfd60 2024-09-21T01:12:51.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.976+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 --> [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa67c063f90 con 0x7fa6680bfd60 2024-09-21T01:12:51.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.976+0000 7fa6797fa640 1 -- 172.21.15.148:0/4101006062 <== osd.11 v2:172.21.15.181:6824/2872762977 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa67c063f90 con 0x7fa6680bfd60 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 >> [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] conn(0x7fa6680bfd60 msgr2=0x7fa6680c21b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa681c93640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] conn(0x7fa6680bfd60 0x7fa6680c21b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa6680b65d0 msgr2=0x7fa6680b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa681c93640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa6680b65d0 0x7fa6680b8ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa6640096c0 tx=0x7fa664031400 comp rx=0 tx=0).stop 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa67c102a60 msgr2=0x7fa67c19b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa681c93640 1 --2- 172.21.15.148:0/4101006062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa67c102a60 0x7fa67c19b270 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c970 tx=0x7fa66c00ce30 comp rx=0 tx=0).stop 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa67bfff640 1 -- 172.21.15.148:0/4101006062 reap_dead start 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 shutdown_connections 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 >> 172.21.15.148:0/4101006062 conn(0x7fa67c079730 msgr2=0x7fa67c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 shutdown_connections 2024-09-21T01:12:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:51.977+0000 7fa681c93640 1 -- 172.21.15.148:0/4101006062 wait complete. 2024-09-21T01:12:51.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:51 smithi181 ceph-mon[34811]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:12:51.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:51 smithi157 ceph-mon[34140]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:12:52.692 INFO:teuthology.orchestra.run.smithi148.stdout:292057776149 2024-09-21T01:12:52.692 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T01:12:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.593+0000 7f6cf4f98640 1 -- 172.21.15.148:0/2855479105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cf0108480 msgr2=0x7f6cf010ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.593+0000 7f6cf4f98640 1 --2- 172.21.15.148:0/2855479105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cf0108480 0x7f6cf010ecb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009ca0 tx=0x7f6ce802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:12:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.593+0000 7f6cf4f98640 1 -- 172.21.15.148:0/2855479105 shutdown_connections 2024-09-21T01:12:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.593+0000 7f6cf4f98640 1 --2- 172.21.15.148:0/2855479105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cf0108480 0x7f6cf010ecb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.593+0000 7f6cf4f98640 1 --2- 172.21.15.148:0/2855479105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cf0107b30 0x7f6cf0107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.593+0000 7f6cf4f98640 1 --2- 172.21.15.148:0/2855479105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cf01021f0 0x7f6cf0102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.593+0000 7f6cf4f98640 1 -- 172.21.15.148:0/2855479105 >> 172.21.15.148:0/2855479105 conn(0x7f6cf0077c60 msgr2=0x7f6cf00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.593+0000 7f6cf4f98640 1 -- 172.21.15.148:0/2855479105 shutdown_connections 2024-09-21T01:12:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.593+0000 7f6cf4f98640 1 -- 172.21.15.148:0/2855479105 wait complete. 2024-09-21T01:12:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cf4f98640 1 Processor -- start 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cf4f98640 1 -- start start 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cf4f98640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cf01021f0 0x7f6cf01993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cf4f98640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cf0107b30 0x7f6cf0199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cf4f98640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cf0108480 0x7f6cf019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cf4f98640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf0112150 con 0x7f6cf01021f0 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cf4f98640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf0111fd0 con 0x7f6cf0108480 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cf4f98640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf01122d0 con 0x7f6cf0107b30 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cee59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cf01021f0 0x7f6cf01993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cee59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cf01021f0 0x7f6cf01993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46964/0 (socket says 172.21.15.148:46964) 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.594+0000 7f6cee59c640 1 -- 172.21.15.148:0/3566372850 learned_addr learned my addr 172.21.15.148:0/3566372850 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cedd9b640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cf0107b30 0x7f6cf0199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6ceed9d640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cf0108480 0x7f6cf019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cee59c640 1 -- 172.21.15.148:0/3566372850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cf0107b30 msgr2=0x7f6cf0199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cee59c640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cf0107b30 0x7f6cf0199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cee59c640 1 -- 172.21.15.148:0/3566372850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cf0108480 msgr2=0x7f6cf019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cee59c640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cf0108480 0x7f6cf019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cee59c640 1 -- 172.21.15.148:0/3566372850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf019f330 con 0x7f6cf01021f0 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cee59c640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cf01021f0 0x7f6cf01993c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000d950 tx=0x7f6ce000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cdf7fe640 1 -- 172.21.15.148:0/3566372850 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0017070 con 0x7f6cf01021f0 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cdf7fe640 1 -- 172.21.15.148:0/3566372850 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ce0009c30 con 0x7f6cf01021f0 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf019f620 con 0x7f6cf01021f0 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.595+0000 7f6cdf7fe640 1 -- 172.21.15.148:0/3566372850 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce000f620 con 0x7f6cf01021f0 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.596+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf01a5d80 con 0x7f6cf01021f0 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.597+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6cf0106d20 con 0x7f6cf01021f0 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.599+0000 7f6cdf7fe640 1 -- 172.21.15.148:0/3566372850 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f6ce0010460 con 0x7f6cf01021f0 2024-09-21T01:12:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.600+0000 7f6cdf7fe640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cd80b65a0 0x7f6cd80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.600+0000 7f6cedd9b640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cd80b65a0 0x7f6cd80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.600+0000 7f6cdf7fe640 1 -- 172.21.15.148:0/3566372850 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f6ce00e72b0 con 0x7f6cf01021f0 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.600+0000 7f6cdf7fe640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] conn(0x7f6cd80bfd30 0x7f6cd80c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.600+0000 7f6cdf7fe640 1 -- 172.21.15.148:0/3566372850 --> [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ce0024ea0 con 0x7f6cd80bfd30 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.600+0000 7f6cdf7fe640 1 -- 172.21.15.148:0/3566372850 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f6ce00e7790 con 0x7f6cf01021f0 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.600+0000 7f6cedd9b640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cd80b65a0 0x7f6cd80b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0104170 tx=0x7f6ce400a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.600+0000 7f6ceed9d640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] conn(0x7f6cd80bfd30 0x7f6cd80c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.601+0000 7f6ceed9d640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] conn(0x7f6cd80bfd30 0x7f6cd80c2180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.601+0000 7f6cdf7fe640 1 -- 172.21.15.148:0/3566372850 <== osd.1 v2:172.21.15.157:6800/2914779788 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ce0024ea0 con 0x7f6cd80bfd30 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.615+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 --> [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6cf0103470 con 0x7f6cd80bfd30 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.615+0000 7f6cdf7fe640 1 -- 172.21.15.148:0/3566372850 <== osd.1 v2:172.21.15.157:6800/2914779788 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6cf0103470 con 0x7f6cd80bfd30 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.615+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 >> [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] conn(0x7f6cd80bfd30 msgr2=0x7f6cd80c2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.615+0000 7f6cf4f98640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] conn(0x7f6cd80bfd30 0x7f6cd80c2180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.615+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cd80b65a0 msgr2=0x7f6cd80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:52.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.615+0000 7f6cf4f98640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f6cd80b65a0 0x7f6cd80b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0104170 tx=0x7f6ce400a250 comp rx=0 tx=0).stop 2024-09-21T01:12:52.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.615+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cf01021f0 msgr2=0x7f6cf01993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:52.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.615+0000 7f6cf4f98640 1 --2- 172.21.15.148:0/3566372850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cf01021f0 0x7f6cf01993c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000d950 tx=0x7f6ce000de10 comp rx=0 tx=0).stop 2024-09-21T01:12:52.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.615+0000 7f6ceed9d640 1 -- 172.21.15.148:0/3566372850 reap_dead start 2024-09-21T01:12:52.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.616+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 shutdown_connections 2024-09-21T01:12:52.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.616+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 >> 172.21.15.148:0/3566372850 conn(0x7f6cf0077c60 msgr2=0x7f6cf0106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:52.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.616+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 shutdown_connections 2024-09-21T01:12:52.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:50.616+0000 7f6cf4f98640 1 -- 172.21.15.148:0/3566372850 wait complete. 2024-09-21T01:12:53.455 INFO:teuthology.orchestra.run.smithi148.stdout:55834574917 2024-09-21T01:12:53.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T01:12:53.680 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:53 smithi148 ceph-mon[31000]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T01:12:53.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:53 smithi181 ceph-mon[34811]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T01:12:53.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:53 smithi157 ceph-mon[34140]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T01:12:54.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.077+0000 7f2ff9c53640 1 -- 172.21.15.148:0/1429103881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ff4104880 msgr2=0x7f2ff4104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.077+0000 7f2ff9c53640 1 --2- 172.21.15.148:0/1429103881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ff4104880 0x7f2ff4104c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009900 tx=0x7f2fe402a410 comp rx=0 tx=0).stop 2024-09-21T01:12:54.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.078+0000 7f2ff9c53640 1 -- 172.21.15.148:0/1429103881 shutdown_connections 2024-09-21T01:12:54.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.078+0000 7f2ff9c53640 1 --2- 172.21.15.148:0/1429103881 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff410de30 0x7f2ff4110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.078+0000 7f2ff9c53640 1 --2- 172.21.15.148:0/1429103881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ff41052b0 0x7f2ff410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.078+0000 7f2ff9c53640 1 --2- 172.21.15.148:0/1429103881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ff4104880 0x7f2ff4104c90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.078+0000 7f2ff9c53640 1 -- 172.21.15.148:0/1429103881 >> 172.21.15.148:0/1429103881 conn(0x7f2ff4079740 msgr2=0x7f2ff4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:54.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.078+0000 7f2ff9c53640 1 -- 172.21.15.148:0/1429103881 shutdown_connections 2024-09-21T01:12:54.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.078+0000 7f2ff9c53640 1 -- 172.21.15.148:0/1429103881 wait complete. 2024-09-21T01:12:54.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff9c53640 1 Processor -- start 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff9c53640 1 -- start start 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff9c53640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff4104880 0x7f2ff419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff9c53640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ff41052b0 0x7f2ff419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff9c53640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ff410de30 0x7f2ff419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff9c53640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff4113aa0 con 0x7f2ff410de30 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff9c53640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff4113920 con 0x7f2ff41052b0 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff9c53640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff4113c20 con 0x7f2ff4104880 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ff410de30 0x7f2ff419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ff410de30 0x7f2ff419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47002/0 (socket says 172.21.15.148:47002) 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff3fff640 1 -- 172.21.15.148:0/4074043216 learned_addr learned my addr 172.21.15.148:0/4074043216 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.079+0000 7f2ff37fe640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff4104880 0x7f2ff419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff2ffd640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ff41052b0 0x7f2ff419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff3fff640 1 -- 172.21.15.148:0/4074043216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff4104880 msgr2=0x7f2ff419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff3fff640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff4104880 0x7f2ff419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff3fff640 1 -- 172.21.15.148:0/4074043216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ff41052b0 msgr2=0x7f2ff419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff3fff640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ff41052b0 0x7f2ff419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff3fff640 1 -- 172.21.15.148:0/4074043216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff41a0460 con 0x7f2ff410de30 2024-09-21T01:12:54.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff3fff640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ff410de30 0x7f2ff419fd30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00eaa0 tx=0x7f2fec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff0ff9640 1 -- 172.21.15.148:0/4074043216 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec00cdb0 con 0x7f2ff410de30 2024-09-21T01:12:54.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff41a0750 con 0x7f2ff410de30 2024-09-21T01:12:54.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff0ff9640 1 -- 172.21.15.148:0/4074043216 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fec005020 con 0x7f2ff410de30 2024-09-21T01:12:54.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff0ff9640 1 -- 172.21.15.148:0/4074043216 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0116d0 con 0x7f2ff410de30 2024-09-21T01:12:54.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.080+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff4102670 con 0x7f2ff410de30 2024-09-21T01:12:54.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.081+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ff4063b10 con 0x7f2ff410de30 2024-09-21T01:12:54.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.083+0000 7f2ff0ff9640 1 -- 172.21.15.148:0/4074043216 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f2fec0054a0 con 0x7f2ff410de30 2024-09-21T01:12:54.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.084+0000 7f2ff0ff9640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2fdc0b6620 0x7f2fdc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.084+0000 7f2ff37fe640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2fdc0b6620 0x7f2fdc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.084+0000 7f2ff0ff9640 1 -- 172.21.15.148:0/4074043216 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f2fec0e7a10 con 0x7f2ff410de30 2024-09-21T01:12:54.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.085+0000 7f2ff0ff9640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] conn(0x7f2fdc0bfdb0 0x7f2fdc0c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.085+0000 7f2ff0ff9640 1 -- 172.21.15.148:0/4074043216 --> [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fec014ec0 con 0x7f2fdc0bfdb0 2024-09-21T01:12:54.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.085+0000 7f2ff0ff9640 1 -- 172.21.15.148:0/4074043216 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f2fec0e7e00 con 0x7f2ff410de30 2024-09-21T01:12:54.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.085+0000 7f2ff37fe640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2fdc0b6620 0x7f2fdc0b8b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4031440 tx=0x7f2fe403c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.085+0000 7f2ff2ffd640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] conn(0x7f2fdc0bfdb0 0x7f2fdc0c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.086+0000 7f2ff2ffd640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] conn(0x7f2fdc0bfdb0 0x7f2fdc0c2200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.086+0000 7f2ff0ff9640 1 -- 172.21.15.148:0/4074043216 <== osd.4 v2:172.21.15.157:6808/3232117147 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2fec014ec0 con 0x7f2fdc0bfdb0 2024-09-21T01:12:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.105+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 --> [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ff4063f10 con 0x7f2fdc0bfdb0 2024-09-21T01:12:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.105+0000 7f2ff0ff9640 1 -- 172.21.15.148:0/4074043216 <== osd.4 v2:172.21.15.157:6808/3232117147 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2ff4063f10 con 0x7f2fdc0bfdb0 2024-09-21T01:12:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 >> [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] conn(0x7f2fdc0bfdb0 msgr2=0x7f2fdc0c2200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff9c53640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] conn(0x7f2fdc0bfdb0 0x7f2fdc0c2200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2fdc0b6620 msgr2=0x7f2fdc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff9c53640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2fdc0b6620 0x7f2fdc0b8b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4031440 tx=0x7f2fe403c040 comp rx=0 tx=0).stop 2024-09-21T01:12:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ff410de30 msgr2=0x7f2ff419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff9c53640 1 --2- 172.21.15.148:0/4074043216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ff410de30 0x7f2ff419fd30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00eaa0 tx=0x7f2fec00ef60 comp rx=0 tx=0).stop 2024-09-21T01:12:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff3fff640 1 -- 172.21.15.148:0/4074043216 reap_dead start 2024-09-21T01:12:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 shutdown_connections 2024-09-21T01:12:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 >> 172.21.15.148:0/4074043216 conn(0x7f2ff4079740 msgr2=0x7f2ff4100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 shutdown_connections 2024-09-21T01:12:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.106+0000 7f2ff9c53640 1 -- 172.21.15.148:0/4074043216 wait complete. 2024-09-21T01:12:54.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.283+0000 7f1ab827c640 1 -- 172.21.15.148:0/4026173313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ab0102a60 msgr2=0x7f1ab0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.283+0000 7f1ab827c640 1 --2- 172.21.15.148:0/4026173313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ab0102a60 0x7f1ab0102e70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009900 tx=0x7f1aac02a410 comp rx=0 tx=0).stop 2024-09-21T01:12:54.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.283+0000 7f1ab827c640 1 -- 172.21.15.148:0/4026173313 shutdown_connections 2024-09-21T01:12:54.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.283+0000 7f1ab827c640 1 --2- 172.21.15.148:0/4026173313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ab0108cf0 0x7f1ab010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.283+0000 7f1ab827c640 1 --2- 172.21.15.148:0/4026173313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab01083a0 0x7f1ab01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.283+0000 7f1ab827c640 1 --2- 172.21.15.148:0/4026173313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ab0102a60 0x7f1ab0102e70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.283+0000 7f1ab827c640 1 -- 172.21.15.148:0/4026173313 >> 172.21.15.148:0/4026173313 conn(0x7f1ab0079730 msgr2=0x7f1ab0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:54.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.284+0000 7f1ab827c640 1 -- 172.21.15.148:0/4026173313 shutdown_connections 2024-09-21T01:12:54.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.284+0000 7f1ab827c640 1 -- 172.21.15.148:0/4026173313 wait complete. 2024-09-21T01:12:54.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.284+0000 7f1ab827c640 1 Processor -- start 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab827c640 1 -- start start 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab827c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ab0102a60 0x7f1ab019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab827c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab01083a0 0x7f1ab019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab827c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ab0108cf0 0x7f1ab019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab827c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab0112960 con 0x7f1ab0102a60 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab827c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab01127e0 con 0x7f1ab01083a0 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab827c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab0112ae0 con 0x7f1ab0108cf0 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab6018640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ab0102a60 0x7f1ab019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab6018640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ab0102a60 0x7f1ab019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47026/0 (socket says 172.21.15.148:47026) 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab6018640 1 -- 172.21.15.148:0/676769801 learned_addr learned my addr 172.21.15.148:0/676769801 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab5817640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab01083a0 0x7f1ab019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.285+0000 7f1ab6819640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ab0108cf0 0x7f1ab019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1ab6018640 1 -- 172.21.15.148:0/676769801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ab0108cf0 msgr2=0x7f1ab019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1ab6018640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ab0108cf0 0x7f1ab019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1ab6018640 1 -- 172.21.15.148:0/676769801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab01083a0 msgr2=0x7f1ab019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1ab6018640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ab01083a0 0x7f1ab019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1ab6018640 1 -- 172.21.15.148:0/676769801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab01a0370 con 0x7f1ab0102a60 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1ab6819640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ab0108cf0 0x7f1ab019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1ab6018640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ab0102a60 0x7f1ab019a4c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1aac005940 tx=0x7f1aac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1aa77fe640 1 -- 172.21.15.148:0/676769801 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac03f030 con 0x7f1ab0102a60 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab01a0600 con 0x7f1ab0102a60 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1aa77fe640 1 -- 172.21.15.148:0/676769801 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aac003cb0 con 0x7f1ab0102a60 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1aa77fe640 1 -- 172.21.15.148:0/676769801 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac035070 con 0x7f1ab0102a60 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.286+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab01a0b30 con 0x7f1ab0102a60 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.287+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ab0101a30 con 0x7f1ab0102a60 2024-09-21T01:12:54.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.289+0000 7f1aa77fe640 1 -- 172.21.15.148:0/676769801 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f1aac042030 con 0x7f1ab0102a60 2024-09-21T01:12:54.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.290+0000 7f1aa77fe640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1a9c0b65d0 0x7f1a9c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.290+0000 7f1ab5817640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1a9c0b65d0 0x7f1a9c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.290+0000 7f1aa77fe640 1 -- 172.21.15.148:0/676769801 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f1aac107ee0 con 0x7f1ab0102a60 2024-09-21T01:12:54.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.290+0000 7f1aa77fe640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] conn(0x7f1a9c0bfd60 0x7f1a9c0c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.290+0000 7f1aa77fe640 1 -- 172.21.15.148:0/676769801 --> [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a9c0c2880 con 0x7f1a9c0bfd60 2024-09-21T01:12:54.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.290+0000 7f1aa77fe640 1 -- 172.21.15.148:0/676769801 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f1aac1083c0 con 0x7f1ab0102a60 2024-09-21T01:12:54.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.290+0000 7f1ab6819640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] conn(0x7f1a9c0bfd60 0x7f1a9c0c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.290+0000 7f1ab5817640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1a9c0b65d0 0x7f1a9c0b8ae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0100b70 tx=0x7f1aa000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.290+0000 7f1ab6819640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] conn(0x7f1a9c0bfd60 0x7f1a9c0c21b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.292+0000 7f1aa77fe640 1 -- 172.21.15.148:0/676769801 <== osd.9 v2:172.21.15.148:6826/1373400085 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a9c0c2880 con 0x7f1a9c0bfd60 2024-09-21T01:12:54.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.306+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 --> [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ab0103ce0 con 0x7f1a9c0bfd60 2024-09-21T01:12:54.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1aa77fe640 1 -- 172.21.15.148:0/676769801 <== osd.9 v2:172.21.15.148:6826/1373400085 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1ab0103ce0 con 0x7f1a9c0bfd60 2024-09-21T01:12:54.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] conn(0x7f1a9c0bfd60 msgr2=0x7f1a9c0c21b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab827c640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] conn(0x7f1a9c0bfd60 0x7f1a9c0c21b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1a9c0b65d0 msgr2=0x7f1a9c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab827c640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1a9c0b65d0 0x7f1a9c0b8ae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0100b70 tx=0x7f1aa000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ab0102a60 msgr2=0x7f1ab019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab827c640 1 --2- 172.21.15.148:0/676769801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ab0102a60 0x7f1ab019a4c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1aac005940 tx=0x7f1aac0042f0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab6819640 1 -- 172.21.15.148:0/676769801 reap_dead start 2024-09-21T01:12:54.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 shutdown_connections 2024-09-21T01:12:54.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 >> 172.21.15.148:0/676769801 conn(0x7f1ab0079730 msgr2=0x7f1ab01066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:54.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 shutdown_connections 2024-09-21T01:12:54.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.307+0000 7f1ab827c640 1 -- 172.21.15.148:0/676769801 wait complete. 2024-09-21T01:12:54.939 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T01:12:54.939 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T01:12:54.939 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2024-09-21T01:12:54.939 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2024-09-21T01:12:54.939 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 7]} : dispatch 2024-09-21T01:12:54.939 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-09-21T01:12:54.940 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]} : dispatch 2024-09-21T01:12:54.940 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:54 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]} : dispatch 2024-09-21T01:12:54.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.956+0000 7fa72f3da640 1 -- 172.21.15.148:0/1946917930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa728108d20 msgr2=0x7fa72810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.956+0000 7fa72f3da640 1 --2- 172.21.15.148:0/1946917930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa728108d20 0x7fa72810f550 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa720009ca0 tx=0x7fa72002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.956+0000 7fa72f3da640 1 -- 172.21.15.148:0/1946917930 shutdown_connections 2024-09-21T01:12:54.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.956+0000 7fa72f3da640 1 --2- 172.21.15.148:0/1946917930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa728108d20 0x7fa72810f550 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.956+0000 7fa72f3da640 1 --2- 172.21.15.148:0/1946917930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7281083d0 0x7fa7281087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.956+0000 7fa72f3da640 1 --2- 172.21.15.148:0/1946917930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa728102a90 0x7fa728102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.956+0000 7fa72f3da640 1 -- 172.21.15.148:0/1946917930 >> 172.21.15.148:0/1946917930 conn(0x7fa728079750 msgr2=0x7fa728079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:54.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.957+0000 7fa72f3da640 1 -- 172.21.15.148:0/1946917930 shutdown_connections 2024-09-21T01:12:54.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.957+0000 7fa72f3da640 1 -- 172.21.15.148:0/1946917930 wait complete. 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.957+0000 7fa72f3da640 1 Processor -- start 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.957+0000 7fa72f3da640 1 -- start start 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72f3da640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa728102a90 0x7fa728199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72f3da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7281083d0 0x7fa728199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72f3da640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa728108d20 0x7fa72819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72f3da640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa728112a70 con 0x7fa7281083d0 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72f3da640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa7281128f0 con 0x7fa728108d20 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72f3da640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa728112bf0 con 0x7fa728102a90 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72c975640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7281083d0 0x7fa728199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72c975640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7281083d0 0x7fa728199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47042/0 (socket says 172.21.15.148:47042) 2024-09-21T01:12:54.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72c975640 1 -- 172.21.15.148:0/936340124 learned_addr learned my addr 172.21.15.148:0/936340124 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72d977640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa728108d20 0x7fa72819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72d176640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa728102a90 0x7fa728199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72c975640 1 -- 172.21.15.148:0/936340124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa728102a90 msgr2=0x7fa728199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72c975640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa728102a90 0x7fa728199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72c975640 1 -- 172.21.15.148:0/936340124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa728108d20 msgr2=0x7fa72819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72c975640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa728108d20 0x7fa72819eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72c975640 1 -- 172.21.15.148:0/936340124 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72819f3d0 con 0x7fa7281083d0 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.958+0000 7fa72c975640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7281083d0 0x7fa728199a00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa71800b450 tx=0x7fa71800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.959+0000 7fa71e7fc640 1 -- 172.21.15.148:0/936340124 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa718015020 con 0x7fa7281083d0 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.959+0000 7fa71e7fc640 1 -- 172.21.15.148:0/936340124 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa718011ce0 con 0x7fa7281083d0 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.959+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa72819f6c0 con 0x7fa7281083d0 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.959+0000 7fa71e7fc640 1 -- 172.21.15.148:0/936340124 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa718010dc0 con 0x7fa7281083d0 2024-09-21T01:12:54.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.959+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7281a5e20 con 0x7fa7281083d0 2024-09-21T01:12:54.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.960+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa728063ad0 con 0x7fa7281083d0 2024-09-21T01:12:54.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.962+0000 7fa71e7fc640 1 -- 172.21.15.148:0/936340124 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fa718018020 con 0x7fa7281083d0 2024-09-21T01:12:54.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.963+0000 7fa71e7fc640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7140b65a0 0x7fa7140b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.963+0000 7fa72d176640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7140b65a0 0x7fa7140b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.963+0000 7fa71e7fc640 1 -- 172.21.15.148:0/936340124 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8219+0+0 (secure 0 0 0) 0x7fa7180e7230 con 0x7fa7281083d0 2024-09-21T01:12:54.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.963+0000 7fa71e7fc640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] conn(0x7fa7140c0090 0x7fa7140c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.963+0000 7fa71e7fc640 1 -- 172.21.15.148:0/936340124 --> [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa71801ee70 con 0x7fa7140c0090 2024-09-21T01:12:54.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.963+0000 7fa71e7fc640 1 -- 172.21.15.148:0/936340124 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa7180e7680 con 0x7fa7281083d0 2024-09-21T01:12:54.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.963+0000 7fa72d977640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] conn(0x7fa7140c0090 0x7fa7140c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.964+0000 7fa72d176640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7140b65a0 0x7fa7140b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa724009990 tx=0x7fa724009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.964+0000 7fa72d977640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] conn(0x7fa7140c0090 0x7fa7140c2580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.964+0000 7fa71e7fc640 1 -- 172.21.15.148:0/936340124 <== osd.6 v2:172.21.15.148:6818/2007504486 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa71801ee70 con 0x7fa7140c0090 2024-09-21T01:12:54.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.978+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 --> [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa728063ed0 con 0x7fa7140c0090 2024-09-21T01:12:54.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.978+0000 7fa71e7fc640 1 -- 172.21.15.148:0/936340124 <== osd.6 v2:172.21.15.148:6818/2007504486 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa728063ed0 con 0x7fa7140c0090 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] conn(0x7fa7140c0090 msgr2=0x7fa7140c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72f3da640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] conn(0x7fa7140c0090 0x7fa7140c2580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7140b65a0 msgr2=0x7fa7140b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72f3da640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa7140b65a0 0x7fa7140b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa724009990 tx=0x7fa724009110 comp rx=0 tx=0).stop 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7281083d0 msgr2=0x7fa728199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72f3da640 1 --2- 172.21.15.148:0/936340124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7281083d0 0x7fa728199a00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa71800b450 tx=0x7fa71800b850 comp rx=0 tx=0).stop 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72d977640 1 -- 172.21.15.148:0/936340124 reap_dead start 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 shutdown_connections 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 >> 172.21.15.148:0/936340124 conn(0x7fa728079750 msgr2=0x7fa7281052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 shutdown_connections 2024-09-21T01:12:54.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:54.979+0000 7fa72f3da640 1 -- 172.21.15.148:0/936340124 wait complete. 2024-09-21T01:12:54.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T01:12:54.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T01:12:54.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2024-09-21T01:12:54.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2024-09-21T01:12:54.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 7]} : dispatch 2024-09-21T01:12:54.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-09-21T01:12:54.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]} : dispatch 2024-09-21T01:12:54.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:54 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]} : dispatch 2024-09-21T01:12:54.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T01:12:54.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T01:12:54.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2024-09-21T01:12:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2024-09-21T01:12:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 7]} : dispatch 2024-09-21T01:12:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-09-21T01:12:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]} : dispatch 2024-09-21T01:12:54.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:54 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]} : dispatch 2024-09-21T01:12:55.657 INFO:teuthology.orchestra.run.smithi148.stdout:249108103199 2024-09-21T01:12:55.657 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T01:12:55.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:55 smithi181 ceph-mon[34811]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-21T01:12:55.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T01:12:55.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T01:12:55.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-09-21T01:12:55.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-21T01:12:55.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 7]}]': finished 2024-09-21T01:12:55.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-21T01:12:55.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-21T01:12:55.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:55 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-09-21T01:12:55.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:55 smithi181 ceph-mon[34811]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T01:12:55.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:55 smithi157 ceph-mon[34140]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-21T01:12:55.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T01:12:55.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T01:12:55.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-09-21T01:12:55.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-21T01:12:55.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 7]}]': finished 2024-09-21T01:12:55.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-21T01:12:55.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-21T01:12:55.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:55 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-09-21T01:12:55.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:55 smithi157 ceph-mon[34140]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T01:12:56.019 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:55 smithi148 ceph-mon[31000]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-21T01:12:56.020 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T01:12:56.020 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T01:12:56.020 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-09-21T01:12:56.020 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-21T01:12:56.020 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9, 4, 7]}]': finished 2024-09-21T01:12:56.020 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-21T01:12:56.021 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-21T01:12:56.021 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:55 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-09-21T01:12:56.021 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:55 smithi148 ceph-mon[31000]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T01:12:56.054 INFO:teuthology.orchestra.run.smithi148.stdout:270582939673 2024-09-21T01:12:56.054 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T01:12:56.082 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:56.537 INFO:teuthology.orchestra.run.smithi148.stdout:111669149754 2024-09-21T01:12:56.537 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T01:12:56.715 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:56.815 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:56 smithi148 ceph-mon[31000]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:12:56.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:56 smithi181 ceph-mon[34811]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:12:56.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:56 smithi157 ceph-mon[34140]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:12:57.160 INFO:teuthology.orchestra.run.smithi148.stdout:180388626478 2024-09-21T01:12:57.160 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T01:12:57.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.651+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/2639888473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a581094a0 msgr2=0x7f0a581098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.651+0000 7f0a5e2c7640 1 --2- 172.21.15.148:0/2639888473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a581094a0 0x7f0a581098b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009900 tx=0x7f0a4002a410 comp rx=0 tx=0).stop 2024-09-21T01:12:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.651+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/2639888473 shutdown_connections 2024-09-21T01:12:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.651+0000 7f0a5e2c7640 1 --2- 172.21.15.148:0/2639888473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a581094a0 0x7f0a581098b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.651+0000 7f0a5e2c7640 1 --2- 172.21.15.148:0/2639888473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a58109df0 0x7f0a58110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.651+0000 7f0a5e2c7640 1 --2- 172.21.15.148:0/2639888473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a58103b60 0x7f0a58103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.651+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/2639888473 >> 172.21.15.148:0/2639888473 conn(0x7f0a5807b850 msgr2=0x7f0a5807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.651+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/2639888473 shutdown_connections 2024-09-21T01:12:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.651+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/2639888473 wait complete. 2024-09-21T01:12:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5e2c7640 1 Processor -- start 2024-09-21T01:12:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5e2c7640 1 -- start start 2024-09-21T01:12:57.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5e2c7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a58103b60 0x7f0a5819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:57.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5e2c7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a581094a0 0x7f0a5819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:57.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5e2c7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58109df0 0x7f0a5819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:57.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5e2c7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58113ad0 con 0x7f0a58109df0 2024-09-21T01:12:57.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5e2c7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58113950 con 0x7f0a581094a0 2024-09-21T01:12:57.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5e2c7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58113c50 con 0x7f0a58103b60 2024-09-21T01:12:57.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5c864640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58109df0 0x7f0a5819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:57.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5c864640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58109df0 0x7f0a5819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52984/0 (socket says 172.21.15.148:52984) 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.652+0000 7f0a5c864640 1 -- 172.21.15.148:0/1859805549 learned_addr learned my addr 172.21.15.148:0/1859805549 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a57fff640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a58103b60 0x7f0a5819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a577fe640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a581094a0 0x7f0a5819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a5c864640 1 -- 172.21.15.148:0/1859805549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a58103b60 msgr2=0x7f0a5819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a5c864640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a58103b60 0x7f0a5819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a5c864640 1 -- 172.21.15.148:0/1859805549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a581094a0 msgr2=0x7f0a5819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a5c864640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a581094a0 0x7f0a5819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a5c864640 1 -- 172.21.15.148:0/1859805549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a581a04d0 con 0x7f0a58109df0 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a5c864640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58109df0 0x7f0a5819fda0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000eaa0 tx=0x7f0a5000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a557fa640 1 -- 172.21.15.148:0/1859805549 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000cdb0 con 0x7f0a58109df0 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a557fa640 1 -- 172.21.15.148:0/1859805549 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a50005020 con 0x7f0a58109df0 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a581a07c0 con 0x7f0a58109df0 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a557fa640 1 -- 172.21.15.148:0/1859805549 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a500116d0 con 0x7f0a58109df0 2024-09-21T01:12:57.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.653+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a581a6f20 con 0x7f0a58109df0 2024-09-21T01:12:57.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.654+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a58063b50 con 0x7f0a58109df0 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.656+0000 7f0a557fa640 1 -- 172.21.15.148:0/1859805549 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f0a500051d0 con 0x7f0a58109df0 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.657+0000 7f0a557fa640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0a440b65a0 0x7f0a440b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.657+0000 7f0a57fff640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0a440b65a0 0x7f0a440b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.657+0000 7f0a557fa640 1 -- 172.21.15.148:0/1859805549 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f0a500e7b40 con 0x7f0a58109df0 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.657+0000 7f0a557fa640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] conn(0x7f0a440c0090 0x7f0a440c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.657+0000 7f0a557fa640 1 -- 172.21.15.148:0/1859805549 --> [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a5001be50 con 0x7f0a440c0090 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.657+0000 7f0a557fa640 1 -- 172.21.15.148:0/1859805549 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f0a500e7f90 con 0x7f0a58109df0 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.657+0000 7f0a57fff640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0a440b65a0 0x7f0a440b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009890 tx=0x7f0a48008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.657+0000 7f0a577fe640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] conn(0x7f0a440c0090 0x7f0a440c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.658+0000 7f0a577fe640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] conn(0x7f0a440c0090 0x7f0a440c2580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:57.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.659+0000 7f0a557fa640 1 -- 172.21.15.148:0/1859805549 <== osd.8 v2:172.21.15.181:6816/1103366396 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a5001be50 con 0x7f0a440c0090 2024-09-21T01:12:57.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.672+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 --> [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0a58063fd0 con 0x7f0a440c0090 2024-09-21T01:12:57.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.672+0000 7f0a557fa640 1 -- 172.21.15.148:0/1859805549 <== osd.8 v2:172.21.15.181:6816/1103366396 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0a58063fd0 con 0x7f0a440c0090 2024-09-21T01:12:57.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 >> [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] conn(0x7f0a440c0090 msgr2=0x7f0a440c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5e2c7640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] conn(0x7f0a440c0090 0x7f0a440c2580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0a440b65a0 msgr2=0x7f0a440b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5e2c7640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0a440b65a0 0x7f0a440b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009890 tx=0x7f0a48008040 comp rx=0 tx=0).stop 2024-09-21T01:12:57.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58109df0 msgr2=0x7f0a5819fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5e2c7640 1 --2- 172.21.15.148:0/1859805549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58109df0 0x7f0a5819fda0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000eaa0 tx=0x7f0a5000ef60 comp rx=0 tx=0).stop 2024-09-21T01:12:57.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5c864640 1 -- 172.21.15.148:0/1859805549 reap_dead start 2024-09-21T01:12:57.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 shutdown_connections 2024-09-21T01:12:57.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 >> 172.21.15.148:0/1859805549 conn(0x7f0a5807b850 msgr2=0x7f0a581075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:57.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 shutdown_connections 2024-09-21T01:12:57.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:57.673+0000 7f0a5e2c7640 1 -- 172.21.15.148:0/1859805549 wait complete. 2024-09-21T01:12:57.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:57 smithi181 ceph-mon[34811]: pgmap v307: 97 pgs: 4 peering, 93 active+clean; 646 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-21T01:12:57.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:57 smithi157 ceph-mon[34140]: pgmap v307: 97 pgs: 4 peering, 93 active+clean; 646 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-21T01:12:58.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:57 smithi148 ceph-mon[31000]: pgmap v307: 97 pgs: 4 peering, 93 active+clean; 646 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-21T01:12:58.401 INFO:teuthology.orchestra.run.smithi148.stdout:223338299429 2024-09-21T01:12:58.401 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T01:12:58.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.885+0000 7f4841425640 1 -- 172.21.15.148:0/1109596505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f483c108420 msgr2=0x7f483c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:58.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.885+0000 7f4841425640 1 --2- 172.21.15.148:0/1109596505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f483c108420 0x7f483c108830 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4830009900 tx=0x7f483002a410 comp rx=0 tx=0).stop 2024-09-21T01:12:58.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.885+0000 7f4841425640 1 -- 172.21.15.148:0/1109596505 shutdown_connections 2024-09-21T01:12:58.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.885+0000 7f4841425640 1 --2- 172.21.15.148:0/1109596505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f483c108420 0x7f483c108830 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:58.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.885+0000 7f4841425640 1 --2- 172.21.15.148:0/1109596505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c108d70 0x7f483c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:58.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.885+0000 7f4841425640 1 --2- 172.21.15.148:0/1109596505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f483c102ae0 0x7f483c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:58.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.885+0000 7f4841425640 1 -- 172.21.15.148:0/1109596505 >> 172.21.15.148:0/1109596505 conn(0x7f483c079770 msgr2=0x7f483c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:58.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.885+0000 7f4841425640 1 -- 172.21.15.148:0/1109596505 shutdown_connections 2024-09-21T01:12:58.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.885+0000 7f4841425640 1 -- 172.21.15.148:0/1109596505 wait complete. 2024-09-21T01:12:58.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f4841425640 1 Processor -- start 2024-09-21T01:12:58.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f4841425640 1 -- start start 2024-09-21T01:12:58.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f4841425640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c102ae0 0x7f483c1994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:58.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f4841425640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f483c108420 0x7f483c199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:58.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f4841425640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f483c108d70 0x7f483c19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:58.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f4841425640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f483c112aa0 con 0x7f483c108420 2024-09-21T01:12:58.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f4841425640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f483c112920 con 0x7f483c102ae0 2024-09-21T01:12:58.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f4841425640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f483c112c20 con 0x7f483c108d70 2024-09-21T01:12:58.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f483a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f483c108420 0x7f483c199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:58.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f483a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f483c108420 0x7f483c199a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53016/0 (socket says 172.21.15.148:53016) 2024-09-21T01:12:58.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.886+0000 7f483a7fc640 1 -- 172.21.15.148:0/1812773860 learned_addr learned my addr 172.21.15.148:0/1812773860 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:12:58.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f483affd640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c102ae0 0x7f483c1994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:58.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f483b7fe640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f483c108d70 0x7f483c19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:58.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f483a7fc640 1 -- 172.21.15.148:0/1812773860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f483c108d70 msgr2=0x7f483c19ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:58.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f483a7fc640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f483c108d70 0x7f483c19ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:58.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f483a7fc640 1 -- 172.21.15.148:0/1812773860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c102ae0 msgr2=0x7f483c1994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:58.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f483a7fc640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c102ae0 0x7f483c1994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:58.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f483a7fc640 1 -- 172.21.15.148:0/1812773860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c19f420 con 0x7f483c108420 2024-09-21T01:12:58.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f483affd640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c102ae0 0x7f483c1994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:12:58.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f483b7fe640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f483c108d70 0x7f483c19ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:58.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f483a7fc640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f483c108420 0x7f483c199a50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4830005ab0 tx=0x7f4830003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:58.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f4823fff640 1 -- 172.21.15.148:0/1812773860 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483003f070 con 0x7f483c108420 2024-09-21T01:12:58.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f4823fff640 1 -- 172.21.15.148:0/1812773860 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4830031d60 con 0x7f483c108420 2024-09-21T01:12:58.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483c19f6b0 con 0x7f483c108420 2024-09-21T01:12:58.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f4823fff640 1 -- 172.21.15.148:0/1812773860 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830035030 con 0x7f483c108420 2024-09-21T01:12:58.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.887+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f483c1a5e70 con 0x7f483c108420 2024-09-21T01:12:58.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.888+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f483c063b50 con 0x7f483c108420 2024-09-21T01:12:58.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.890+0000 7f4823fff640 1 -- 172.21.15.148:0/1812773860 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f4830042070 con 0x7f483c108420 2024-09-21T01:12:58.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.890+0000 7f4823fff640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48240b65a0 0x7f48240b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:58.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.890+0000 7f483affd640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48240b65a0 0x7f48240b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:58.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.890+0000 7f4823fff640 1 -- 172.21.15.148:0/1812773860 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f48301083d0 con 0x7f483c108420 2024-09-21T01:12:58.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.891+0000 7f4823fff640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] conn(0x7f48240c0090 0x7f48240c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:58.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.891+0000 7f4823fff640 1 -- 172.21.15.148:0/1812773860 --> [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48240c2c50 con 0x7f48240c0090 2024-09-21T01:12:58.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.891+0000 7f4823fff640 1 -- 172.21.15.148:0/1812773860 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f4830108820 con 0x7f483c108420 2024-09-21T01:12:58.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.891+0000 7f483affd640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48240b65a0 0x7f48240b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f482c009930 tx=0x7f482c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:58.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.891+0000 7f483b7fe640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] conn(0x7f48240c0090 0x7f48240c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:58.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.891+0000 7f483b7fe640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] conn(0x7f48240c0090 0x7f48240c2580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:58.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.892+0000 7f4823fff640 1 -- 172.21.15.148:0/1812773860 <== osd.2 v2:172.21.15.181:6800/3636676499 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48240c2c50 con 0x7f48240c0090 2024-09-21T01:12:58.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.906+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 --> [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f483c063f50 con 0x7f48240c0090 2024-09-21T01:12:58.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.906+0000 7f4823fff640 1 -- 172.21.15.148:0/1812773860 <== osd.2 v2:172.21.15.181:6800/3636676499 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f483c063f50 con 0x7f48240c0090 2024-09-21T01:12:58.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.906+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 >> [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] conn(0x7f48240c0090 msgr2=0x7f48240c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:58.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.906+0000 7f4841425640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] conn(0x7f48240c0090 0x7f48240c2580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:58.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.906+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48240b65a0 msgr2=0x7f48240b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:58.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.906+0000 7f4841425640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48240b65a0 0x7f48240b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f482c009930 tx=0x7f482c008040 comp rx=0 tx=0).stop 2024-09-21T01:12:58.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.906+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f483c108420 msgr2=0x7f483c199a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:58.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.906+0000 7f4841425640 1 --2- 172.21.15.148:0/1812773860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f483c108420 0x7f483c199a50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4830005ab0 tx=0x7f4830003cd0 comp rx=0 tx=0).stop 2024-09-21T01:12:58.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.907+0000 7f483b7fe640 1 -- 172.21.15.148:0/1812773860 reap_dead start 2024-09-21T01:12:58.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.907+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 shutdown_connections 2024-09-21T01:12:58.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.907+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 >> 172.21.15.148:0/1812773860 conn(0x7f483c079770 msgr2=0x7f483c1064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:58.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.907+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 shutdown_connections 2024-09-21T01:12:58.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.907+0000 7f4841425640 1 -- 172.21.15.148:0/1812773860 wait complete. 2024-09-21T01:12:59.683 INFO:teuthology.orchestra.run.smithi148.stdout:77309411396 2024-09-21T01:12:59.684 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T01:12:59.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:12:59 smithi181 ceph-mon[34811]: pgmap v308: 97 pgs: 4 peering, 93 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-21T01:12:59.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:12:59 smithi157 ceph-mon[34140]: pgmap v308: 97 pgs: 4 peering, 93 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-21T01:13:00.025 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:12:59 smithi148 ceph-mon[31000]: pgmap v308: 97 pgs: 4 peering, 93 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-21T01:13:00.064 INFO:teuthology.orchestra.run.smithi148.stdout:133143986232 2024-09-21T01:13:00.065 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T01:13:00.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.773+0000 7f51b5c2d640 1 -- 172.21.15.148:0/1528439625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b0108d10 msgr2=0x7f51b010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.773+0000 7f51b5c2d640 1 --2- 172.21.15.148:0/1528439625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b0108d10 0x7f51b010f540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009ca0 tx=0x7f51a802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.773+0000 7f51b5c2d640 1 -- 172.21.15.148:0/1528439625 shutdown_connections 2024-09-21T01:13:00.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.773+0000 7f51b5c2d640 1 --2- 172.21.15.148:0/1528439625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b0108d10 0x7f51b010f540 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.773+0000 7f51b5c2d640 1 --2- 172.21.15.148:0/1528439625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51b01083c0 0x7f51b01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.773+0000 7f51b5c2d640 1 --2- 172.21.15.148:0/1528439625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b0102a80 0x7f51b0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.773+0000 7f51b5c2d640 1 -- 172.21.15.148:0/1528439625 >> 172.21.15.148:0/1528439625 conn(0x7f51b0079740 msgr2=0x7f51b0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:00.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.773+0000 7f51b5c2d640 1 -- 172.21.15.148:0/1528439625 shutdown_connections 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.773+0000 7f51b5c2d640 1 -- 172.21.15.148:0/1528439625 wait complete. 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51b5c2d640 1 Processor -- start 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51b5c2d640 1 -- start start 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51b5c2d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51b0102a80 0x7f51b019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51b5c2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b01083c0 0x7f51b019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51b5c2d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b0108d10 0x7f51b019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51b5c2d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0113ae0 con 0x7f51b01083c0 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51b5c2d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0113960 con 0x7f51b0102a80 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51b5c2d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0113c60 con 0x7f51b0108d10 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51aeffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b01083c0 0x7f51b019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51aeffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b01083c0 0x7f51b019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53008/0 (socket says 172.21.15.148:53008) 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51aeffd640 1 -- 172.21.15.148:0/2130566255 learned_addr learned my addr 172.21.15.148:0/2130566255 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:00.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51affff640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b0108d10 0x7f51b019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.774+0000 7f51af7fe640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51b0102a80 0x7f51b019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51aeffd640 1 -- 172.21.15.148:0/2130566255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b0108d10 msgr2=0x7f51b019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51aeffd640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b0108d10 0x7f51b019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51aeffd640 1 -- 172.21.15.148:0/2130566255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51b0102a80 msgr2=0x7f51b019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51aeffd640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51b0102a80 0x7f51b019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51aeffd640 1 -- 172.21.15.148:0/2130566255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b01a0480 con 0x7f51b01083c0 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51affff640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b0108d10 0x7f51b019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51aeffd640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b01083c0 0x7f51b019aab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f51a400d770 tx=0x7f51a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51acff9640 1 -- 172.21.15.148:0/2130566255 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4017070 con 0x7f51b01083c0 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b01a0770 con 0x7f51b01083c0 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51acff9640 1 -- 172.21.15.148:0/2130566255 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a4009c30 con 0x7f51b01083c0 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51acff9640 1 -- 172.21.15.148:0/2130566255 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a400f620 con 0x7f51b01083c0 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.775+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b01a6ed0 con 0x7f51b01083c0 2024-09-21T01:13:00.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.776+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51b0063b50 con 0x7f51b01083c0 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.778+0000 7f51acff9640 1 -- 172.21.15.148:0/2130566255 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f51a401a070 con 0x7f51b01083c0 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.778+0000 7f51acff9640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f51980b65a0 0x7f51980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.778+0000 7f51af7fe640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f51980b65a0 0x7f51980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.778+0000 7f51acff9640 1 -- 172.21.15.148:0/2130566255 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f51a40e7460 con 0x7f51b01083c0 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.779+0000 7f51acff9640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] conn(0x7f51980c0090 0x7f51980c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.779+0000 7f51acff9640 1 -- 172.21.15.148:0/2130566255 --> [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51980c2c50 con 0x7f51980c0090 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.779+0000 7f51acff9640 1 -- 172.21.15.148:0/2130566255 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f51a40e78b0 con 0x7f51b01083c0 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.779+0000 7f51af7fe640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f51980b65a0 0x7f51980b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009890 tx=0x7f51a0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.779+0000 7f51affff640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] conn(0x7f51980c0090 0x7f51980c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.780+0000 7f51affff640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] conn(0x7f51980c0090 0x7f51980c2580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:00.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.780+0000 7f51acff9640 1 -- 172.21.15.148:0/2130566255 <== osd.5 v2:172.21.15.181:6808/1383691858 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f51980c2c50 con 0x7f51980c0090 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.794+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 --> [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f51b0063f50 con 0x7f51980c0090 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.795+0000 7f51acff9640 1 -- 172.21.15.148:0/2130566255 <== osd.5 v2:172.21.15.181:6808/1383691858 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f51b0063f50 con 0x7f51980c0090 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.795+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 >> [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] conn(0x7f51980c0090 msgr2=0x7f51980c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.795+0000 7f51b5c2d640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] conn(0x7f51980c0090 0x7f51980c2580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.795+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f51980b65a0 msgr2=0x7f51980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.795+0000 7f51b5c2d640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f51980b65a0 0x7f51980b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009890 tx=0x7f51a0008040 comp rx=0 tx=0).stop 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.795+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b01083c0 msgr2=0x7f51b019aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.795+0000 7f51b5c2d640 1 --2- 172.21.15.148:0/2130566255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b01083c0 0x7f51b019aab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f51a400d770 tx=0x7f51a400dc30 comp rx=0 tx=0).stop 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.795+0000 7f51affff640 1 -- 172.21.15.148:0/2130566255 reap_dead start 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.796+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 shutdown_connections 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.796+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 >> 172.21.15.148:0/2130566255 conn(0x7f51b0079740 msgr2=0x7f51b01052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.796+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 shutdown_connections 2024-09-21T01:13:00.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:12:58.796+0000 7f51b5c2d640 1 -- 172.21.15.148:0/2130566255 wait complete. 2024-09-21T01:13:00.423 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:00.432 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:00.922 INFO:teuthology.orchestra.run.smithi148.stdout:158913790005 2024-09-21T01:13:00.922 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T01:13:01.160 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:01.164 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:01.165 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.375+0000 7ff80b047640 1 -- 172.21.15.148:0/4049004111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff804108d70 msgr2=0x7ff80410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.375+0000 7ff80b047640 1 --2- 172.21.15.148:0/4049004111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff804108d70 0x7ff80410f5a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009ca0 tx=0x7ff7fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.375+0000 7ff80b047640 1 -- 172.21.15.148:0/4049004111 shutdown_connections 2024-09-21T01:13:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.375+0000 7ff80b047640 1 --2- 172.21.15.148:0/4049004111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff804108d70 0x7ff80410f5a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.375+0000 7ff80b047640 1 --2- 172.21.15.148:0/4049004111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff804108420 0x7ff804108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.375+0000 7ff80b047640 1 --2- 172.21.15.148:0/4049004111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff804102ae0 0x7ff804102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.375+0000 7ff80b047640 1 -- 172.21.15.148:0/4049004111 >> 172.21.15.148:0/4049004111 conn(0x7ff804079770 msgr2=0x7ff804079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.375+0000 7ff80b047640 1 -- 172.21.15.148:0/4049004111 shutdown_connections 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.376+0000 7ff80b047640 1 -- 172.21.15.148:0/4049004111 wait complete. 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.376+0000 7ff80b047640 1 Processor -- start 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.376+0000 7ff80b047640 1 -- start start 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.376+0000 7ff80b047640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff804102ae0 0x7ff8041993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.376+0000 7ff80b047640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff804108420 0x7ff804199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.376+0000 7ff80b047640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff804108d70 0x7ff80419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff80b047640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff804112a30 con 0x7ff804102ae0 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff80b047640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff8041128b0 con 0x7ff804108420 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff80b047640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff804112bb0 con 0x7ff804108d70 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff808de3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff804102ae0 0x7ff8041993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff808de3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff804102ae0 0x7ff8041993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53034/0 (socket says 172.21.15.148:53034) 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff808de3640 1 -- 172.21.15.148:0/3327548544 learned_addr learned my addr 172.21.15.148:0/3327548544 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff803fff640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff804108420 0x7ff804199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff8095e4640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff804108d70 0x7ff80419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff808de3640 1 -- 172.21.15.148:0/3327548544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff804108d70 msgr2=0x7ff80419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff808de3640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff804108d70 0x7ff80419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff808de3640 1 -- 172.21.15.148:0/3327548544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff804108420 msgr2=0x7ff804199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff808de3640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff804108420 0x7ff804199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff808de3640 1 -- 172.21.15.148:0/3327548544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80419f250 con 0x7ff804102ae0 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff803fff640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff804108420 0x7ff804199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff8095e4640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff804108d70 0x7ff80419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff808de3640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff804102ae0 0x7ff8041993a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8007b50 tx=0x7ff7f800e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff801ffb640 1 -- 172.21.15.148:0/3327548544 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8007c40 con 0x7ff804102ae0 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff801ffb640 1 -- 172.21.15.148:0/3327548544 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7f8007de0 con 0x7ff804102ae0 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff80b047640 1 -- 172.21.15.148:0/3327548544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff80419f540 con 0x7ff804102ae0 2024-09-21T01:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.377+0000 7ff801ffb640 1 -- 172.21.15.148:0/3327548544 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800ace0 con 0x7ff804102ae0 2024-09-21T01:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.378+0000 7ff80b047640 1 -- 172.21.15.148:0/3327548544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff80406bb60 con 0x7ff804102ae0 2024-09-21T01:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.379+0000 7ff80b047640 1 -- 172.21.15.148:0/3327548544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff804103d60 con 0x7ff804102ae0 2024-09-21T01:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.380+0000 7ff801ffb640 1 -- 172.21.15.148:0/3327548544 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7ff7f800eb30 con 0x7ff804102ae0 2024-09-21T01:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.381+0000 7ff801ffb640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7f40b65d0 0x7ff7f40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.381+0000 7ff803fff640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7f40b65d0 0x7ff7f40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.381+0000 7ff801ffb640 1 -- 172.21.15.148:0/3327548544 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7ff7f80e8ab0 con 0x7ff804102ae0 2024-09-21T01:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.381+0000 7ff803fff640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7f40b65d0 0x7ff7f40b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff8041080f0 tx=0x7ff7f0005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.385+0000 7ff801ffb640 1 -- 172.21.15.148:0/3327548544 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7f8023060 con 0x7ff804102ae0 2024-09-21T01:13:01.420 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:01.421 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:01.438 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:01.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.590+0000 7ff80b047640 1 -- 172.21.15.148:0/3327548544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff804102ef0 con 0x7ff804102ae0 2024-09-21T01:13:01.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.590+0000 7ff801ffb640 1 -- 172.21.15.148:0/3327548544 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff7f800ee20 con 0x7ff804102ae0 2024-09-21T01:13:01.591 INFO:teuthology.orchestra.run.smithi148.stdout:34359738445 2024-09-21T01:13:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 -- 172.21.15.148:0/3327548544 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7f40b65d0 msgr2=0x7ff7f40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7f40b65d0 0x7ff7f40b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff8041080f0 tx=0x7ff7f0005d30 comp rx=0 tx=0).stop 2024-09-21T01:13:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 -- 172.21.15.148:0/3327548544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff804102ae0 msgr2=0x7ff8041993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff804102ae0 0x7ff8041993a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8007b50 tx=0x7ff7f800e420 comp rx=0 tx=0).stop 2024-09-21T01:13:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 -- 172.21.15.148:0/3327548544 shutdown_connections 2024-09-21T01:13:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7f40b65d0 0x7ff7f40b8ae0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff804108d70 0x7ff80419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff804108420 0x7ff804199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 --2- 172.21.15.148:0/3327548544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff804102ae0 0x7ff8041993a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:01.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 -- 172.21.15.148:0/3327548544 >> 172.21.15.148:0/3327548544 conn(0x7ff804079770 msgr2=0x7ff804106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:01.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 -- 172.21.15.148:0/3327548544 shutdown_connections 2024-09-21T01:13:01.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:01.593+0000 7ff80b047640 1 -- 172.21.15.148:0/3327548544 wait complete. 2024-09-21T01:13:01.979 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:01 smithi148 ceph-mon[31000]: pgmap v309: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 383 B/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:01.979 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:01 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3327548544' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T01:13:01.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:01 smithi181 ceph-mon[34811]: pgmap v309: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 383 B/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:01.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:01 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3327548544' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T01:13:01.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:01 smithi157 ceph-mon[34140]: pgmap v309: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 383 B/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:01.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:01 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3327548544' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.069+0000 7f29a237e640 1 -- 172.21.15.148:0/2436508375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c102ae0 msgr2=0x7f299c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.069+0000 7f29a237e640 1 --2- 172.21.15.148:0/2436508375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c102ae0 0x7f299c102ef0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f298c009900 tx=0x7f298c02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.069+0000 7f29a237e640 1 -- 172.21.15.148:0/2436508375 shutdown_connections 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.069+0000 7f29a237e640 1 --2- 172.21.15.148:0/2436508375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299c108d70 0x7f299c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.069+0000 7f29a237e640 1 --2- 172.21.15.148:0/2436508375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c108420 0x7f299c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.069+0000 7f29a237e640 1 --2- 172.21.15.148:0/2436508375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c102ae0 0x7f299c102ef0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.069+0000 7f29a237e640 1 -- 172.21.15.148:0/2436508375 >> 172.21.15.148:0/2436508375 conn(0x7f299c079770 msgr2=0x7f299c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.069+0000 7f29a237e640 1 -- 172.21.15.148:0/2436508375 shutdown_connections 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.069+0000 7f29a237e640 1 -- 172.21.15.148:0/2436508375 wait complete. 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f29a237e640 1 Processor -- start 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f29a237e640 1 -- start start 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f29a237e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299c102ae0 0x7f299c19b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f29a237e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c108420 0x7f299c19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f29a237e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c108d70 0x7f299c19be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f29a237e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f299c112a30 con 0x7f299c108420 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f29a237e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f299c1128b0 con 0x7f299c108d70 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f29a237e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f299c112bb0 con 0x7f299c102ae0 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f2993fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c108420 0x7f299c19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f2993fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c108420 0x7f299c19b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53048/0 (socket says 172.21.15.148:53048) 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f2993fff640 1 -- 172.21.15.148:0/2601807868 learned_addr learned my addr 172.21.15.148:0/2601807868 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f299bfff640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299c102ae0 0x7f299c19b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.070+0000 7f29a091b640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c108d70 0x7f299c19be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f2993fff640 1 -- 172.21.15.148:0/2601807868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299c102ae0 msgr2=0x7f299c19b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f2993fff640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299c102ae0 0x7f299c19b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f2993fff640 1 -- 172.21.15.148:0/2601807868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c108d70 msgr2=0x7f299c19be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f2993fff640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c108d70 0x7f299c19be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f2993fff640 1 -- 172.21.15.148:0/2601807868 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c1a6610 con 0x7f299c108420 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f29a091b640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c108d70 0x7f299c19be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f2993fff640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c108420 0x7f299c19b8c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f298400d740 tx=0x7f298400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f2999ffb640 1 -- 172.21.15.148:0/2601807868 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2984017070 con 0x7f299c108420 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f29a237e640 1 -- 172.21.15.148:0/2601807868 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c1a6900 con 0x7f299c108420 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f2999ffb640 1 -- 172.21.15.148:0/2601807868 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f298400de50 con 0x7f299c108420 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f2999ffb640 1 -- 172.21.15.148:0/2601807868 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298400f620 con 0x7f299c108420 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.071+0000 7f29a237e640 1 -- 172.21.15.148:0/2601807868 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c1a6e90 con 0x7f299c108420 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.072+0000 7f29a237e640 1 -- 172.21.15.148:0/2601807868 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c103d60 con 0x7f299c108420 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.073+0000 7f2999ffb640 1 -- 172.21.15.148:0/2601807868 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f298401a070 con 0x7f299c108420 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.074+0000 7f2999ffb640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f29880b65d0 0x7f29880b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.074+0000 7f299bfff640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f29880b65d0 0x7f29880b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.074+0000 7f2999ffb640 1 -- 172.21.15.148:0/2601807868 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f29840e6e60 con 0x7f299c108420 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.075+0000 7f299bfff640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f29880b65d0 0x7f29880b8ae0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f298c000c00 tx=0x7f298c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.077+0000 7f2999ffb640 1 -- 172.21.15.148:0/2601807868 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f29840ad5a0 con 0x7f299c108420 2024-09-21T01:13:02.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.260+0000 7f29a237e640 1 -- 172.21.15.148:0/2601807868 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f299c102ef0 con 0x7f299c108420 2024-09-21T01:13:02.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.261+0000 7f2999ffb640 1 -- 172.21.15.148:0/2601807868 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f29840b1980 con 0x7f299c108420 2024-09-21T01:13:02.262 INFO:teuthology.orchestra.run.smithi148.stdout:197568495657 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 -- 172.21.15.148:0/2601807868 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f29880b65d0 msgr2=0x7f29880b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f29880b65d0 0x7f29880b8ae0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f298c000c00 tx=0x7f298c031400 comp rx=0 tx=0).stop 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 -- 172.21.15.148:0/2601807868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c108420 msgr2=0x7f299c19b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c108420 0x7f299c19b8c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f298400d740 tx=0x7f298400dc00 comp rx=0 tx=0).stop 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 -- 172.21.15.148:0/2601807868 shutdown_connections 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f29880b65d0 0x7f29880b8ae0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f299c108420 0x7f299c19b8c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f299c108d70 0x7f299c19be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 --2- 172.21.15.148:0/2601807868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f299c102ae0 0x7f299c19b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 -- 172.21.15.148:0/2601807868 >> 172.21.15.148:0/2601807868 conn(0x7f299c079770 msgr2=0x7f299c106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 -- 172.21.15.148:0/2601807868 shutdown_connections 2024-09-21T01:13:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:02.263+0000 7f29a237e640 1 -- 172.21.15.148:0/2601807868 wait complete. 2024-09-21T01:13:02.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:02 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2601807868' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T01:13:02.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:02 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2601807868' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T01:13:02.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:02 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2601807868' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T01:13:02.999 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495655 got 197568495657 for osd.7 2024-09-21T01:13:02.999 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:03.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:03 smithi148 ceph-mon[31000]: pgmap v310: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 383 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:03.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:03 smithi181 ceph-mon[34811]: pgmap v310: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 383 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:03.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:03 smithi157 ceph-mon[34140]: pgmap v310: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 383 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.007+0000 7f12f9b79640 1 -- 172.21.15.148:0/2883692153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f4109570 msgr2=0x7f12f4109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.007+0000 7f12f9b79640 1 --2- 172.21.15.148:0/2883692153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f4109570 0x7f12f4109980 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009900 tx=0x7f12e802a410 comp rx=0 tx=0).stop 2024-09-21T01:13:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.007+0000 7f12f9b79640 1 -- 172.21.15.148:0/2883692153 shutdown_connections 2024-09-21T01:13:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.007+0000 7f12f9b79640 1 --2- 172.21.15.148:0/2883692153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f4109570 0x7f12f4109980 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.007+0000 7f12f9b79640 1 --2- 172.21.15.148:0/2883692153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f4109ec0 0x7f12f41106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.007+0000 7f12f9b79640 1 --2- 172.21.15.148:0/2883692153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f4103c30 0x7f12f4104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.007+0000 7f12f9b79640 1 -- 172.21.15.148:0/2883692153 >> 172.21.15.148:0/2883692153 conn(0x7f12f407b8d0 msgr2=0x7f12f407bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.007+0000 7f12f9b79640 1 -- 172.21.15.148:0/2883692153 shutdown_connections 2024-09-21T01:13:04.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.007+0000 7f12f9b79640 1 -- 172.21.15.148:0/2883692153 wait complete. 2024-09-21T01:13:04.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f9b79640 1 Processor -- start 2024-09-21T01:13:04.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f9b79640 1 -- start start 2024-09-21T01:13:04.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f9b79640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f4103c30 0x7f12f419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:04.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f9b79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f4109570 0x7f12f419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:04.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f9b79640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f4109ec0 0x7f12f419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:04.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f9b79640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12f4113ae0 con 0x7f12f4109570 2024-09-21T01:13:04.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f9b79640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f12f4113960 con 0x7f12f4109ec0 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f9b79640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f12f4113c60 con 0x7f12f4103c30 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f4109570 0x7f12f419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f4109570 0x7f12f419aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53084/0 (socket says 172.21.15.148:53084) 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.008+0000 7f12f2ffd640 1 -- 172.21.15.148:0/240599972 learned_addr learned my addr 172.21.15.148:0/240599972 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f3fff640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f4109ec0 0x7f12f419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f37fe640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f4103c30 0x7f12f419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f2ffd640 1 -- 172.21.15.148:0/240599972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f4103c30 msgr2=0x7f12f419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f2ffd640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f4103c30 0x7f12f419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f2ffd640 1 -- 172.21.15.148:0/240599972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f4109ec0 msgr2=0x7f12f419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f2ffd640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f4109ec0 0x7f12f419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f2ffd640 1 -- 172.21.15.148:0/240599972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f41a0360 con 0x7f12f4109570 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f2ffd640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f4109570 0x7f12f419aa50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f12e802a930 tx=0x7f12e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f0ff9640 1 -- 172.21.15.148:0/240599972 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e803f030 con 0x7f12f4109570 2024-09-21T01:13:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f9b79640 1 -- 172.21.15.148:0/240599972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f41a05f0 con 0x7f12f4109570 2024-09-21T01:13:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f0ff9640 1 -- 172.21.15.148:0/240599972 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12e8003aa0 con 0x7f12f4109570 2024-09-21T01:13:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f0ff9640 1 -- 172.21.15.148:0/240599972 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8035070 con 0x7f12f4109570 2024-09-21T01:13:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.009+0000 7f12f9b79640 1 -- 172.21.15.148:0/240599972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f41a0ad0 con 0x7f12f4109570 2024-09-21T01:13:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.010+0000 7f12f9b79640 1 -- 172.21.15.148:0/240599972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f4104040 con 0x7f12f4109570 2024-09-21T01:13:04.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.012+0000 7f12f0ff9640 1 -- 172.21.15.148:0/240599972 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f12e8042030 con 0x7f12f4109570 2024-09-21T01:13:04.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.013+0000 7f12f0ff9640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f12dc0b65d0 0x7f12dc0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:04.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.013+0000 7f12f37fe640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f12dc0b65d0 0x7f12dc0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:04.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.013+0000 7f12f0ff9640 1 -- 172.21.15.148:0/240599972 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f12e8107f90 con 0x7f12f4109570 2024-09-21T01:13:04.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.013+0000 7f12f37fe640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f12dc0b65d0 0x7f12dc0b8ae0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f12e4005d00 tx=0x7f12e4005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:04.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.020+0000 7f12f0ff9640 1 -- 172.21.15.148:0/240599972 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12e80ce6d0 con 0x7f12f4109570 2024-09-21T01:13:04.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.906+0000 7f9d02146640 1 -- 172.21.15.148:0/2001933272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cfc102ae0 msgr2=0x7f9cfc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.906+0000 7f9d02146640 1 --2- 172.21.15.148:0/2001933272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cfc102ae0 0x7f9cfc102ef0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009900 tx=0x7f9cec02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.906+0000 7f9d02146640 1 -- 172.21.15.148:0/2001933272 shutdown_connections 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.906+0000 7f9d02146640 1 --2- 172.21.15.148:0/2001933272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cfc108d70 0x7f9cfc10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.906+0000 7f9d02146640 1 --2- 172.21.15.148:0/2001933272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cfc108420 0x7f9cfc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.906+0000 7f9d02146640 1 --2- 172.21.15.148:0/2001933272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cfc102ae0 0x7f9cfc102ef0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.906+0000 7f9d02146640 1 -- 172.21.15.148:0/2001933272 >> 172.21.15.148:0/2001933272 conn(0x7f9cfc079770 msgr2=0x7f9cfc079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.906+0000 7f9d02146640 1 -- 172.21.15.148:0/2001933272 shutdown_connections 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.906+0000 7f9d02146640 1 -- 172.21.15.148:0/2001933272 wait complete. 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.907+0000 7f9d02146640 1 Processor -- start 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.907+0000 7f9d02146640 1 -- start start 2024-09-21T01:13:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9d02146640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cfc102ae0 0x7f9cfc19b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9d02146640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cfc108420 0x7f9cfc19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9d02146640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cfc108d70 0x7f9cfc19bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9d02146640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc112a90 con 0x7f9cfc108d70 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9d02146640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc112910 con 0x7f9cfc102ae0 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9d02146640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc112c10 con 0x7f9cfc108420 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cfc108d70 0x7f9cfc19bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cfc108d70 0x7f9cfc19bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53064/0 (socket says 172.21.15.148:53064) 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfbfff640 1 -- 172.21.15.148:0/3679240440 learned_addr learned my addr 172.21.15.148:0/3679240440 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfb7fe640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cfc102ae0 0x7f9cfc19b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfaffd640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cfc108420 0x7f9cfc19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfbfff640 1 -- 172.21.15.148:0/3679240440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cfc108420 msgr2=0x7f9cfc19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfbfff640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cfc108420 0x7f9cfc19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfbfff640 1 -- 172.21.15.148:0/3679240440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cfc102ae0 msgr2=0x7f9cfc19b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfbfff640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cfc102ae0 0x7f9cfc19b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfbfff640 1 -- 172.21.15.148:0/3679240440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cfc1a66f0 con 0x7f9cfc108d70 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfb7fe640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cfc102ae0 0x7f9cfc19b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cfbfff640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cfc108d70 0x7f9cfc19bee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400b970 tx=0x7f9cf400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cf8ff9640 1 -- 172.21.15.148:0/3679240440 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4019070 con 0x7f9cfc108d70 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cf8ff9640 1 -- 172.21.15.148:0/3679240440 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cf4014440 con 0x7f9cfc108d70 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9d02146640 1 -- 172.21.15.148:0/3679240440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cfc1a69e0 con 0x7f9cfc108d70 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9cf8ff9640 1 -- 172.21.15.148:0/3679240440 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40075d0 con 0x7f9cfc108d70 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.908+0000 7f9d02146640 1 -- 172.21.15.148:0/3679240440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cfc1a6f20 con 0x7f9cfc108d70 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.909+0000 7f9d02146640 1 -- 172.21.15.148:0/3679240440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cfc103d60 con 0x7f9cfc108d70 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.911+0000 7f9cf8ff9640 1 -- 172.21.15.148:0/3679240440 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f9cf401c070 con 0x7f9cfc108d70 2024-09-21T01:13:04.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.912+0000 7f9cf8ff9640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9ce40b65d0 0x7f9ce40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.912+0000 7f9cfb7fe640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9ce40b65d0 0x7f9ce40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.912+0000 7f9cf8ff9640 1 -- 172.21.15.148:0/3679240440 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f9cf40e6e50 con 0x7f9cfc108d70 2024-09-21T01:13:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.912+0000 7f9cfb7fe640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9ce40b65d0 0x7f9ce40b8ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9cec000c00 tx=0x7f9cec009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:03.915+0000 7f9cf8ff9640 1 -- 172.21.15.148:0/3679240440 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cf40ad590 con 0x7f9cfc108d70 2024-09-21T01:13:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.111+0000 7f9d02146640 1 -- 172.21.15.148:0/3679240440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f9cfc10aba0 con 0x7f9cfc108d70 2024-09-21T01:13:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.111+0000 7f9cf8ff9640 1 -- 172.21.15.148:0/3679240440 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f9cf40b1970 con 0x7f9cfc108d70 2024-09-21T01:13:04.112 INFO:teuthology.orchestra.run.smithi148.stdout:270582939676 2024-09-21T01:13:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.113+0000 7f9d02146640 1 -- 172.21.15.148:0/3679240440 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9ce40b65d0 msgr2=0x7f9ce40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.113+0000 7f9d02146640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9ce40b65d0 0x7f9ce40b8ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9cec000c00 tx=0x7f9cec009680 comp rx=0 tx=0).stop 2024-09-21T01:13:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.113+0000 7f9d02146640 1 -- 172.21.15.148:0/3679240440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cfc108d70 msgr2=0x7f9cfc19bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.113+0000 7f9d02146640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cfc108d70 0x7f9cfc19bee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400b970 tx=0x7f9cf400be30 comp rx=0 tx=0).stop 2024-09-21T01:13:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.113+0000 7f9d02146640 1 -- 172.21.15.148:0/3679240440 shutdown_connections 2024-09-21T01:13:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.113+0000 7f9d02146640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9ce40b65d0 0x7f9ce40b8ae0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.113+0000 7f9d02146640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cfc108d70 0x7f9cfc19bee0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.113+0000 7f9d02146640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cfc108420 0x7f9cfc19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.113+0000 7f9d02146640 1 --2- 172.21.15.148:0/3679240440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9cfc102ae0 0x7f9cfc19b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.113+0000 7f9d02146640 1 -- 172.21.15.148:0/3679240440 >> 172.21.15.148:0/3679240440 conn(0x7f9cfc079770 msgr2=0x7f9cfc106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.114+0000 7f9d02146640 1 -- 172.21.15.148:0/3679240440 shutdown_connections 2024-09-21T01:13:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.114+0000 7f9d02146640 1 -- 172.21.15.148:0/3679240440 wait complete. 2024-09-21T01:13:04.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.208+0000 7f12f9b79640 1 -- 172.21.15.148:0/240599972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f12f410b700 con 0x7f12f4109570 2024-09-21T01:13:04.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.208+0000 7f12f0ff9640 1 -- 172.21.15.148:0/240599972 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f12e80d2ab0 con 0x7f12f4109570 2024-09-21T01:13:04.209 INFO:teuthology.orchestra.run.smithi148.stdout:249108103201 2024-09-21T01:13:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 -- 172.21.15.148:0/240599972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f12dc0b65d0 msgr2=0x7f12dc0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f12dc0b65d0 0x7f12dc0b8ae0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f12e4005d00 tx=0x7f12e4005c50 comp rx=0 tx=0).stop 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 -- 172.21.15.148:0/240599972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f4109570 msgr2=0x7f12f419aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f4109570 0x7f12f419aa50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f12e802a930 tx=0x7f12e8004270 comp rx=0 tx=0).stop 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 -- 172.21.15.148:0/240599972 shutdown_connections 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f12dc0b65d0 0x7f12dc0b8ae0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12f4109570 0x7f12f419aa50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f4109ec0 0x7f12f419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 --2- 172.21.15.148:0/240599972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f4103c30 0x7f12f419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 -- 172.21.15.148:0/240599972 >> 172.21.15.148:0/240599972 conn(0x7f12f407b8d0 msgr2=0x7f12f41055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 -- 172.21.15.148:0/240599972 shutdown_connections 2024-09-21T01:13:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:04.211+0000 7f12f9b79640 1 -- 172.21.15.148:0/240599972 wait complete. 2024-09-21T01:13:04.807 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:04 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3679240440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T01:13:04.807 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:04 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/240599972' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T01:13:04.807 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:04 smithi148 ceph-mon[31000]: pgmap v311: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 318 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:04.835 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939673 got 270582939676 for osd.10 2024-09-21T01:13:04.835 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:04.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:04 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3679240440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T01:13:04.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:04 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/240599972' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T01:13:04.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:04 smithi181 ceph-mon[34811]: pgmap v311: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 318 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:04.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:04 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3679240440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T01:13:04.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:04 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/240599972' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T01:13:04.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:04 smithi157 ceph-mon[34140]: pgmap v311: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 318 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.017+0000 7fd4341c8640 1 -- 172.21.15.148:0/2649418210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd42c1094a0 msgr2=0x7fd42c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.017+0000 7fd4341c8640 1 --2- 172.21.15.148:0/2649418210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd42c1094a0 0x7fd42c1098b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009900 tx=0x7fd41c02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.017+0000 7fd4341c8640 1 -- 172.21.15.148:0/2649418210 shutdown_connections 2024-09-21T01:13:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.017+0000 7fd4341c8640 1 --2- 172.21.15.148:0/2649418210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd42c1094a0 0x7fd42c1098b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.017+0000 7fd4341c8640 1 --2- 172.21.15.148:0/2649418210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c109df0 0x7fd42c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.017+0000 7fd4341c8640 1 --2- 172.21.15.148:0/2649418210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd42c103b60 0x7fd42c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.017+0000 7fd4341c8640 1 -- 172.21.15.148:0/2649418210 >> 172.21.15.148:0/2649418210 conn(0x7fd42c07b850 msgr2=0x7fd42c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.017+0000 7fd4341c8640 1 -- 172.21.15.148:0/2649418210 shutdown_connections 2024-09-21T01:13:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.017+0000 7fd4341c8640 1 -- 172.21.15.148:0/2649418210 wait complete. 2024-09-21T01:13:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd4341c8640 1 Processor -- start 2024-09-21T01:13:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd4341c8640 1 -- start start 2024-09-21T01:13:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd4341c8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd42c103b60 0x7fd42c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd4341c8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd42c1094a0 0x7fd42c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd4341c8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c109df0 0x7fd42c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd4341c8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c113ab0 con 0x7fd42c1094a0 2024-09-21T01:13:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd4341c8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c113930 con 0x7fd42c109df0 2024-09-21T01:13:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd4341c8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c113c30 con 0x7fd42c103b60 2024-09-21T01:13:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd431763640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd42c1094a0 0x7fd42c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd431763640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd42c1094a0 0x7fd42c19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53104/0 (socket says 172.21.15.148:53104) 2024-09-21T01:13:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd431763640 1 -- 172.21.15.148:0/1423365642 learned_addr learned my addr 172.21.15.148:0/1423365642 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd432765640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c109df0 0x7fd42c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd431f64640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd42c103b60 0x7fd42c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd431763640 1 -- 172.21.15.148:0/1423365642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd42c103b60 msgr2=0x7fd42c19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd431763640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd42c103b60 0x7fd42c19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd431763640 1 -- 172.21.15.148:0/1423365642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c109df0 msgr2=0x7fd42c19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.018+0000 7fd431763640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c109df0 0x7fd42c19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.019+0000 7fd431763640 1 -- 172.21.15.148:0/1423365642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c1a0510 con 0x7fd42c1094a0 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.019+0000 7fd431f64640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd42c103b60 0x7fd42c19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.019+0000 7fd431763640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd42c1094a0 0x7fd42c19ab40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd41c02a930 tx=0x7fd41c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.019+0000 7fd422ffd640 1 -- 172.21.15.148:0/1423365642 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c03f030 con 0x7fd42c1094a0 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.019+0000 7fd4341c8640 1 -- 172.21.15.148:0/1423365642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42c1a07a0 con 0x7fd42c1094a0 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.019+0000 7fd422ffd640 1 -- 172.21.15.148:0/1423365642 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd41c003aa0 con 0x7fd42c1094a0 2024-09-21T01:13:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.019+0000 7fd422ffd640 1 -- 172.21.15.148:0/1423365642 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c035070 con 0x7fd42c1094a0 2024-09-21T01:13:05.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.019+0000 7fd4341c8640 1 -- 172.21.15.148:0/1423365642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd42c1a6f60 con 0x7fd42c1094a0 2024-09-21T01:13:05.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.020+0000 7fd4341c8640 1 -- 172.21.15.148:0/1423365642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd42c104de0 con 0x7fd42c1094a0 2024-09-21T01:13:05.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.022+0000 7fd422ffd640 1 -- 172.21.15.148:0/1423365642 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fd41c042030 con 0x7fd42c1094a0 2024-09-21T01:13:05.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.022+0000 7fd422ffd640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4180b65a0 0x7fd4180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:05.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.022+0000 7fd431f64640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4180b65a0 0x7fd4180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:05.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.023+0000 7fd422ffd640 1 -- 172.21.15.148:0/1423365642 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fd41c107f20 con 0x7fd42c1094a0 2024-09-21T01:13:05.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.023+0000 7fd431f64640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4180b65a0 0x7fd4180b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd428005fd0 tx=0x7fd428009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:05.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.026+0000 7fd422ffd640 1 -- 172.21.15.148:0/1423365642 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd41c0ce660 con 0x7fd42c1094a0 2024-09-21T01:13:05.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.210+0000 7fd4341c8640 1 -- 172.21.15.148:0/1423365642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd42c10bbe0 con 0x7fd42c1094a0 2024-09-21T01:13:05.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.210+0000 7fd422ffd640 1 -- 172.21.15.148:0/1423365642 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd41c0d2a40 con 0x7fd42c1094a0 2024-09-21T01:13:05.211 INFO:teuthology.orchestra.run.smithi148.stdout:77309411397 2024-09-21T01:13:05.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.212+0000 7fd4341c8640 1 -- 172.21.15.148:0/1423365642 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4180b65a0 msgr2=0x7fd4180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:05.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.212+0000 7fd4341c8640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4180b65a0 0x7fd4180b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd428005fd0 tx=0x7fd428009520 comp rx=0 tx=0).stop 2024-09-21T01:13:05.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.212+0000 7fd4341c8640 1 -- 172.21.15.148:0/1423365642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd42c1094a0 msgr2=0x7fd42c19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:05.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.212+0000 7fd4341c8640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd42c1094a0 0x7fd42c19ab40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd41c02a930 tx=0x7fd41c004270 comp rx=0 tx=0).stop 2024-09-21T01:13:05.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.212+0000 7fd4341c8640 1 -- 172.21.15.148:0/1423365642 shutdown_connections 2024-09-21T01:13:05.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.212+0000 7fd4341c8640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd4180b65a0 0x7fd4180b8ab0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.212+0000 7fd4341c8640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd42c1094a0 0x7fd42c19ab40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.212+0000 7fd4341c8640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c109df0 0x7fd42c19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.212+0000 7fd4341c8640 1 --2- 172.21.15.148:0/1423365642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd42c103b60 0x7fd42c19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.212+0000 7fd4341c8640 1 -- 172.21.15.148:0/1423365642 >> 172.21.15.148:0/1423365642 conn(0x7fd42c07b850 msgr2=0x7fd42c107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:05.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.213+0000 7fd4341c8640 1 -- 172.21.15.148:0/1423365642 shutdown_connections 2024-09-21T01:13:05.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:05.213+0000 7fd4341c8640 1 -- 172.21.15.148:0/1423365642 wait complete. 2024-09-21T01:13:05.618 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:05.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:05 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1423365642' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T01:13:05.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:05 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1423365642' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T01:13:06.023 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:05 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1423365642' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T01:13:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.039+0000 7fe872816640 1 -- 172.21.15.148:0/2188731338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe86c102aa0 msgr2=0x7fe86c102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.039+0000 7fe872816640 1 --2- 172.21.15.148:0/2188731338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe86c102aa0 0x7fe86c102eb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009900 tx=0x7fe85c02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.039+0000 7fe872816640 1 -- 172.21.15.148:0/2188731338 shutdown_connections 2024-09-21T01:13:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.039+0000 7fe872816640 1 --2- 172.21.15.148:0/2188731338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe86c108d30 0x7fe86c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.039+0000 7fe872816640 1 --2- 172.21.15.148:0/2188731338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe86c1083e0 0x7fe86c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.039+0000 7fe872816640 1 --2- 172.21.15.148:0/2188731338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe86c102aa0 0x7fe86c102eb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.039+0000 7fe872816640 1 -- 172.21.15.148:0/2188731338 >> 172.21.15.148:0/2188731338 conn(0x7fe86c0797e0 msgr2=0x7fe86c079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.039+0000 7fe872816640 1 -- 172.21.15.148:0/2188731338 shutdown_connections 2024-09-21T01:13:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.039+0000 7fe872816640 1 -- 172.21.15.148:0/2188731338 wait complete. 2024-09-21T01:13:06.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe872816640 1 Processor -- start 2024-09-21T01:13:06.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe872816640 1 -- start start 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe872816640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe86c102aa0 0x7fe86c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe872816640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe86c1083e0 0x7fe86c199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe872816640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe86c108d30 0x7fe86c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe872816640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c1129a0 con 0x7fe86c1083e0 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe872816640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c112820 con 0x7fe86c102aa0 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe872816640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c112b20 con 0x7fe86c108d30 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe863fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe86c1083e0 0x7fe86c199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe863fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe86c1083e0 0x7fe86c199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53124/0 (socket says 172.21.15.148:53124) 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe863fff640 1 -- 172.21.15.148:0/1123694842 learned_addr learned my addr 172.21.15.148:0/1123694842 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.040+0000 7fe86bfff640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe86c102aa0 0x7fe86c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe870db3640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe86c108d30 0x7fe86c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe863fff640 1 -- 172.21.15.148:0/1123694842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe86c108d30 msgr2=0x7fe86c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:06.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe863fff640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe86c108d30 0x7fe86c19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:06.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe863fff640 1 -- 172.21.15.148:0/1123694842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe86c102aa0 msgr2=0x7fe86c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:06.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe863fff640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe86c102aa0 0x7fe86c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:06.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe863fff640 1 -- 172.21.15.148:0/1123694842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c19f300 con 0x7fe86c1083e0 2024-09-21T01:13:06.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe863fff640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe86c1083e0 0x7fe86c199930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe85400d740 tx=0x7fe85400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:06.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe869ffb640 1 -- 172.21.15.148:0/1123694842 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854017070 con 0x7fe86c1083e0 2024-09-21T01:13:06.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe869ffb640 1 -- 172.21.15.148:0/1123694842 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe85400de50 con 0x7fe86c1083e0 2024-09-21T01:13:06.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe872816640 1 -- 172.21.15.148:0/1123694842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c19f590 con 0x7fe86c1083e0 2024-09-21T01:13:06.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe869ffb640 1 -- 172.21.15.148:0/1123694842 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854004ce0 con 0x7fe86c1083e0 2024-09-21T01:13:06.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.041+0000 7fe872816640 1 -- 172.21.15.148:0/1123694842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c06b820 con 0x7fe86c1083e0 2024-09-21T01:13:06.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.043+0000 7fe872816640 1 -- 172.21.15.148:0/1123694842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c103d20 con 0x7fe86c1083e0 2024-09-21T01:13:06.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.044+0000 7fe869ffb640 1 -- 172.21.15.148:0/1123694842 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fe854004e80 con 0x7fe86c1083e0 2024-09-21T01:13:06.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.045+0000 7fe869ffb640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe8580b65a0 0x7fe8580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:06.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.045+0000 7fe86bfff640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe8580b65a0 0x7fe8580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:06.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.045+0000 7fe869ffb640 1 -- 172.21.15.148:0/1123694842 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fe8540e71c0 con 0x7fe86c1083e0 2024-09-21T01:13:06.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.046+0000 7fe86bfff640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe8580b65a0 0x7fe8580b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe85c031440 tx=0x7fe85c009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:06.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.049+0000 7fe869ffb640 1 -- 172.21.15.148:0/1123694842 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8540b1ce0 con 0x7fe86c1083e0 2024-09-21T01:13:06.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.240+0000 7fe872816640 1 -- 172.21.15.148:0/1123694842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe86c06c1b0 con 0x7fe86c1083e0 2024-09-21T01:13:06.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.240+0000 7fe869ffb640 1 -- 172.21.15.148:0/1123694842 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe8540b6c20 con 0x7fe86c1083e0 2024-09-21T01:13:06.241 INFO:teuthology.orchestra.run.smithi148.stdout:292057776151 2024-09-21T01:13:06.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.242+0000 7fe872816640 1 -- 172.21.15.148:0/1123694842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe8580b65a0 msgr2=0x7fe8580b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.242+0000 7fe872816640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe8580b65a0 0x7fe8580b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe85c031440 tx=0x7fe85c009560 comp rx=0 tx=0).stop 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.243+0000 7fe872816640 1 -- 172.21.15.148:0/1123694842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe86c1083e0 msgr2=0x7fe86c199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.243+0000 7fe872816640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe86c1083e0 0x7fe86c199930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe85400d740 tx=0x7fe85400dc00 comp rx=0 tx=0).stop 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.243+0000 7fe872816640 1 -- 172.21.15.148:0/1123694842 shutdown_connections 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.243+0000 7fe872816640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe8580b65a0 0x7fe8580b8ab0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.243+0000 7fe872816640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe86c1083e0 0x7fe86c199930 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.243+0000 7fe872816640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe86c108d30 0x7fe86c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.243+0000 7fe872816640 1 --2- 172.21.15.148:0/1123694842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe86c102aa0 0x7fe86c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.243+0000 7fe872816640 1 -- 172.21.15.148:0/1123694842 >> 172.21.15.148:0/1123694842 conn(0x7fe86c0797e0 msgr2=0x7fe86c101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.243+0000 7fe872816640 1 -- 172.21.15.148:0/1123694842 shutdown_connections 2024-09-21T01:13:06.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.243+0000 7fe872816640 1 -- 172.21.15.148:0/1123694842 wait complete. 2024-09-21T01:13:06.978 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:06 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1123694842' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T01:13:06.978 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:06 smithi148 ceph-mon[31000]: pgmap v312: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:06.978 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:06 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/346548831' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T01:13:06.979 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776149 got 292057776151 for osd.11 2024-09-21T01:13:06.979 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:06.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:06 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1123694842' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T01:13:06.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:06 smithi157 ceph-mon[34140]: pgmap v312: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:06.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:06 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/346548831' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T01:13:07.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.167+0000 7fb5621c6640 1 -- 172.21.15.148:0/1048440818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb55c105320 msgr2=0x7fb55c10d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.167+0000 7fb5621c6640 1 --2- 172.21.15.148:0/1048440818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb55c105320 0x7fb55c10d870 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb544009900 tx=0x7fb54402a410 comp rx=0 tx=0).stop 2024-09-21T01:13:07.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.167+0000 7fb5621c6640 1 -- 172.21.15.148:0/1048440818 shutdown_connections 2024-09-21T01:13:07.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.167+0000 7fb5621c6640 1 --2- 172.21.15.148:0/1048440818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb55c105320 0x7fb55c10d870 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.167+0000 7fb5621c6640 1 --2- 172.21.15.148:0/1048440818 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c10de30 0x7fb55c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.167+0000 7fb5621c6640 1 --2- 172.21.15.148:0/1048440818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb55c1049d0 0x7fb55c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.167+0000 7fb5621c6640 1 -- 172.21.15.148:0/1048440818 >> 172.21.15.148:0/1048440818 conn(0x7fb55c079740 msgr2=0x7fb55c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:07.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.167+0000 7fb5621c6640 1 -- 172.21.15.148:0/1048440818 shutdown_connections 2024-09-21T01:13:07.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.167+0000 7fb5621c6640 1 -- 172.21.15.148:0/1048440818 wait complete. 2024-09-21T01:13:07.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.167+0000 7fb5621c6640 1 Processor -- start 2024-09-21T01:13:07.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb5621c6640 1 -- start start 2024-09-21T01:13:07.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb5621c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb55c1049d0 0x7fb55c102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb5621c6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c105320 0x7fb55c102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb5621c6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb55c10de30 0x7fb55c103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb5621c6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c113a90 con 0x7fb55c1049d0 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb5621c6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c113910 con 0x7fb55c105320 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb5621c6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c113c10 con 0x7fb55c10de30 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb55b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb55c1049d0 0x7fb55c102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb55b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb55c1049d0 0x7fb55c102710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52202/0 (socket says 172.21.15.148:52202) 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb55b7fe640 1 -- 172.21.15.148:0/3336507247 learned_addr learned my addr 172.21.15.148:0/3336507247 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb55bfff640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb55c10de30 0x7fb55c103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb552ffd640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c105320 0x7fb55c102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb55b7fe640 1 -- 172.21.15.148:0/3336507247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb55c10de30 msgr2=0x7fb55c103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb55b7fe640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb55c10de30 0x7fb55c103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb55b7fe640 1 -- 172.21.15.148:0/3336507247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c105320 msgr2=0x7fb55c102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb55b7fe640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c105320 0x7fb55c102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb55b7fe640 1 -- 172.21.15.148:0/3336507247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c1a8740 con 0x7fb55c1049d0 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.168+0000 7fb552ffd640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c105320 0x7fb55c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:07.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.169+0000 7fb55b7fe640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb55c1049d0 0x7fb55c102710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00d950 tx=0x7fb54c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:07.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.169+0000 7fb5597fa640 1 -- 172.21.15.148:0/3336507247 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c017070 con 0x7fb55c1049d0 2024-09-21T01:13:07.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.169+0000 7fb5621c6640 1 -- 172.21.15.148:0/3336507247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55c1a8a30 con 0x7fb55c1049d0 2024-09-21T01:13:07.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.169+0000 7fb5597fa640 1 -- 172.21.15.148:0/3336507247 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb54c009c30 con 0x7fb55c1049d0 2024-09-21T01:13:07.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.169+0000 7fb5597fa640 1 -- 172.21.15.148:0/3336507247 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00f620 con 0x7fb55c1049d0 2024-09-21T01:13:07.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.169+0000 7fb5621c6640 1 -- 172.21.15.148:0/3336507247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55c1a8ef0 con 0x7fb55c1049d0 2024-09-21T01:13:07.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.170+0000 7fb5621c6640 1 -- 172.21.15.148:0/3336507247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55c104de0 con 0x7fb55c1049d0 2024-09-21T01:13:07.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.171+0000 7fb5597fa640 1 -- 172.21.15.148:0/3336507247 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fb54c01a070 con 0x7fb55c1049d0 2024-09-21T01:13:07.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.172+0000 7fb5597fa640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5480b65a0 0x7fb5480b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.173+0000 7fb552ffd640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5480b65a0 0x7fb5480b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.173+0000 7fb5597fa640 1 -- 172.21.15.148:0/3336507247 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fb54c0e6f10 con 0x7fb55c1049d0 2024-09-21T01:13:07.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.173+0000 7fb552ffd640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5480b65a0 0x7fb5480b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb544009230 tx=0x7fb544000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:07.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.176+0000 7fb5597fa640 1 -- 172.21.15.148:0/3336507247 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb54c009de0 con 0x7fb55c1049d0 2024-09-21T01:13:07.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:06 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1123694842' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T01:13:07.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:06 smithi181 ceph-mon[34811]: pgmap v312: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:07.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:06 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/346548831' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T01:13:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.259+0000 7fd9899cf640 1 -- 172.21.15.148:0/2791566288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd984101f70 msgr2=0x7fd984102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.259+0000 7fd9899cf640 1 --2- 172.21.15.148:0/2791566288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd984101f70 0x7fd984102380 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd974009900 tx=0x7fd97402a410 comp rx=0 tx=0).stop 2024-09-21T01:13:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.259+0000 7fd9899cf640 1 -- 172.21.15.148:0/2791566288 shutdown_connections 2024-09-21T01:13:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.259+0000 7fd9899cf640 1 --2- 172.21.15.148:0/2791566288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd984109e00 0x7fd984110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.259+0000 7fd9899cf640 1 --2- 172.21.15.148:0/2791566288 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9841094b0 0x7fd9841098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.259+0000 7fd9899cf640 1 --2- 172.21.15.148:0/2791566288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd984101f70 0x7fd984102380 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.259+0000 7fd9899cf640 1 -- 172.21.15.148:0/2791566288 >> 172.21.15.148:0/2791566288 conn(0x7fd984077c60 msgr2=0x7fd9840780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.260+0000 7fd9899cf640 1 -- 172.21.15.148:0/2791566288 shutdown_connections 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.260+0000 7fd9899cf640 1 -- 172.21.15.148:0/2791566288 wait complete. 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.260+0000 7fd9899cf640 1 Processor -- start 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd9899cf640 1 -- start start 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd9899cf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd984101f70 0x7fd98419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd9899cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9841094b0 0x7fd98419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd9899cf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd984109e00 0x7fd98419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd9899cf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd984113ac0 con 0x7fd984101f70 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd9899cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd984113940 con 0x7fd9841094b0 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd9899cf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd984113c40 con 0x7fd984109e00 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd984101f70 0x7fd98419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd982ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd984101f70 0x7fd98419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52184/0 (socket says 172.21.15.148:52184) 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd982ffd640 1 -- 172.21.15.148:0/346548831 learned_addr learned my addr 172.21.15.148:0/346548831 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd9837fe640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd984109e00 0x7fd98419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd9827fc640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9841094b0 0x7fd98419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd982ffd640 1 -- 172.21.15.148:0/346548831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd984109e00 msgr2=0x7fd98419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd982ffd640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd984109e00 0x7fd98419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd982ffd640 1 -- 172.21.15.148:0/346548831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9841094b0 msgr2=0x7fd98419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd982ffd640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9841094b0 0x7fd98419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.261+0000 7fd982ffd640 1 -- 172.21.15.148:0/346548831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9841a0360 con 0x7fd984101f70 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.262+0000 7fd982ffd640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd984101f70 0x7fd98419a4b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd974006010 tx=0x7fd9740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.262+0000 7fd9889cd640 1 -- 172.21.15.148:0/346548831 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97403f030 con 0x7fd984101f70 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.262+0000 7fd9899cf640 1 -- 172.21.15.148:0/346548831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9841a05f0 con 0x7fd984101f70 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.262+0000 7fd9889cd640 1 -- 172.21.15.148:0/346548831 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd974003800 con 0x7fd984101f70 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.262+0000 7fd9889cd640 1 -- 172.21.15.148:0/346548831 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974035070 con 0x7fd984101f70 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.262+0000 7fd9899cf640 1 -- 172.21.15.148:0/346548831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9841a0b20 con 0x7fd984101f70 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.263+0000 7fd9899cf640 1 -- 172.21.15.148:0/346548831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd984102380 con 0x7fd984101f70 2024-09-21T01:13:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.265+0000 7fd9889cd640 1 -- 172.21.15.148:0/346548831 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fd974003cb0 con 0x7fd984101f70 2024-09-21T01:13:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.266+0000 7fd9889cd640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd96c0b65d0 0x7fd96c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.266+0000 7fd9827fc640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd96c0b65d0 0x7fd96c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.266+0000 7fd9889cd640 1 -- 172.21.15.148:0/346548831 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fd974107fe0 con 0x7fd984101f70 2024-09-21T01:13:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.267+0000 7fd9827fc640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd96c0b65d0 0x7fd96c0b8ae0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd984109170 tx=0x7fd97800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.270+0000 7fd9889cd640 1 -- 172.21.15.148:0/346548831 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9841a0b20 con 0x7fd984101f70 2024-09-21T01:13:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.473+0000 7fd9899cf640 1 -- 172.21.15.148:0/346548831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd98410b640 con 0x7fd984101f70 2024-09-21T01:13:07.314 INFO:teuthology.orchestra.run.smithi148.stdout:133143986234 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.473+0000 7fd9889cd640 1 -- 172.21.15.148:0/346548831 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd9740d2b00 con 0x7fd984101f70 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 -- 172.21.15.148:0/346548831 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd96c0b65d0 msgr2=0x7fd96c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd96c0b65d0 0x7fd96c0b8ae0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd984109170 tx=0x7fd97800a2d0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 -- 172.21.15.148:0/346548831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd984101f70 msgr2=0x7fd98419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd984101f70 0x7fd98419a4b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd974006010 tx=0x7fd9740042f0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 -- 172.21.15.148:0/346548831 shutdown_connections 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd96c0b65d0 0x7fd96c0b8ae0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd984109e00 0x7fd98419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9841094b0 0x7fd98419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 --2- 172.21.15.148:0/346548831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd984101f70 0x7fd98419a4b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 -- 172.21.15.148:0/346548831 >> 172.21.15.148:0/346548831 conn(0x7fd984077c60 msgr2=0x7fd984107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 -- 172.21.15.148:0/346548831 shutdown_connections 2024-09-21T01:13:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:06.476+0000 7fd9899cf640 1 -- 172.21.15.148:0/346548831 wait complete. 2024-09-21T01:13:07.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.368+0000 7fb5621c6640 1 -- 172.21.15.148:0/3336507247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb55c02e640 con 0x7fb55c1049d0 2024-09-21T01:13:07.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.368+0000 7fb5597fa640 1 -- 172.21.15.148:0/3336507247 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb54c0ad5f0 con 0x7fb55c1049d0 2024-09-21T01:13:07.369 INFO:teuthology.orchestra.run.smithi148.stdout:55834574920 2024-09-21T01:13:07.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 -- 172.21.15.148:0/3336507247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5480b65a0 msgr2=0x7fb5480b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5480b65a0 0x7fb5480b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb544009230 tx=0x7fb544000bc0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 -- 172.21.15.148:0/3336507247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb55c1049d0 msgr2=0x7fb55c102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb55c1049d0 0x7fb55c102710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00d950 tx=0x7fb54c00de10 comp rx=0 tx=0).stop 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 -- 172.21.15.148:0/3336507247 shutdown_connections 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5480b65a0 0x7fb5480b8ab0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb55c10de30 0x7fb55c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c105320 0x7fb55c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 --2- 172.21.15.148:0/3336507247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb55c1049d0 0x7fb55c102710 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 -- 172.21.15.148:0/3336507247 >> 172.21.15.148:0/3336507247 conn(0x7fb55c079740 msgr2=0x7fb55c100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 -- 172.21.15.148:0/3336507247 shutdown_connections 2024-09-21T01:13:07.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:07.371+0000 7fb5621c6640 1 -- 172.21.15.148:0/3336507247 wait complete. 2024-09-21T01:13:07.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:07 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:07.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:07 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3336507247' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T01:13:07.918 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986232 got 133143986234 for osd.4 2024-09-21T01:13:07.918 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:07.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:07 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:07.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:07 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3336507247' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T01:13:07.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:07 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:07.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:07 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3336507247' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T01:13:08.505 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738442 got 34359738445 for osd.0 2024-09-21T01:13:08.505 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:08.650 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:08.971 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103199 got 249108103201 for osd.9 2024-09-21T01:13:08.971 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:08.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:08 smithi157 ceph-mon[34140]: pgmap v313: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:08.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:08 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:08.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:08 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:09.016 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:08 smithi148 ceph-mon[31000]: pgmap v313: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:09.016 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:08 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:09.016 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:08 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:09.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.106+0000 7f46e12c1640 1 -- 172.21.15.148:0/1359004192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46dc102a80 msgr2=0x7f46dc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:09.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.106+0000 7f46e12c1640 1 --2- 172.21.15.148:0/1359004192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46dc102a80 0x7f46dc102e90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009900 tx=0x7f46cc02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:09.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.107+0000 7f46e12c1640 1 -- 172.21.15.148:0/1359004192 shutdown_connections 2024-09-21T01:13:09.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.107+0000 7f46e12c1640 1 --2- 172.21.15.148:0/1359004192 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46dc108d10 0x7f46dc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.107+0000 7f46e12c1640 1 --2- 172.21.15.148:0/1359004192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1083c0 0x7f46dc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.107+0000 7f46e12c1640 1 --2- 172.21.15.148:0/1359004192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46dc102a80 0x7f46dc102e90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.107+0000 7f46e12c1640 1 -- 172.21.15.148:0/1359004192 >> 172.21.15.148:0/1359004192 conn(0x7f46dc079740 msgr2=0x7f46dc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:09.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.107+0000 7f46e12c1640 1 -- 172.21.15.148:0/1359004192 shutdown_connections 2024-09-21T01:13:09.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.107+0000 7f46e12c1640 1 -- 172.21.15.148:0/1359004192 wait complete. 2024-09-21T01:13:09.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.107+0000 7f46e12c1640 1 Processor -- start 2024-09-21T01:13:09.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.108+0000 7f46e12c1640 1 -- start start 2024-09-21T01:13:09.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.108+0000 7f46e12c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46dc102a80 0x7f46dc10bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:09.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.108+0000 7f46e12c1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1083c0 0x7f46dc10c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:09.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.108+0000 7f46e12c1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46dc108d10 0x7f46dc1ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:09.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.108+0000 7f46e12c1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc111950 con 0x7f46dc102a80 2024-09-21T01:13:09.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.108+0000 7f46e12c1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc1117d0 con 0x7f46dc1083c0 2024-09-21T01:13:09.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.108+0000 7f46e12c1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc111ad0 con 0x7f46dc108d10 2024-09-21T01:13:09.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46daffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46dc102a80 0x7f46dc10bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:09.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46daffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46dc102a80 0x7f46dc10bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52220/0 (socket says 172.21.15.148:52220) 2024-09-21T01:13:09.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46daffd640 1 -- 172.21.15.148:0/3475936209 learned_addr learned my addr 172.21.15.148:0/3475936209 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:09.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46da7fc640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1083c0 0x7f46dc10c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:09.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46db7fe640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46dc108d10 0x7f46dc1ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46daffd640 1 -- 172.21.15.148:0/3475936209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46dc108d10 msgr2=0x7f46dc1ac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46daffd640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46dc108d10 0x7f46dc1ac7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46daffd640 1 -- 172.21.15.148:0/3475936209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1083c0 msgr2=0x7f46dc10c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46daffd640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1083c0 0x7f46dc10c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46daffd640 1 -- 172.21.15.148:0/3475936209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc1acd10 con 0x7f46dc102a80 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46da7fc640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1083c0 0x7f46dc10c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46daffd640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46dc102a80 0x7f46dc10bd20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f46cc006010 tx=0x7f46cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.109+0000 7f46c3fff640 1 -- 172.21.15.148:0/3475936209 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc03f030 con 0x7f46dc102a80 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.110+0000 7f46e12c1640 1 -- 172.21.15.148:0/3475936209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46dc1acf40 con 0x7f46dc102a80 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.110+0000 7f46e12c1640 1 -- 172.21.15.148:0/3475936209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46dc1ad470 con 0x7f46dc102a80 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.110+0000 7f46c3fff640 1 -- 172.21.15.148:0/3475936209 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46cc003800 con 0x7f46dc102a80 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.110+0000 7f46c3fff640 1 -- 172.21.15.148:0/3475936209 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc035070 con 0x7f46dc102a80 2024-09-21T01:13:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.111+0000 7f46e12c1640 1 -- 172.21.15.148:0/3475936209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c8005290 con 0x7f46dc102a80 2024-09-21T01:13:09.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.113+0000 7f46c3fff640 1 -- 172.21.15.148:0/3475936209 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f46cc031b10 con 0x7f46dc102a80 2024-09-21T01:13:09.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.114+0000 7f46c3fff640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f46c40b6620 0x7f46c40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:09.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.115+0000 7f46da7fc640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f46c40b6620 0x7f46c40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:09.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.115+0000 7f46c3fff640 1 -- 172.21.15.148:0/3475936209 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f46cc107dd0 con 0x7f46dc102a80 2024-09-21T01:13:09.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.115+0000 7f46da7fc640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f46c40b6620 0x7f46c40b8b30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f46dc100e20 tx=0x7f46d0009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:09.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.117+0000 7f46c3fff640 1 -- 172.21.15.148:0/3475936209 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46cc0ce4b0 con 0x7f46dc102a80 2024-09-21T01:13:09.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:08 smithi181 ceph-mon[34811]: pgmap v313: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:09.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:08 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:09.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:08 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.299+0000 7f46e12c1640 1 -- 172.21.15.148:0/3475936209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f46c8005850 con 0x7f46dc102a80 2024-09-21T01:13:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.300+0000 7f46c3fff640 1 -- 172.21.15.148:0/3475936209 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f46cc0d2890 con 0x7f46dc102a80 2024-09-21T01:13:09.301 INFO:teuthology.orchestra.run.smithi148.stdout:180388626481 2024-09-21T01:13:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 -- 172.21.15.148:0/3475936209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f46c40b6620 msgr2=0x7f46c40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f46c40b6620 0x7f46c40b8b30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f46dc100e20 tx=0x7f46d0009110 comp rx=0 tx=0).stop 2024-09-21T01:13:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 -- 172.21.15.148:0/3475936209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46dc102a80 msgr2=0x7f46dc10bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46dc102a80 0x7f46dc10bd20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f46cc006010 tx=0x7f46cc0042f0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 -- 172.21.15.148:0/3475936209 shutdown_connections 2024-09-21T01:13:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f46c40b6620 0x7f46c40b8b30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46dc108d10 0x7f46dc1ac7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1083c0 0x7f46dc10c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 --2- 172.21.15.148:0/3475936209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46dc102a80 0x7f46dc10bd20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 -- 172.21.15.148:0/3475936209 >> 172.21.15.148:0/3475936209 conn(0x7f46dc079740 msgr2=0x7f46dc101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:09.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 -- 172.21.15.148:0/3475936209 shutdown_connections 2024-09-21T01:13:09.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.302+0000 7f46e12c1640 1 -- 172.21.15.148:0/3475936209 wait complete. 2024-09-21T01:13:09.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.772+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1628910357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcd4102a70 msgr2=0x7fbcd4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.772+0000 7fbcd8d3d640 1 --2- 172.21.15.148:0/1628910357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcd4102a70 0x7fbcd4102e80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009900 tx=0x7fbcc402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.772+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1628910357 shutdown_connections 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.772+0000 7fbcd8d3d640 1 --2- 172.21.15.148:0/1628910357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcd4108d00 0x7fbcd410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.772+0000 7fbcd8d3d640 1 --2- 172.21.15.148:0/1628910357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcd41083b0 0x7fbcd41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.772+0000 7fbcd8d3d640 1 --2- 172.21.15.148:0/1628910357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcd4102a70 0x7fbcd4102e80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.772+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1628910357 >> 172.21.15.148:0/1628910357 conn(0x7fbcd4079730 msgr2=0x7fbcd4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.772+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1628910357 shutdown_connections 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.772+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1628910357 wait complete. 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd8d3d640 1 Processor -- start 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd8d3d640 1 -- start start 2024-09-21T01:13:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd8d3d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcd4102a70 0x7fbcd419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd8d3d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcd41083b0 0x7fbcd419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd8d3d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcd4108d00 0x7fbcd419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd8d3d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4112970 con 0x7fbcd41083b0 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd8d3d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd41127f0 con 0x7fbcd4102a70 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd8d3d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4112af0 con 0x7fbcd4108d00 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcd41083b0 0x7fbcd419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcd41083b0 0x7fbcd419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52250/0 (socket says 172.21.15.148:52250) 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd1d9b640 1 -- 172.21.15.148:0/1172143759 learned_addr learned my addr 172.21.15.148:0/1172143759 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd259c640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcd4102a70 0x7fbcd419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd1d9b640 1 -- 172.21.15.148:0/1172143759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcd4108d00 msgr2=0x7fbcd419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd1d9b640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcd4108d00 0x7fbcd419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd1d9b640 1 -- 172.21.15.148:0/1172143759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcd4102a70 msgr2=0x7fbcd419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd1d9b640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcd4102a70 0x7fbcd419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.773+0000 7fbcd1d9b640 1 -- 172.21.15.148:0/1172143759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd41a02c0 con 0x7fbcd41083b0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.774+0000 7fbcd1d9b640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcd41083b0 0x7fbcd419a9b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800c970 tx=0x7fbcc800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.774+0000 7fbcc37fe640 1 -- 172.21.15.148:0/1172143759 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8014070 con 0x7fbcd41083b0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.774+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1172143759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd41a05b0 con 0x7fbcd41083b0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.774+0000 7fbcc37fe640 1 -- 172.21.15.148:0/1172143759 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc8004440 con 0x7fbcd41083b0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.774+0000 7fbcc37fe640 1 -- 172.21.15.148:0/1172143759 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8003e50 con 0x7fbcd41083b0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.774+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1172143759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd41a6dd0 con 0x7fbcd41083b0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.775+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1172143759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd4103cf0 con 0x7fbcd41083b0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.777+0000 7fbcc37fe640 1 -- 172.21.15.148:0/1172143759 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fbcc8017070 con 0x7fbcd41083b0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.778+0000 7fbcc37fe640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbcbc0b6770 0x7fbcbc0b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.778+0000 7fbcd259c640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbcbc0b6770 0x7fbcbc0b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.778+0000 7fbcc37fe640 1 -- 172.21.15.148:0/1172143759 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fbcc80e7830 con 0x7fbcd41083b0 2024-09-21T01:13:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.778+0000 7fbcd259c640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbcbc0b6770 0x7fbcbc0b8c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4031440 tx=0x7fbcc4005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:09.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.781+0000 7fbcc37fe640 1 -- 172.21.15.148:0/1172143759 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbcc801e030 con 0x7fbcd41083b0 2024-09-21T01:13:09.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.965+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1172143759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbcd4102e80 con 0x7fbcd41083b0 2024-09-21T01:13:09.967 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:09.967 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:09 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:09.967 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:09 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3475936209' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T01:13:09.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.966+0000 7fbcc37fe640 1 -- 172.21.15.148:0/1172143759 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbcc80035f0 con 0x7fbcd41083b0 2024-09-21T01:13:09.967 INFO:teuthology.orchestra.run.smithi148.stdout:111669149758 2024-09-21T01:13:09.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.968+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1172143759 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbcbc0b6770 msgr2=0x7fbcbc0b8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:09.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.968+0000 7fbcd8d3d640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbcbc0b6770 0x7fbcbc0b8c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4031440 tx=0x7fbcc4005d50 comp rx=0 tx=0).stop 2024-09-21T01:13:09.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.968+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1172143759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcd41083b0 msgr2=0x7fbcd419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:09.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.968+0000 7fbcd8d3d640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcd41083b0 0x7fbcd419a9b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800c970 tx=0x7fbcc800ce30 comp rx=0 tx=0).stop 2024-09-21T01:13:09.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.968+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1172143759 shutdown_connections 2024-09-21T01:13:09.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.968+0000 7fbcd8d3d640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fbcbc0b6770 0x7fbcbc0b8c80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.968+0000 7fbcd8d3d640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcd41083b0 0x7fbcd419a9b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.968+0000 7fbcd8d3d640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbcd4108d00 0x7fbcd419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.968+0000 7fbcd8d3d640 1 --2- 172.21.15.148:0/1172143759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcd4102a70 0x7fbcd419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:09.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.968+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1172143759 >> 172.21.15.148:0/1172143759 conn(0x7fbcd4079730 msgr2=0x7fbcd4101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:09.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.969+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1172143759 shutdown_connections 2024-09-21T01:13:09.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:09.969+0000 7fbcd8d3d640 1 -- 172.21.15.148:0/1172143759 wait complete. 2024-09-21T01:13:10.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:10.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:09 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:10.231 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:09 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3475936209' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T01:13:10.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:10.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:09 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:10.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:09 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3475936209' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T01:13:10.261 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626478 got 180388626481 for osd.6 2024-09-21T01:13:10.261 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:10.654 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411396 got 77309411397 for osd.2 2024-09-21T01:13:10.655 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:10.681 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:10.681 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:11.047 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:10 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1172143759' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T01:13:11.047 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:10 smithi148 ceph-mon[31000]: pgmap v314: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:11.075 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574917 got 55834574920 for osd.1 2024-09-21T01:13:11.075 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:11.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:10 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1172143759' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T01:13:11.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:10 smithi181 ceph-mon[34811]: pgmap v314: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:11.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:10 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1172143759' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T01:13:11.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:10 smithi157 ceph-mon[34140]: pgmap v314: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:13:11.730 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149754 got 111669149758 for osd.3 2024-09-21T01:13:11.730 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.390+0000 7f358954c640 1 -- 172.21.15.148:0/1121845532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3584109eb0 msgr2=0x7f35841106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.390+0000 7f358954c640 1 --2- 172.21.15.148:0/1121845532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3584109eb0 0x7f35841106e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f357c009ca0 tx=0x7f357c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.390+0000 7f358954c640 1 -- 172.21.15.148:0/1121845532 shutdown_connections 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.390+0000 7f358954c640 1 --2- 172.21.15.148:0/1121845532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3584109eb0 0x7f35841106e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.390+0000 7f358954c640 1 --2- 172.21.15.148:0/1121845532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3584109560 0x7f3584109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.390+0000 7f358954c640 1 --2- 172.21.15.148:0/1121845532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584102080 0x7f3584102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.390+0000 7f358954c640 1 -- 172.21.15.148:0/1121845532 >> 172.21.15.148:0/1121845532 conn(0x7f3584079ec0 msgr2=0x7f358407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.390+0000 7f358954c640 1 -- 172.21.15.148:0/1121845532 shutdown_connections 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.390+0000 7f358954c640 1 -- 172.21.15.148:0/1121845532 wait complete. 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.390+0000 7f358954c640 1 Processor -- start 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f358954c640 1 -- start start 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f358954c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3584102080 0x7f358419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f358954c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584109560 0x7f358419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f358954c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3584109eb0 0x7f358419fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f358954c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3584113bd0 con 0x7f3584102080 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f358954c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3584113a50 con 0x7f3584109560 2024-09-21T01:13:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f358954c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3584113d50 con 0x7f3584109eb0 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f3582ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3584102080 0x7f358419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f3582ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3584102080 0x7f358419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52272/0 (socket says 172.21.15.148:52272) 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f3582ffd640 1 -- 172.21.15.148:0/2943515471 learned_addr learned my addr 172.21.15.148:0/2943515471 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f35837fe640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3584109eb0 0x7f358419fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f35827fc640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584109560 0x7f358419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f3582ffd640 1 -- 172.21.15.148:0/2943515471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3584109eb0 msgr2=0x7f358419fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f3582ffd640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3584109eb0 0x7f358419fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f3582ffd640 1 -- 172.21.15.148:0/2943515471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584109560 msgr2=0x7f358419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f3582ffd640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584109560 0x7f358419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.391+0000 7f3582ffd640 1 -- 172.21.15.148:0/2943515471 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35841a05b0 con 0x7f3584102080 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.392+0000 7f3582ffd640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3584102080 0x7f358419a640 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f357400b4a0 tx=0x7f357400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.392+0000 7f356bfff640 1 -- 172.21.15.148:0/2943515471 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574014070 con 0x7f3584102080 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.392+0000 7f358954c640 1 -- 172.21.15.148:0/2943515471 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35841a08a0 con 0x7f3584102080 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.392+0000 7f356bfff640 1 -- 172.21.15.148:0/2943515471 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3574010ac0 con 0x7f3584102080 2024-09-21T01:13:12.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.392+0000 7f358954c640 1 -- 172.21.15.148:0/2943515471 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35841a7000 con 0x7f3584102080 2024-09-21T01:13:12.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.392+0000 7f356bfff640 1 -- 172.21.15.148:0/2943515471 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574017c30 con 0x7f3584102080 2024-09-21T01:13:12.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.393+0000 7f358954c640 1 -- 172.21.15.148:0/2943515471 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3584102490 con 0x7f3584102080 2024-09-21T01:13:12.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.395+0000 7f356bfff640 1 -- 172.21.15.148:0/2943515471 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f3574017070 con 0x7f3584102080 2024-09-21T01:13:12.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.395+0000 7f356bfff640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f356c0b65a0 0x7f356c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:12.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.395+0000 7f35827fc640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f356c0b65a0 0x7f356c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:12.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.395+0000 7f356bfff640 1 -- 172.21.15.148:0/2943515471 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f35740e6c90 con 0x7f3584102080 2024-09-21T01:13:12.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.396+0000 7f35827fc640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f356c0b65a0 0x7f356c0b8ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3578005fd0 tx=0x7f3578005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:12.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.398+0000 7f356bfff640 1 -- 172.21.15.148:0/2943515471 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35740ad3d0 con 0x7f3584102080 2024-09-21T01:13:12.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.583+0000 7f358954c640 1 -- 172.21.15.148:0/2943515471 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f358410bca0 con 0x7f3584102080 2024-09-21T01:13:12.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.583+0000 7f356bfff640 1 -- 172.21.15.148:0/2943515471 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f35740b17b0 con 0x7f3584102080 2024-09-21T01:13:12.584 INFO:teuthology.orchestra.run.smithi148.stdout:158913790008 2024-09-21T01:13:12.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 -- 172.21.15.148:0/2943515471 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f356c0b65a0 msgr2=0x7f356c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:12.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f356c0b65a0 0x7f356c0b8ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3578005fd0 tx=0x7f3578005850 comp rx=0 tx=0).stop 2024-09-21T01:13:12.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 -- 172.21.15.148:0/2943515471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3584102080 msgr2=0x7f358419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:12.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3584102080 0x7f358419a640 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f357400b4a0 tx=0x7f357400b960 comp rx=0 tx=0).stop 2024-09-21T01:13:12.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 -- 172.21.15.148:0/2943515471 shutdown_connections 2024-09-21T01:13:12.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f356c0b65a0 0x7f356c0b8ab0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3584109eb0 0x7f358419fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584109560 0x7f358419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 --2- 172.21.15.148:0/2943515471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3584102080 0x7f358419a640 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 -- 172.21.15.148:0/2943515471 >> 172.21.15.148:0/2943515471 conn(0x7f3584079ec0 msgr2=0x7f35841075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:12.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 -- 172.21.15.148:0/2943515471 shutdown_connections 2024-09-21T01:13:12.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.586+0000 7f358954c640 1 -- 172.21.15.148:0/2943515471 wait complete. 2024-09-21T01:13:12.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.618+0000 7fd010c58640 1 -- 172.21.15.148:0/974966464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd00c108cf0 msgr2=0x7fd00c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:12.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.618+0000 7fd010c58640 1 --2- 172.21.15.148:0/974966464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd00c108cf0 0x7fd00c10f520 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd004009ca0 tx=0x7fd00402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.618+0000 7fd010c58640 1 -- 172.21.15.148:0/974966464 shutdown_connections 2024-09-21T01:13:12.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.618+0000 7fd010c58640 1 --2- 172.21.15.148:0/974966464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd00c108cf0 0x7fd00c10f520 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.618+0000 7fd010c58640 1 --2- 172.21.15.148:0/974966464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c1083a0 0x7fd00c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.618+0000 7fd010c58640 1 --2- 172.21.15.148:0/974966464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c102a60 0x7fd00c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.618+0000 7fd010c58640 1 -- 172.21.15.148:0/974966464 >> 172.21.15.148:0/974966464 conn(0x7fd00c079730 msgr2=0x7fd00c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.618+0000 7fd010c58640 1 -- 172.21.15.148:0/974966464 shutdown_connections 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.618+0000 7fd010c58640 1 -- 172.21.15.148:0/974966464 wait complete. 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd010c58640 1 Processor -- start 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd010c58640 1 -- start start 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd010c58640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd00c102a60 0x7fd00c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd010c58640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1083a0 0x7fd00c1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd010c58640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c108cf0 0x7fd00c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd010c58640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c112960 con 0x7fd00c102a60 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd010c58640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c1127e0 con 0x7fd00c1083a0 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd010c58640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c112ae0 con 0x7fd00c108cf0 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd00a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd00c102a60 0x7fd00c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd00a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd00c102a60 0x7fd00c199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52296/0 (socket says 172.21.15.148:52296) 2024-09-21T01:13:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd00a59c640 1 -- 172.21.15.148:0/3444604669 learned_addr learned my addr 172.21.15.148:0/3444604669 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd00ad9d640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c108cf0 0x7fd00c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.619+0000 7fd001d9b640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1083a0 0x7fd00c1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd00a59c640 1 -- 172.21.15.148:0/3444604669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c108cf0 msgr2=0x7fd00c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd00a59c640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c108cf0 0x7fd00c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd00a59c640 1 -- 172.21.15.148:0/3444604669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1083a0 msgr2=0x7fd00c1998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd00a59c640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1083a0 0x7fd00c1998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd00a59c640 1 -- 172.21.15.148:0/3444604669 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00c19f2c0 con 0x7fd00c102a60 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd00ad9d640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c108cf0 0x7fd00c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd00a59c640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd00c102a60 0x7fd00c199350 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00e9f0 tx=0x7fcffc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd003fff640 1 -- 172.21.15.148:0/3444604669 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00cd80 con 0x7fd00c102a60 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd003fff640 1 -- 172.21.15.148:0/3444604669 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcffc0108e0 con 0x7fd00c102a60 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd010c58640 1 -- 172.21.15.148:0/3444604669 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00c19f5b0 con 0x7fd00c102a60 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd003fff640 1 -- 172.21.15.148:0/3444604669 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc018980 con 0x7fd00c102a60 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.620+0000 7fd010c58640 1 -- 172.21.15.148:0/3444604669 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00c06ae60 con 0x7fd00c102a60 2024-09-21T01:13:12.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.621+0000 7fd010c58640 1 -- 172.21.15.148:0/3444604669 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00c102e70 con 0x7fd00c102a60 2024-09-21T01:13:12.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.623+0000 7fd003fff640 1 -- 172.21.15.148:0/3444604669 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fcffc010430 con 0x7fd00c102a60 2024-09-21T01:13:12.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.623+0000 7fd003fff640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcff80b6620 0x7fcff80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:12.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.623+0000 7fd001d9b640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcff80b6620 0x7fcff80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:12.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.623+0000 7fd003fff640 1 -- 172.21.15.148:0/3444604669 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fcffc0e7d20 con 0x7fd00c102a60 2024-09-21T01:13:12.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.624+0000 7fd001d9b640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcff80b6620 0x7fcff80b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcff4005d70 tx=0x7fcff4005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:12.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.627+0000 7fd003fff640 1 -- 172.21.15.148:0/3444604669 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcffc0ae460 con 0x7fd00c102a60 2024-09-21T01:13:12.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.811+0000 7fd010c58640 1 -- 172.21.15.148:0/3444604669 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fd00c06b9b0 con 0x7fd00c102a60 2024-09-21T01:13:12.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.811+0000 7fd003fff640 1 -- 172.21.15.148:0/3444604669 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcffc0b2840 con 0x7fd00c102a60 2024-09-21T01:13:12.812 INFO:teuthology.orchestra.run.smithi148.stdout:223338299432 2024-09-21T01:13:12.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.813+0000 7fd010c58640 1 -- 172.21.15.148:0/3444604669 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcff80b6620 msgr2=0x7fcff80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.813+0000 7fd010c58640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcff80b6620 0x7fcff80b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcff4005d70 tx=0x7fcff4005d00 comp rx=0 tx=0).stop 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.814+0000 7fd010c58640 1 -- 172.21.15.148:0/3444604669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd00c102a60 msgr2=0x7fd00c199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.814+0000 7fd010c58640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd00c102a60 0x7fd00c199350 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00e9f0 tx=0x7fcffc00eeb0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.814+0000 7fd010c58640 1 -- 172.21.15.148:0/3444604669 shutdown_connections 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.814+0000 7fd010c58640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcff80b6620 0x7fcff80b8b30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.814+0000 7fd010c58640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd00c108cf0 0x7fd00c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.814+0000 7fd010c58640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd00c1083a0 0x7fd00c1998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.814+0000 7fd010c58640 1 --2- 172.21.15.148:0/3444604669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd00c102a60 0x7fd00c199350 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.814+0000 7fd010c58640 1 -- 172.21.15.148:0/3444604669 >> 172.21.15.148:0/3444604669 conn(0x7fd00c079730 msgr2=0x7fd00c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.814+0000 7fd010c58640 1 -- 172.21.15.148:0/3444604669 shutdown_connections 2024-09-21T01:13:12.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:12.814+0000 7fd010c58640 1 -- 172.21.15.148:0/3444604669 wait complete. 2024-09-21T01:13:13.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:13 smithi148 ceph-mon[31000]: pgmap v315: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T01:13:13.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:13 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2943515471' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T01:13:13.422 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:13 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3444604669' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T01:13:13.452 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299429 got 223338299432 for osd.8 2024-09-21T01:13:13.452 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:13.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:13 smithi181 ceph-mon[34811]: pgmap v315: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T01:13:13.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:13 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2943515471' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T01:13:13.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:13 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3444604669' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T01:13:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:13 smithi157 ceph-mon[34140]: pgmap v315: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T01:13:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:13 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2943515471' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T01:13:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:13 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3444604669' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T01:13:13.848 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790005 got 158913790008 for osd.5 2024-09-21T01:13:13.848 DEBUG:teuthology.parallel:result is None 2024-09-21T01:13:13.849 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T01:13:13.849 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:13:14.778 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.254+0000 7f2f21161640 1 -- 172.21.15.148:0/684774612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f1c108fc0 msgr2=0x7f2f1c10f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.254+0000 7f2f21161640 1 --2- 172.21.15.148:0/684774612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f1c108fc0 0x7f2f1c10f7f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009ca0 tx=0x7f2f1402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.254+0000 7f2f21161640 1 -- 172.21.15.148:0/684774612 shutdown_connections 2024-09-21T01:13:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.254+0000 7f2f21161640 1 --2- 172.21.15.148:0/684774612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f1c108fc0 0x7f2f1c10f7f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.254+0000 7f2f21161640 1 --2- 172.21.15.148:0/684774612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f1c108670 0x7f2f1c108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.254+0000 7f2f21161640 1 --2- 172.21.15.148:0/684774612 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f1c103230 0x7f2f1c103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.254+0000 7f2f21161640 1 -- 172.21.15.148:0/684774612 >> 172.21.15.148:0/684774612 conn(0x7f2f1c079ea0 msgr2=0x7f2f1c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:15.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.254+0000 7f2f21161640 1 -- 172.21.15.148:0/684774612 shutdown_connections 2024-09-21T01:13:15.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.254+0000 7f2f21161640 1 -- 172.21.15.148:0/684774612 wait complete. 2024-09-21T01:13:15.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.255+0000 7f2f21161640 1 Processor -- start 2024-09-21T01:13:15.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.255+0000 7f2f21161640 1 -- start start 2024-09-21T01:13:15.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.255+0000 7f2f21161640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f1c103230 0x7f2f1c19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:15.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.255+0000 7f2f21161640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f1c108670 0x7f2f1c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:15.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f21161640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f1c108fc0 0x7f2f1c19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:15.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f21161640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c112c80 con 0x7f2f1c103230 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f21161640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c112b00 con 0x7f2f1c108fc0 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f21161640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c112e00 con 0x7f2f1c108670 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f1c103230 0x7f2f1c19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f1c103230 0x7f2f1c19b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52314/0 (socket says 172.21.15.148:52314) 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f1ad9d640 1 -- 172.21.15.148:0/3764032793 learned_addr learned my addr 172.21.15.148:0/3764032793 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f1b59e640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f1c108fc0 0x7f2f1c19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f13fff640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f1c108670 0x7f2f1c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f1ad9d640 1 -- 172.21.15.148:0/3764032793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f1c108670 msgr2=0x7f2f1c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f1ad9d640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f1c108670 0x7f2f1c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f1ad9d640 1 -- 172.21.15.148:0/3764032793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f1c108fc0 msgr2=0x7f2f1c19bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f1ad9d640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f1c108fc0 0x7f2f1c19bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f1ad9d640 1 -- 172.21.15.148:0/3764032793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c1a66a0 con 0x7f2f1c103230 2024-09-21T01:13:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f1ad9d640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f1c103230 0x7f2f1c19b470 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00c920 tx=0x7f2f0c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f18d99640 1 -- 172.21.15.148:0/3764032793 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c007c70 con 0x7f2f1c103230 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f18d99640 1 -- 172.21.15.148:0/3764032793 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0c007e10 con 0x7f2f1c103230 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f21161640 1 -- 172.21.15.148:0/3764032793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1c1a6990 con 0x7f2f1c103230 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f18d99640 1 -- 172.21.15.148:0/3764032793 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c018820 con 0x7f2f1c103230 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.256+0000 7f2f21161640 1 -- 172.21.15.148:0/3764032793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1c1a6ed0 con 0x7f2f1c103230 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.257+0000 7f2f21161640 1 -- 172.21.15.148:0/3764032793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1c103640 con 0x7f2f1c103230 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.259+0000 7f2f18d99640 1 -- 172.21.15.148:0/3764032793 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f2f0c00f450 con 0x7f2f1c103230 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.259+0000 7f2f18d99640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2f080b65a0 0x7f2f080b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.260+0000 7f2f13fff640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2f080b65a0 0x7f2f080b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.260+0000 7f2f18d99640 1 -- 172.21.15.148:0/3764032793 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f2f0c0e7870 con 0x7f2f1c103230 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.260+0000 7f2f13fff640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2f080b65a0 0x7f2f080b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f04005e10 tx=0x7f2f04005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.263+0000 7f2f18d99640 1 -- 172.21.15.148:0/3764032793 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f0c014030 con 0x7f2f1c103230 2024-09-21T01:13:15.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.458+0000 7f2f21161640 1 -- 172.21.15.148:0/3764032793 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f1c063800 con 0x7f2f080b65a0 2024-09-21T01:13:15.459 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:15 smithi148 ceph-mon[31000]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:15.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.463+0000 7f2f18d99640 1 -- 172.21.15.148:0/3764032793 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258699 (secure 0 0 0) 0x7f2f1c063800 con 0x7f2f080b65a0 2024-09-21T01:13:15.465 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:15.466 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-21T01:13:15.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 -- 172.21.15.148:0/3764032793 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2f080b65a0 msgr2=0x7f2f080b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2f080b65a0 0x7f2f080b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f04005e10 tx=0x7f2f04005da0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 -- 172.21.15.148:0/3764032793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f1c103230 msgr2=0x7f2f1c19b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f1c103230 0x7f2f1c19b470 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00c920 tx=0x7f2f0c00cde0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 -- 172.21.15.148:0/3764032793 shutdown_connections 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f2f080b65a0 0x7f2f080b8ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f1c108fc0 0x7f2f1c19bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f1c108670 0x7f2f1c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 --2- 172.21.15.148:0/3764032793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f1c103230 0x7f2f1c19b470 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 -- 172.21.15.148:0/3764032793 >> 172.21.15.148:0/3764032793 conn(0x7f2f1c079ea0 msgr2=0x7f2f1c1045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 -- 172.21.15.148:0/3764032793 shutdown_connections 2024-09-21T01:13:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:15.466+0000 7f2f21161640 1 -- 172.21.15.148:0/3764032793 wait complete. 2024-09-21T01:13:15.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:15 smithi181 ceph-mon[34811]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:15.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:15 smithi157 ceph-mon[34140]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-21T01:13:14.326725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661051,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":404,"num_read_kb":302,"num_write":289,"num_write_kb":2271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390132,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551692,"statfs":{"total":1151940427776,"available":1151540932608,"internally_reserved":0,"allocated":11980800,"data_stored":6729177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003502"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671714+0000","last_change":"2024-09-21T01:12:11.314815+0000","last_active":"2024-09-21T01:12:55.671714+0000","last_peered":"2024-09-21T01:12:55.671714+0000","last_clean":"2024-09-21T01:12:55.671714+0000","last_became_active":"2024-09-21T01:12:11.314139+0000","last_became_peered":"2024-09-21T01:12:11.314139+0000","last_unstale":"2024-09-21T01:12:55.671714+0000","last_undegraded":"2024-09-21T01:12:55.671714+0000","last_fullsized":"2024-09-21T01:12:55.671714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.538846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675365+0000","last_change":"2024-09-21T01:12:11.309915+0000","last_active":"2024-09-21T01:12:55.675365+0000","last_peered":"2024-09-21T01:12:55.675365+0000","last_clean":"2024-09-21T01:12:55.675365+0000","last_became_active":"2024-09-21T01:12:11.309551+0000","last_became_peered":"2024-09-21T01:12:11.309551+0000","last_unstale":"2024-09-21T01:12:55.675365+0000","last_undegraded":"2024-09-21T01:12:55.675365+0000","last_fullsized":"2024-09-21T01:12:55.675365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.568041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676670+0000","last_change":"2024-09-21T01:12:11.306393+0000","last_active":"2024-09-21T01:12:55.676670+0000","last_peered":"2024-09-21T01:12:55.676670+0000","last_clean":"2024-09-21T01:12:55.676670+0000","last_became_active":"2024-09-21T01:12:11.306035+0000","last_became_peered":"2024-09-21T01:12:11.306035+0000","last_unstale":"2024-09-21T01:12:55.676670+0000","last_undegraded":"2024-09-21T01:12:55.676670+0000","last_fullsized":"2024-09-21T01:12:55.676670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:20.528141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784401+0000","last_change":"2024-09-21T01:12:11.302339+0000","last_active":"2024-09-21T01:12:55.784401+0000","last_peered":"2024-09-21T01:12:55.784401+0000","last_clean":"2024-09-21T01:12:55.784401+0000","last_became_active":"2024-09-21T01:12:11.301890+0000","last_became_peered":"2024-09-21T01:12:11.301890+0000","last_unstale":"2024-09-21T01:12:55.784401+0000","last_undegraded":"2024-09-21T01:12:55.784401+0000","last_fullsized":"2024-09-21T01:12:55.784401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:34.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675728+0000","last_change":"2024-09-21T01:12:11.299171+0000","last_active":"2024-09-21T01:12:55.675728+0000","last_peered":"2024-09-21T01:12:55.675728+0000","last_clean":"2024-09-21T01:12:55.675728+0000","last_became_active":"2024-09-21T01:12:11.298764+0000","last_became_peered":"2024-09-21T01:12:11.298764+0000","last_unstale":"2024-09-21T01:12:55.675728+0000","last_undegraded":"2024-09-21T01:12:55.675728+0000","last_fullsized":"2024-09-21T01:12:55.675728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:02.078587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669113+0000","last_change":"2024-09-21T01:12:11.307909+0000","last_active":"2024-09-21T01:12:55.669113+0000","last_peered":"2024-09-21T01:12:55.669113+0000","last_clean":"2024-09-21T01:12:55.669113+0000","last_became_active":"2024-09-21T01:12:11.307546+0000","last_became_peered":"2024-09-21T01:12:11.307546+0000","last_unstale":"2024-09-21T01:12:55.669113+0000","last_undegraded":"2024-09-21T01:12:55.669113+0000","last_fullsized":"2024-09-21T01:12:55.669113+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:48.683684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674277+0000","last_change":"2024-09-21T01:12:11.309402+0000","last_active":"2024-09-21T01:12:55.674277+0000","last_peered":"2024-09-21T01:12:55.674277+0000","last_clean":"2024-09-21T01:12:55.674277+0000","last_became_active":"2024-09-21T01:12:11.309019+0000","last_became_peered":"2024-09-21T01:12:11.309019+0000","last_unstale":"2024-09-21T01:12:55.674277+0000","last_undegraded":"2024-09-21T01:12:55.674277+0000","last_fullsized":"2024-09-21T01:12:55.674277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:55.020239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670562+0000","last_change":"2024-09-21T01:12:11.308589+0000","last_active":"2024-09-21T01:12:55.670562+0000","last_peered":"2024-09-21T01:12:55.670562+0000","last_clean":"2024-09-21T01:12:55.670562+0000","last_became_active":"2024-09-21T01:12:11.308133+0000","last_became_peered":"2024-09-21T01:12:11.308133+0000","last_unstale":"2024-09-21T01:12:55.670562+0000","last_undegraded":"2024-09-21T01:12:55.670562+0000","last_fullsized":"2024-09-21T01:12:55.670562+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:15.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.681115+0000","last_change":"2024-09-21T01:12:55.681017+0000","last_active":"2024-09-21T01:12:55.681115+0000","last_peered":"2024-09-21T01:12:55.681115+0000","last_clean":"2024-09-21T01:12:55.681115+0000","last_became_active":"2024-09-21T01:12:55.680594+0000","last_became_peered":"2024-09-21T01:12:55.680594+0000","last_unstale":"2024-09-21T01:12:55.681115+0000","last_undegraded":"2024-09-21T01:12:55.681115+0000","last_fullsized":"2024-09-21T01:12:55.681115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.847129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669516+0000","last_change":"2024-09-21T01:12:11.311426+0000","last_active":"2024-09-21T01:12:55.669516+0000","last_peered":"2024-09-21T01:12:55.669516+0000","last_clean":"2024-09-21T01:12:55.669516+0000","last_became_active":"2024-09-21T01:12:11.309351+0000","last_became_peered":"2024-09-21T01:12:11.309351+0000","last_unstale":"2024-09-21T01:12:55.669516+0000","last_undegraded":"2024-09-21T01:12:55.669516+0000","last_fullsized":"2024-09-21T01:12:55.669516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:31.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674782+0000","last_change":"2024-09-21T01:12:11.312171+0000","last_active":"2024-09-21T01:12:55.674782+0000","last_peered":"2024-09-21T01:12:55.674782+0000","last_clean":"2024-09-21T01:12:55.674782+0000","last_became_active":"2024-09-21T01:12:11.311542+0000","last_became_peered":"2024-09-21T01:12:11.311542+0000","last_unstale":"2024-09-21T01:12:55.674782+0000","last_undegraded":"2024-09-21T01:12:55.674782+0000","last_fullsized":"2024-09-21T01:12:55.674782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:13.257463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784543+0000","last_change":"2024-09-21T01:12:11.301344+0000","last_active":"2024-09-21T01:12:55.784543+0000","last_peered":"2024-09-21T01:12:55.784543+0000","last_clean":"2024-09-21T01:12:55.784543+0000","last_became_active":"2024-09-21T01:12:11.300593+0000","last_became_peered":"2024-09-21T01:12:11.300593+0000","last_unstale":"2024-09-21T01:12:55.784543+0000","last_undegraded":"2024-09-21T01:12:55.784543+0000","last_fullsized":"2024-09-21T01:12:55.784543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:12.659972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823191+0000","last_change":"2024-09-21T01:12:11.298690+0000","last_active":"2024-09-21T01:12:55.823191+0000","last_peered":"2024-09-21T01:12:55.823191+0000","last_clean":"2024-09-21T01:12:55.823191+0000","last_became_active":"2024-09-21T01:12:11.298418+0000","last_became_peered":"2024-09-21T01:12:11.298418+0000","last_unstale":"2024-09-21T01:12:55.823191+0000","last_undegraded":"2024-09-21T01:12:55.823191+0000","last_fullsized":"2024-09-21T01:12:55.823191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:08.311791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675752+0000","last_change":"2024-09-21T01:12:11.299382+0000","last_active":"2024-09-21T01:12:55.675752+0000","last_peered":"2024-09-21T01:12:55.675752+0000","last_clean":"2024-09-21T01:12:55.675752+0000","last_became_active":"2024-09-21T01:12:11.298428+0000","last_became_peered":"2024-09-21T01:12:11.298428+0000","last_unstale":"2024-09-21T01:12:55.675752+0000","last_undegraded":"2024-09-21T01:12:55.675752+0000","last_fullsized":"2024-09-21T01:12:55.675752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:02.472994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674719+0000","last_change":"2024-09-21T01:12:11.305018+0000","last_active":"2024-09-21T01:12:55.674719+0000","last_peered":"2024-09-21T01:12:55.674719+0000","last_clean":"2024-09-21T01:12:55.674719+0000","last_became_active":"2024-09-21T01:12:11.304607+0000","last_became_peered":"2024-09-21T01:12:11.304607+0000","last_unstale":"2024-09-21T01:12:55.674719+0000","last_undegraded":"2024-09-21T01:12:55.674719+0000","last_fullsized":"2024-09-21T01:12:55.674719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:39.552633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.327961+0000","last_change":"2024-09-21T01:12:11.308846+0000","last_active":"2024-09-21T01:12:56.327961+0000","last_peered":"2024-09-21T01:12:56.327961+0000","last_clean":"2024-09-21T01:12:56.327961+0000","last_became_active":"2024-09-21T01:12:11.308486+0000","last_became_peered":"2024-09-21T01:12:11.308486+0000","last_unstale":"2024-09-21T01:12:56.327961+0000","last_undegraded":"2024-09-21T01:12:56.327961+0000","last_fullsized":"2024-09-21T01:12:56.327961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:29.072947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671796+0000","last_change":"2024-09-21T01:12:11.316277+0000","last_active":"2024-09-21T01:12:55.671796+0000","last_peered":"2024-09-21T01:12:55.671796+0000","last_clean":"2024-09-21T01:12:55.671796+0000","last_became_active":"2024-09-21T01:12:11.315364+0000","last_became_peered":"2024-09-21T01:12:11.315364+0000","last_unstale":"2024-09-21T01:12:55.671796+0000","last_undegraded":"2024-09-21T01:12:55.671796+0000","last_fullsized":"2024-09-21T01:12:55.671796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:50.281556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673807+0000","last_change":"2024-09-21T01:12:11.300761+0000","last_active":"2024-09-21T01:12:55.673807+0000","last_peered":"2024-09-21T01:12:55.673807+0000","last_clean":"2024-09-21T01:12:55.673807+0000","last_became_active":"2024-09-21T01:12:11.300343+0000","last_became_peered":"2024-09-21T01:12:11.300343+0000","last_unstale":"2024-09-21T01:12:55.673807+0000","last_undegraded":"2024-09-21T01:12:55.673807+0000","last_fullsized":"2024-09-21T01:12:55.673807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:29.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674595+0000","last_change":"2024-09-21T01:12:11.305370+0000","last_active":"2024-09-21T01:12:55.674595+0000","last_peered":"2024-09-21T01:12:55.674595+0000","last_clean":"2024-09-21T01:12:55.674595+0000","last_became_active":"2024-09-21T01:12:11.304991+0000","last_became_peered":"2024-09-21T01:12:11.304991+0000","last_unstale":"2024-09-21T01:12:55.674595+0000","last_undegraded":"2024-09-21T01:12:55.674595+0000","last_fullsized":"2024-09-21T01:12:55.674595+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:12.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671227+0000","last_change":"2024-09-21T01:12:11.303981+0000","last_active":"2024-09-21T01:12:55.671227+0000","last_peered":"2024-09-21T01:12:55.671227+0000","last_clean":"2024-09-21T01:12:55.671227+0000","last_became_active":"2024-09-21T01:12:11.303602+0000","last_became_peered":"2024-09-21T01:12:11.303602+0000","last_unstale":"2024-09-21T01:12:55.671227+0000","last_undegraded":"2024-09-21T01:12:55.671227+0000","last_fullsized":"2024-09-21T01:12:55.671227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:24.513365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823170+0000","last_change":"2024-09-21T01:12:11.302849+0000","last_active":"2024-09-21T01:12:55.823170+0000","last_peered":"2024-09-21T01:12:55.823170+0000","last_clean":"2024-09-21T01:12:55.823170+0000","last_became_active":"2024-09-21T01:12:11.302487+0000","last_became_peered":"2024-09-21T01:12:11.302487+0000","last_unstale":"2024-09-21T01:12:55.823170+0000","last_undegraded":"2024-09-21T01:12:55.823170+0000","last_fullsized":"2024-09-21T01:12:55.823170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:44.174213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328126+0000","last_change":"2024-09-21T01:12:11.315578+0000","last_active":"2024-09-21T01:12:56.328126+0000","last_peered":"2024-09-21T01:12:56.328126+0000","last_clean":"2024-09-21T01:12:56.328126+0000","last_became_active":"2024-09-21T01:12:11.315174+0000","last_became_peered":"2024-09-21T01:12:11.315174+0000","last_unstale":"2024-09-21T01:12:56.328126+0000","last_undegraded":"2024-09-21T01:12:56.328126+0000","last_fullsized":"2024-09-21T01:12:56.328126+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:46.172101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670587+0000","last_change":"2024-09-21T01:12:11.308086+0000","last_active":"2024-09-21T01:12:55.670587+0000","last_peered":"2024-09-21T01:12:55.670587+0000","last_clean":"2024-09-21T01:12:55.670587+0000","last_became_active":"2024-09-21T01:12:11.307248+0000","last_became_peered":"2024-09-21T01:12:11.307248+0000","last_unstale":"2024-09-21T01:12:55.670587+0000","last_undegraded":"2024-09-21T01:12:55.670587+0000","last_fullsized":"2024-09-21T01:12:55.670587+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:11.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.678445+0000","last_change":"2024-09-21T01:12:11.301672+0000","last_active":"2024-09-21T01:12:55.678445+0000","last_peered":"2024-09-21T01:12:55.678445+0000","last_clean":"2024-09-21T01:12:55.678445+0000","last_became_active":"2024-09-21T01:12:11.298775+0000","last_became_peered":"2024-09-21T01:12:11.298775+0000","last_unstale":"2024-09-21T01:12:55.678445+0000","last_undegraded":"2024-09-21T01:12:55.678445+0000","last_fullsized":"2024-09-21T01:12:55.678445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:30.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670851+0000","last_change":"2024-09-21T01:12:11.311947+0000","last_active":"2024-09-21T01:12:55.670851+0000","last_peered":"2024-09-21T01:12:55.670851+0000","last_clean":"2024-09-21T01:12:55.670851+0000","last_became_active":"2024-09-21T01:12:11.311616+0000","last_became_peered":"2024-09-21T01:12:11.311616+0000","last_unstale":"2024-09-21T01:12:55.670851+0000","last_undegraded":"2024-09-21T01:12:55.670851+0000","last_fullsized":"2024-09-21T01:12:55.670851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:25.727807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675065+0000","last_change":"2024-09-21T01:12:11.312161+0000","last_active":"2024-09-21T01:12:55.675065+0000","last_peered":"2024-09-21T01:12:55.675065+0000","last_clean":"2024-09-21T01:12:55.675065+0000","last_became_active":"2024-09-21T01:12:11.311781+0000","last_became_peered":"2024-09-21T01:12:11.311781+0000","last_unstale":"2024-09-21T01:12:55.675065+0000","last_undegraded":"2024-09-21T01:12:55.675065+0000","last_fullsized":"2024-09-21T01:12:55.675065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:01.923801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671385+0000","last_change":"2024-09-21T01:12:11.310698+0000","last_active":"2024-09-21T01:12:55.671385+0000","last_peered":"2024-09-21T01:12:55.671385+0000","last_clean":"2024-09-21T01:12:55.671385+0000","last_became_active":"2024-09-21T01:12:11.310226+0000","last_became_peered":"2024-09-21T01:12:11.310226+0000","last_unstale":"2024-09-21T01:12:55.671385+0000","last_undegraded":"2024-09-21T01:12:55.671385+0000","last_fullsized":"2024-09-21T01:12:55.671385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:27.428457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823133+0000","last_change":"2024-09-21T01:12:11.294598+0000","last_active":"2024-09-21T01:12:55.823133+0000","last_peered":"2024-09-21T01:12:55.823133+0000","last_clean":"2024-09-21T01:12:55.823133+0000","last_became_active":"2024-09-21T01:12:11.293899+0000","last_became_peered":"2024-09-21T01:12:11.293899+0000","last_unstale":"2024-09-21T01:12:55.823133+0000","last_undegraded":"2024-09-21T01:12:55.823133+0000","last_fullsized":"2024-09-21T01:12:55.823133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.843199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675358+0000","last_change":"2024-09-21T01:12:11.295143+0000","last_active":"2024-09-21T01:12:55.675358+0000","last_peered":"2024-09-21T01:12:55.675358+0000","last_clean":"2024-09-21T01:12:55.675358+0000","last_became_active":"2024-09-21T01:12:11.294787+0000","last_became_peered":"2024-09-21T01:12:11.294787+0000","last_unstale":"2024-09-21T01:12:55.675358+0000","last_undegraded":"2024-09-21T01:12:55.675358+0000","last_fullsized":"2024-09-21T01:12:55.675358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:34.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679505+0000","last_change":"2024-09-21T01:12:55.679399+0000","last_active":"2024-09-21T01:12:55.679505+0000","last_peered":"2024-09-21T01:12:55.679505+0000","last_clean":"2024-09-21T01:12:55.679505+0000","last_became_active":"2024-09-21T01:12:55.678933+0000","last_became_peered":"2024-09-21T01:12:55.678933+0000","last_unstale":"2024-09-21T01:12:55.679505+0000","last_undegraded":"2024-09-21T01:12:55.679505+0000","last_fullsized":"2024-09-21T01:12:55.679505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:20.204715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.680830+0000","last_change":"2024-09-21T01:12:55.680711+0000","last_active":"2024-09-21T01:12:55.680830+0000","last_peered":"2024-09-21T01:12:55.680830+0000","last_clean":"2024-09-21T01:12:55.680830+0000","last_became_active":"2024-09-21T01:12:55.680257+0000","last_became_peered":"2024-09-21T01:12:55.680257+0000","last_unstale":"2024-09-21T01:12:55.680830+0000","last_undegraded":"2024-09-21T01:12:55.680830+0000","last_fullsized":"2024-09-21T01:12:55.680830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:03.610951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671133+0000","last_change":"2024-09-21T01:12:11.308355+0000","last_active":"2024-09-21T01:12:55.671133+0000","last_peered":"2024-09-21T01:12:55.671133+0000","last_clean":"2024-09-21T01:12:55.671133+0000","last_became_active":"2024-09-21T01:12:11.307919+0000","last_became_peered":"2024-09-21T01:12:11.307919+0000","last_unstale":"2024-09-21T01:12:55.671133+0000","last_undegraded":"2024-09-21T01:12:55.671133+0000","last_fullsized":"2024-09-21T01:12:55.671133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:59.869646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674536+0000","last_change":"2024-09-21T01:12:11.298905+0000","last_active":"2024-09-21T01:12:55.674536+0000","last_peered":"2024-09-21T01:12:55.674536+0000","last_clean":"2024-09-21T01:12:55.674536+0000","last_became_active":"2024-09-21T01:12:11.298512+0000","last_became_peered":"2024-09-21T01:12:11.298512+0000","last_unstale":"2024-09-21T01:12:55.674536+0000","last_undegraded":"2024-09-21T01:12:55.674536+0000","last_fullsized":"2024-09-21T01:12:55.674536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:05.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:09.355745+0000","last_change":"2024-09-21T01:12:09.294881+0000","last_active":"2024-09-21T01:13:09.355745+0000","last_peered":"2024-09-21T01:13:09.355745+0000","last_clean":"2024-09-21T01:13:09.355745+0000","last_became_active":"2024-09-21T01:12:09.294513+0000","last_became_peered":"2024-09-21T01:12:09.294513+0000","last_unstale":"2024-09-21T01:13:09.355745+0000","last_undegraded":"2024-09-21T01:13:09.355745+0000","last_fullsized":"2024-09-21T01:13:09.355745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:07.193879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676365+0000","last_change":"2024-09-21T01:12:55.676259+0000","last_active":"2024-09-21T01:12:55.676365+0000","last_peered":"2024-09-21T01:12:55.676365+0000","last_clean":"2024-09-21T01:12:55.676365+0000","last_became_active":"2024-09-21T01:12:55.675810+0000","last_became_peered":"2024-09-21T01:12:55.675810+0000","last_unstale":"2024-09-21T01:12:55.676365+0000","last_undegraded":"2024-09-21T01:12:55.676365+0000","last_fullsized":"2024-09-21T01:12:55.676365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:34.985195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669122+0000","last_change":"2024-09-21T01:12:09.298594+0000","last_active":"2024-09-21T01:12:55.669122+0000","last_peered":"2024-09-21T01:12:55.669122+0000","last_clean":"2024-09-21T01:12:55.669122+0000","last_became_active":"2024-09-21T01:12:09.298130+0000","last_became_peered":"2024-09-21T01:12:09.298130+0000","last_unstale":"2024-09-21T01:12:55.669122+0000","last_undegraded":"2024-09-21T01:12:55.669122+0000","last_fullsized":"2024-09-21T01:12:55.669122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.964507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822858+0000","last_change":"2024-09-21T01:12:09.295997+0000","last_active":"2024-09-21T01:12:55.822858+0000","last_peered":"2024-09-21T01:12:55.822858+0000","last_clean":"2024-09-21T01:12:55.822858+0000","last_became_active":"2024-09-21T01:12:09.295472+0000","last_became_peered":"2024-09-21T01:12:09.295472+0000","last_unstale":"2024-09-21T01:12:55.822858+0000","last_undegraded":"2024-09-21T01:12:55.822858+0000","last_fullsized":"2024-09-21T01:12:55.822858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:25.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670737+0000","last_change":"2024-09-21T01:12:11.306468+0000","last_active":"2024-09-21T01:12:55.670737+0000","last_peered":"2024-09-21T01:12:55.670737+0000","last_clean":"2024-09-21T01:12:55.670737+0000","last_became_active":"2024-09-21T01:12:11.304186+0000","last_became_peered":"2024-09-21T01:12:11.304186+0000","last_unstale":"2024-09-21T01:12:55.670737+0000","last_undegraded":"2024-09-21T01:12:55.670737+0000","last_fullsized":"2024-09-21T01:12:55.670737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:28.564879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.678732+0000","last_change":"2024-09-21T01:12:09.295004+0000","last_active":"2024-09-21T01:12:55.678732+0000","last_peered":"2024-09-21T01:12:55.678732+0000","last_clean":"2024-09-21T01:12:55.678732+0000","last_became_active":"2024-09-21T01:12:09.294655+0000","last_became_peered":"2024-09-21T01:12:09.294655+0000","last_unstale":"2024-09-21T01:12:55.678732+0000","last_undegraded":"2024-09-21T01:12:55.678732+0000","last_fullsized":"2024-09-21T01:12:55.678732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:35.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.672777+0000","last_change":"2024-09-21T01:12:11.304252+0000","last_active":"2024-09-21T01:12:55.672777+0000","last_peered":"2024-09-21T01:12:55.672777+0000","last_clean":"2024-09-21T01:12:55.672777+0000","last_became_active":"2024-09-21T01:12:11.303876+0000","last_became_peered":"2024-09-21T01:12:11.303876+0000","last_unstale":"2024-09-21T01:12:55.672777+0000","last_undegraded":"2024-09-21T01:12:55.672777+0000","last_fullsized":"2024-09-21T01:12:55.672777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:48.460538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":76,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:09.355243+0000","last_change":"2024-09-21T01:12:09.298976+0000","last_active":"2024-09-21T01:13:09.355243+0000","last_peered":"2024-09-21T01:13:09.355243+0000","last_clean":"2024-09-21T01:13:09.355243+0000","last_became_active":"2024-09-21T01:12:09.298664+0000","last_became_peered":"2024-09-21T01:12:09.298664+0000","last_unstale":"2024-09-21T01:13:09.355243+0000","last_undegraded":"2024-09-21T01:13:09.355243+0000","last_fullsized":"2024-09-21T01:13:09.355243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:58.157391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328582+0000","last_change":"2024-09-21T01:12:11.313400+0000","last_active":"2024-09-21T01:12:56.328582+0000","last_peered":"2024-09-21T01:12:56.328582+0000","last_clean":"2024-09-21T01:12:56.328582+0000","last_became_active":"2024-09-21T01:12:11.312940+0000","last_became_peered":"2024-09-21T01:12:11.312940+0000","last_unstale":"2024-09-21T01:12:56.328582+0000","last_undegraded":"2024-09-21T01:12:56.328582+0000","last_fullsized":"2024-09-21T01:12:56.328582+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:22.224157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674784+0000","last_change":"2024-09-21T01:12:09.299266+0000","last_active":"2024-09-21T01:12:55.674784+0000","last_peered":"2024-09-21T01:12:55.674784+0000","last_clean":"2024-09-21T01:12:55.674784+0000","last_became_active":"2024-09-21T01:12:09.298932+0000","last_became_peered":"2024-09-21T01:12:09.298932+0000","last_unstale":"2024-09-21T01:12:55.674784+0000","last_undegraded":"2024-09-21T01:12:55.674784+0000","last_fullsized":"2024-09-21T01:12:55.674784+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:51.546829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.681771+0000","last_change":"2024-09-21T01:12:55.681618+0000","last_active":"2024-09-21T01:12:55.681771+0000","last_peered":"2024-09-21T01:12:55.681771+0000","last_clean":"2024-09-21T01:12:55.681771+0000","last_became_active":"2024-09-21T01:12:55.681211+0000","last_became_peered":"2024-09-21T01:12:55.681211+0000","last_unstale":"2024-09-21T01:12:55.681771+0000","last_undegraded":"2024-09-21T01:12:55.681771+0000","last_fullsized":"2024-09-21T01:12:55.681771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:24.588338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679447+0000","last_change":"2024-09-21T01:12:09.511908+0000","last_active":"2024-09-21T01:12:55.679447+0000","last_peered":"2024-09-21T01:12:55.679447+0000","last_clean":"2024-09-21T01:12:55.679447+0000","last_became_active":"2024-09-21T01:12:09.511550+0000","last_became_peered":"2024-09-21T01:12:09.511550+0000","last_unstale":"2024-09-21T01:12:55.679447+0000","last_undegraded":"2024-09-21T01:12:55.679447+0000","last_fullsized":"2024-09-21T01:12:55.679447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:08.743648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328216+0000","last_change":"2024-09-21T01:12:11.316005+0000","last_active":"2024-09-21T01:12:56.328216+0000","last_peered":"2024-09-21T01:12:56.328216+0000","last_clean":"2024-09-21T01:12:56.328216+0000","last_became_active":"2024-09-21T01:12:11.315245+0000","last_became_peered":"2024-09-21T01:12:11.315245+0000","last_unstale":"2024-09-21T01:12:56.328216+0000","last_undegraded":"2024-09-21T01:12:56.328216+0000","last_fullsized":"2024-09-21T01:12:56.328216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:50.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'31","reported_seq":163,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:10.356536+0000","last_change":"2024-09-21T01:12:09.300010+0000","last_active":"2024-09-21T01:13:10.356536+0000","last_peered":"2024-09-21T01:13:10.356536+0000","last_clean":"2024-09-21T01:13:10.356536+0000","last_became_active":"2024-09-21T01:12:09.299652+0000","last_became_peered":"2024-09-21T01:12:09.299652+0000","last_unstale":"2024-09-21T01:13:10.356536+0000","last_undegraded":"2024-09-21T01:13:10.356536+0000","last_fullsized":"2024-09-21T01:13:10.356536+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:18.610597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66448,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":119,"num_write":32,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675413+0000","last_change":"2024-09-21T01:12:11.308675+0000","last_active":"2024-09-21T01:12:55.675413+0000","last_peered":"2024-09-21T01:12:55.675413+0000","last_clean":"2024-09-21T01:12:55.675413+0000","last_became_active":"2024-09-21T01:12:11.308317+0000","last_became_peered":"2024-09-21T01:12:11.308317+0000","last_unstale":"2024-09-21T01:12:55.675413+0000","last_undegraded":"2024-09-21T01:12:55.675413+0000","last_fullsized":"2024-09-21T01:12:55.675413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:56.081404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673306+0000","last_change":"2024-09-21T01:12:09.293716+0000","last_active":"2024-09-21T01:12:55.673306+0000","last_peered":"2024-09-21T01:12:55.673306+0000","last_clean":"2024-09-21T01:12:55.673306+0000","last_became_active":"2024-09-21T01:12:09.293205+0000","last_became_peered":"2024-09-21T01:12:09.293205+0000","last_unstale":"2024-09-21T01:12:55.673306+0000","last_undegraded":"2024-09-21T01:12:55.673306+0000","last_fullsized":"2024-09-21T01:12:55.673306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:29.955953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822913+0000","last_change":"2024-09-21T01:12:11.302736+0000","last_active":"2024-09-21T01:12:55.822913+0000","last_peered":"2024-09-21T01:12:55.822913+0000","last_clean":"2024-09-21T01:12:55.822913+0000","last_became_active":"2024-09-21T01:12:11.302357+0000","last_became_peered":"2024-09-21T01:12:11.302357+0000","last_unstale":"2024-09-21T01:12:55.822913+0000","last_undegraded":"2024-09-21T01:12:55.822913+0000","last_fullsized":"2024-09-21T01:12:55.822913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:34.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.677786+0000","last_change":"2024-09-21T01:12:09.295258+0000","last_active":"2024-09-21T01:12:55.677786+0000","last_peered":"2024-09-21T01:12:55.677786+0000","last_clean":"2024-09-21T01:12:55.677786+0000","last_became_active":"2024-09-21T01:12:09.294872+0000","last_became_peered":"2024-09-21T01:12:09.294872+0000","last_unstale":"2024-09-21T01:12:55.677786+0000","last_undegraded":"2024-09-21T01:12:55.677786+0000","last_fullsized":"2024-09-21T01:12:55.677786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.216960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674608+0000","last_change":"2024-09-21T01:12:11.303413+0000","last_active":"2024-09-21T01:12:55.674608+0000","last_peered":"2024-09-21T01:12:55.674608+0000","last_clean":"2024-09-21T01:12:55.674608+0000","last_became_active":"2024-09-21T01:12:11.303002+0000","last_became_peered":"2024-09-21T01:12:11.303002+0000","last_unstale":"2024-09-21T01:12:55.674608+0000","last_undegraded":"2024-09-21T01:12:55.674608+0000","last_fullsized":"2024-09-21T01:12:55.674608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:55.984699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:09.355507+0000","last_change":"2024-09-21T01:12:09.297392+0000","last_active":"2024-09-21T01:13:09.355507+0000","last_peered":"2024-09-21T01:13:09.355507+0000","last_clean":"2024-09-21T01:13:09.355507+0000","last_became_active":"2024-09-21T01:12:09.296882+0000","last_became_peered":"2024-09-21T01:12:09.296882+0000","last_unstale":"2024-09-21T01:13:09.355507+0000","last_undegraded":"2024-09-21T01:13:09.355507+0000","last_fullsized":"2024-09-21T01:13:09.355507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.598362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674128+0000","last_change":"2024-09-21T01:12:11.308021+0000","last_active":"2024-09-21T01:12:55.674128+0000","last_peered":"2024-09-21T01:12:55.674128+0000","last_clean":"2024-09-21T01:12:55.674128+0000","last_became_active":"2024-09-21T01:12:11.307643+0000","last_became_peered":"2024-09-21T01:12:11.307643+0000","last_unstale":"2024-09-21T01:12:55.674128+0000","last_undegraded":"2024-09-21T01:12:55.674128+0000","last_fullsized":"2024-09-21T01:12:55.674128+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:55.569855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674898+0000","last_change":"2024-09-21T01:12:09.512120+0000","last_active":"2024-09-21T01:12:55.674898+0000","last_peered":"2024-09-21T01:12:55.674898+0000","last_clean":"2024-09-21T01:12:55.674898+0000","last_became_active":"2024-09-21T01:12:09.511631+0000","last_became_peered":"2024-09-21T01:12:09.511631+0000","last_unstale":"2024-09-21T01:12:55.674898+0000","last_undegraded":"2024-09-21T01:12:55.674898+0000","last_fullsized":"2024-09-21T01:12:55.674898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:13.187219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.677803+0000","last_change":"2024-09-21T01:12:11.301633+0000","last_active":"2024-09-21T01:12:55.677803+0000","last_peered":"2024-09-21T01:12:55.677803+0000","last_clean":"2024-09-21T01:12:55.677803+0000","last_became_active":"2024-09-21T01:12:11.300638+0000","last_became_peered":"2024-09-21T01:12:11.300638+0000","last_unstale":"2024-09-21T01:12:55.677803+0000","last_undegraded":"2024-09-21T01:12:55.677803+0000","last_fullsized":"2024-09-21T01:12:55.677803+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:42.245596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676059+0000","last_change":"2024-09-21T01:12:09.297694+0000","last_active":"2024-09-21T01:12:55.676059+0000","last_peered":"2024-09-21T01:12:55.676059+0000","last_clean":"2024-09-21T01:12:55.676059+0000","last_became_active":"2024-09-21T01:12:09.297127+0000","last_became_peered":"2024-09-21T01:12:09.297127+0000","last_unstale":"2024-09-21T01:12:55.676059+0000","last_undegraded":"2024-09-21T01:12:55.676059+0000","last_fullsized":"2024-09-21T01:12:55.676059+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:35.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671386+0000","last_change":"2024-09-21T01:12:11.303510+0000","last_active":"2024-09-21T01:12:55.671386+0000","last_peered":"2024-09-21T01:12:55.671386+0000","last_clean":"2024-09-21T01:12:55.671386+0000","last_became_active":"2024-09-21T01:12:11.303148+0000","last_became_peered":"2024-09-21T01:12:11.303148+0000","last_unstale":"2024-09-21T01:12:55.671386+0000","last_undegraded":"2024-09-21T01:12:55.671386+0000","last_fullsized":"2024-09-21T01:12:55.671386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:59.338185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823115+0000","last_change":"2024-09-21T01:12:09.293490+0000","last_active":"2024-09-21T01:12:55.823115+0000","last_peered":"2024-09-21T01:12:55.823115+0000","last_clean":"2024-09-21T01:12:55.823115+0000","last_became_active":"2024-09-21T01:12:09.293151+0000","last_became_peered":"2024-09-21T01:12:09.293151+0000","last_unstale":"2024-09-21T01:12:55.823115+0000","last_undegraded":"2024-09-21T01:12:55.823115+0000","last_fullsized":"2024-09-21T01:12:55.823115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:25.153547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674864+0000","last_change":"2024-09-21T01:12:11.311313+0000","last_active":"2024-09-21T01:12:55.674864+0000","last_peered":"2024-09-21T01:12:55.674864+0000","last_clean":"2024-09-21T01:12:55.674864+0000","last_became_active":"2024-09-21T01:12:11.310908+0000","last_became_peered":"2024-09-21T01:12:11.310908+0000","last_unstale":"2024-09-21T01:12:55.674864+0000","last_undegraded":"2024-09-21T01:12:55.674864+0000","last_fullsized":"2024-09-21T01:12:55.674864+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:15.070802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679574+0000","last_change":"2024-09-21T01:12:09.298861+0000","last_active":"2024-09-21T01:12:55.679574+0000","last_peered":"2024-09-21T01:12:55.679574+0000","last_clean":"2024-09-21T01:12:55.679574+0000","last_became_active":"2024-09-21T01:12:09.298504+0000","last_became_peered":"2024-09-21T01:12:09.298504+0000","last_unstale":"2024-09-21T01:12:55.679574+0000","last_undegraded":"2024-09-21T01:12:55.679574+0000","last_fullsized":"2024-09-21T01:12:55.679574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:10.446269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674565+0000","last_change":"2024-09-21T01:12:11.309656+0000","last_active":"2024-09-21T01:12:55.674565+0000","last_peered":"2024-09-21T01:12:55.674565+0000","last_clean":"2024-09-21T01:12:55.674565+0000","last_became_active":"2024-09-21T01:12:11.308515+0000","last_became_peered":"2024-09-21T01:12:11.308515+0000","last_unstale":"2024-09-21T01:12:55.674565+0000","last_undegraded":"2024-09-21T01:12:55.674565+0000","last_fullsized":"2024-09-21T01:12:55.674565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:38.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675314+0000","last_change":"2024-09-21T01:12:09.511434+0000","last_active":"2024-09-21T01:12:55.675314+0000","last_peered":"2024-09-21T01:12:55.675314+0000","last_clean":"2024-09-21T01:12:55.675314+0000","last_became_active":"2024-09-21T01:12:09.511043+0000","last_became_peered":"2024-09-21T01:12:09.511043+0000","last_unstale":"2024-09-21T01:12:55.675314+0000","last_undegraded":"2024-09-21T01:12:55.675314+0000","last_fullsized":"2024-09-21T01:12:55.675314+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:23.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674799+0000","last_change":"2024-09-21T01:12:11.311989+0000","last_active":"2024-09-21T01:12:55.674799+0000","last_peered":"2024-09-21T01:12:55.674799+0000","last_clean":"2024-09-21T01:12:55.674799+0000","last_became_active":"2024-09-21T01:12:11.310338+0000","last_became_peered":"2024-09-21T01:12:11.310338+0000","last_unstale":"2024-09-21T01:12:55.674799+0000","last_undegraded":"2024-09-21T01:12:55.674799+0000","last_fullsized":"2024-09-21T01:12:55.674799+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:12.675575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674409+0000","last_change":"2024-09-21T01:11:01.703479+0000","last_active":"2024-09-21T01:12:55.674409+0000","last_peered":"2024-09-21T01:12:55.674409+0000","last_clean":"2024-09-21T01:12:55.674409+0000","last_became_active":"2024-09-21T01:11:01.697351+0000","last_became_peered":"2024-09-21T01:11:01.697351+0000","last_unstale":"2024-09-21T01:12:55.674409+0000","last_undegraded":"2024-09-21T01:12:55.674409+0000","last_fullsized":"2024-09-21T01:12:55.674409+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_clean_scrub_stamp":"2024-09-21T01:07:43.096984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:18.858448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784499+0000","last_change":"2024-09-21T01:12:09.295468+0000","last_active":"2024-09-21T01:12:55.784499+0000","last_peered":"2024-09-21T01:12:55.784499+0000","last_clean":"2024-09-21T01:12:55.784499+0000","last_became_active":"2024-09-21T01:12:09.295092+0000","last_became_peered":"2024-09-21T01:12:09.295092+0000","last_unstale":"2024-09-21T01:12:55.784499+0000","last_undegraded":"2024-09-21T01:12:55.784499+0000","last_fullsized":"2024-09-21T01:12:55.784499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:08.153176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670981+0000","last_change":"2024-09-21T01:12:11.308460+0000","last_active":"2024-09-21T01:12:55.670981+0000","last_peered":"2024-09-21T01:12:55.670981+0000","last_clean":"2024-09-21T01:12:55.670981+0000","last_became_active":"2024-09-21T01:12:11.307764+0000","last_became_peered":"2024-09-21T01:12:11.307764+0000","last_unstale":"2024-09-21T01:12:55.670981+0000","last_undegraded":"2024-09-21T01:12:55.670981+0000","last_fullsized":"2024-09-21T01:12:55.670981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:32.094902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674341+0000","last_change":"2024-09-21T01:12:09.296477+0000","last_active":"2024-09-21T01:12:55.674341+0000","last_peered":"2024-09-21T01:12:55.674341+0000","last_clean":"2024-09-21T01:12:55.674341+0000","last_became_active":"2024-09-21T01:12:09.296153+0000","last_became_peered":"2024-09-21T01:12:09.296153+0000","last_unstale":"2024-09-21T01:12:55.674341+0000","last_undegraded":"2024-09-21T01:12:55.674341+0000","last_fullsized":"2024-09-21T01:12:55.674341+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:42.380668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822830+0000","last_change":"2024-09-21T01:12:11.297826+0000","last_active":"2024-09-21T01:12:55.822830+0000","last_peered":"2024-09-21T01:12:55.822830+0000","last_clean":"2024-09-21T01:12:55.822830+0000","last_became_active":"2024-09-21T01:12:11.297430+0000","last_became_peered":"2024-09-21T01:12:11.297430+0000","last_unstale":"2024-09-21T01:12:55.822830+0000","last_undegraded":"2024-09-21T01:12:55.822830+0000","last_fullsized":"2024-09-21T01:12:55.822830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:09.130500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:11.358042+0000","last_change":"2024-09-21T01:12:09.511173+0000","last_active":"2024-09-21T01:13:11.358042+0000","last_peered":"2024-09-21T01:13:11.358042+0000","last_clean":"2024-09-21T01:13:11.358042+0000","last_became_active":"2024-09-21T01:12:09.510840+0000","last_became_peered":"2024-09-21T01:12:09.510840+0000","last_unstale":"2024-09-21T01:13:11.358042+0000","last_undegraded":"2024-09-21T01:13:11.358042+0000","last_fullsized":"2024-09-21T01:13:11.358042+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:22.161708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.824933+0000","last_change":"2024-09-21T01:12:55.824825+0000","last_active":"2024-09-21T01:12:55.824933+0000","last_peered":"2024-09-21T01:12:55.824933+0000","last_clean":"2024-09-21T01:12:55.824933+0000","last_became_active":"2024-09-21T01:12:55.824253+0000","last_became_peered":"2024-09-21T01:12:55.824253+0000","last_unstale":"2024-09-21T01:12:55.824933+0000","last_undegraded":"2024-09-21T01:12:55.824933+0000","last_fullsized":"2024-09-21T01:12:55.824933+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:14.580270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674696+0000","last_change":"2024-09-21T01:12:09.295447+0000","last_active":"2024-09-21T01:12:55.674696+0000","last_peered":"2024-09-21T01:12:55.674696+0000","last_clean":"2024-09-21T01:12:55.674696+0000","last_became_active":"2024-09-21T01:12:09.295057+0000","last_became_peered":"2024-09-21T01:12:09.295057+0000","last_unstale":"2024-09-21T01:12:55.674696+0000","last_undegraded":"2024-09-21T01:12:55.674696+0000","last_fullsized":"2024-09-21T01:12:55.674696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:59.389877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669259+0000","last_change":"2024-09-21T01:12:11.304636+0000","last_active":"2024-09-21T01:12:55.669259+0000","last_peered":"2024-09-21T01:12:55.669259+0000","last_clean":"2024-09-21T01:12:55.669259+0000","last_became_active":"2024-09-21T01:12:11.303318+0000","last_became_peered":"2024-09-21T01:12:11.303318+0000","last_unstale":"2024-09-21T01:12:55.669259+0000","last_undegraded":"2024-09-21T01:12:55.669259+0000","last_fullsized":"2024-09-21T01:12:55.669259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:39.377686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679281+0000","last_change":"2024-09-21T01:12:55.679156+0000","last_active":"2024-09-21T01:12:55.679281+0000","last_peered":"2024-09-21T01:12:55.679281+0000","last_clean":"2024-09-21T01:12:55.679281+0000","last_became_active":"2024-09-21T01:12:55.678638+0000","last_became_peered":"2024-09-21T01:12:55.678638+0000","last_unstale":"2024-09-21T01:12:55.679281+0000","last_undegraded":"2024-09-21T01:12:55.679281+0000","last_fullsized":"2024-09-21T01:12:55.679281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.784868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669377+0000","last_change":"2024-09-21T01:12:11.305558+0000","last_active":"2024-09-21T01:12:55.669377+0000","last_peered":"2024-09-21T01:12:55.669377+0000","last_clean":"2024-09-21T01:12:55.669377+0000","last_became_active":"2024-09-21T01:12:11.304934+0000","last_became_peered":"2024-09-21T01:12:11.304934+0000","last_unstale":"2024-09-21T01:12:55.669377+0000","last_undegraded":"2024-09-21T01:12:55.669377+0000","last_fullsized":"2024-09-21T01:12:55.669377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:52.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675716+0000","last_change":"2024-09-21T01:12:09.511384+0000","last_active":"2024-09-21T01:12:55.675716+0000","last_peered":"2024-09-21T01:12:55.675716+0000","last_clean":"2024-09-21T01:12:55.675716+0000","last_became_active":"2024-09-21T01:12:09.511006+0000","last_became_peered":"2024-09-21T01:12:09.511006+0000","last_unstale":"2024-09-21T01:12:55.675716+0000","last_undegraded":"2024-09-21T01:12:55.675716+0000","last_fullsized":"2024-09-21T01:12:55.675716+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:56.580855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823258+0000","last_change":"2024-09-21T01:12:11.304912+0000","last_active":"2024-09-21T01:12:55.823258+0000","last_peered":"2024-09-21T01:12:55.823258+0000","last_clean":"2024-09-21T01:12:55.823258+0000","last_became_active":"2024-09-21T01:12:11.304536+0000","last_became_peered":"2024-09-21T01:12:11.304536+0000","last_unstale":"2024-09-21T01:12:55.823258+0000","last_undegraded":"2024-09-21T01:12:55.823258+0000","last_fullsized":"2024-09-21T01:12:55.823258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:45.037231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673929+0000","last_change":"2024-09-21T01:12:09.294680+0000","last_active":"2024-09-21T01:12:55.673929+0000","last_peered":"2024-09-21T01:12:55.673929+0000","last_clean":"2024-09-21T01:12:55.673929+0000","last_became_active":"2024-09-21T01:12:09.294289+0000","last_became_peered":"2024-09-21T01:12:09.294289+0000","last_unstale":"2024-09-21T01:12:55.673929+0000","last_undegraded":"2024-09-21T01:12:55.673929+0000","last_fullsized":"2024-09-21T01:12:55.673929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.824781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670991+0000","last_change":"2024-09-21T01:12:11.305192+0000","last_active":"2024-09-21T01:12:55.670991+0000","last_peered":"2024-09-21T01:12:55.670991+0000","last_clean":"2024-09-21T01:12:55.670991+0000","last_became_active":"2024-09-21T01:12:11.304761+0000","last_became_peered":"2024-09-21T01:12:11.304761+0000","last_unstale":"2024-09-21T01:12:55.670991+0000","last_undegraded":"2024-09-21T01:12:55.670991+0000","last_fullsized":"2024-09-21T01:12:55.670991+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:58.429511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784602+0000","last_change":"2024-09-21T01:12:09.455476+0000","last_active":"2024-09-21T01:12:55.784602+0000","last_peered":"2024-09-21T01:12:55.784602+0000","last_clean":"2024-09-21T01:12:55.784602+0000","last_became_active":"2024-09-21T01:12:09.454981+0000","last_became_peered":"2024-09-21T01:12:09.454981+0000","last_unstale":"2024-09-21T01:12:55.784602+0000","last_undegraded":"2024-09-21T01:12:55.784602+0000","last_fullsized":"2024-09-21T01:12:55.784602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:27.790928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676141+0000","last_change":"2024-09-21T01:12:11.300631+0000","last_active":"2024-09-21T01:12:55.676141+0000","last_peered":"2024-09-21T01:12:55.676141+0000","last_clean":"2024-09-21T01:12:55.676141+0000","last_became_active":"2024-09-21T01:12:11.300179+0000","last_became_peered":"2024-09-21T01:12:11.300179+0000","last_unstale":"2024-09-21T01:12:55.676141+0000","last_undegraded":"2024-09-21T01:12:55.676141+0000","last_fullsized":"2024-09-21T01:12:55.676141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:23.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328302+0000","last_change":"2024-09-21T01:12:09.511406+0000","last_active":"2024-09-21T01:12:56.328302+0000","last_peered":"2024-09-21T01:12:56.328302+0000","last_clean":"2024-09-21T01:12:56.328302+0000","last_became_active":"2024-09-21T01:12:09.511117+0000","last_became_peered":"2024-09-21T01:12:09.511117+0000","last_unstale":"2024-09-21T01:12:56.328302+0000","last_undegraded":"2024-09-21T01:12:56.328302+0000","last_fullsized":"2024-09-21T01:12:56.328302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:18.100466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674303+0000","last_change":"2024-09-21T01:12:11.306933+0000","last_active":"2024-09-21T01:12:55.674303+0000","last_peered":"2024-09-21T01:12:55.674303+0000","last_clean":"2024-09-21T01:12:55.674303+0000","last_became_active":"2024-09-21T01:12:11.306516+0000","last_became_peered":"2024-09-21T01:12:11.306516+0000","last_unstale":"2024-09-21T01:12:55.674303+0000","last_undegraded":"2024-09-21T01:12:55.674303+0000","last_fullsized":"2024-09-21T01:12:55.674303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:40.524953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670767+0000","last_change":"2024-09-21T01:12:09.297506+0000","last_active":"2024-09-21T01:12:55.670767+0000","last_peered":"2024-09-21T01:12:55.670767+0000","last_clean":"2024-09-21T01:12:55.670767+0000","last_became_active":"2024-09-21T01:12:09.297139+0000","last_became_peered":"2024-09-21T01:12:09.297139+0000","last_unstale":"2024-09-21T01:12:55.670767+0000","last_undegraded":"2024-09-21T01:12:55.670767+0000","last_fullsized":"2024-09-21T01:12:55.670767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:05.641171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671193+0000","last_change":"2024-09-21T01:12:11.314053+0000","last_active":"2024-09-21T01:12:55.671193+0000","last_peered":"2024-09-21T01:12:55.671193+0000","last_clean":"2024-09-21T01:12:55.671193+0000","last_became_active":"2024-09-21T01:12:11.313681+0000","last_became_peered":"2024-09-21T01:12:11.313681+0000","last_unstale":"2024-09-21T01:12:55.671193+0000","last_undegraded":"2024-09-21T01:12:55.671193+0000","last_fullsized":"2024-09-21T01:12:55.671193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.108030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674195+0000","last_change":"2024-09-21T01:12:09.298602+0000","last_active":"2024-09-21T01:12:55.674195+0000","last_peered":"2024-09-21T01:12:55.674195+0000","last_clean":"2024-09-21T01:12:55.674195+0000","last_became_active":"2024-09-21T01:12:09.297295+0000","last_became_peered":"2024-09-21T01:12:09.297295+0000","last_unstale":"2024-09-21T01:12:55.674195+0000","last_undegraded":"2024-09-21T01:12:55.674195+0000","last_fullsized":"2024-09-21T01:12:55.674195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:27.253290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671086+0000","last_change":"2024-09-21T01:12:11.306120+0000","last_active":"2024-09-21T01:12:55.671086+0000","last_peered":"2024-09-21T01:12:55.671086+0000","last_clean":"2024-09-21T01:12:55.671086+0000","last_became_active":"2024-09-21T01:12:11.305771+0000","last_became_peered":"2024-09-21T01:12:11.305771+0000","last_unstale":"2024-09-21T01:12:55.671086+0000","last_undegraded":"2024-09-21T01:12:55.671086+0000","last_fullsized":"2024-09-21T01:12:55.671086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:38.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.685158+0000","last_change":"2024-09-21T01:12:55.684585+0000","last_active":"2024-09-21T01:12:55.685158+0000","last_peered":"2024-09-21T01:12:55.685158+0000","last_clean":"2024-09-21T01:12:55.685158+0000","last_became_active":"2024-09-21T01:12:55.677011+0000","last_became_peered":"2024-09-21T01:12:55.677011+0000","last_unstale":"2024-09-21T01:12:55.685158+0000","last_undegraded":"2024-09-21T01:12:55.685158+0000","last_fullsized":"2024-09-21T01:12:55.685158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:09.563212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674421+0000","last_change":"2024-09-21T01:12:11.312392+0000","last_active":"2024-09-21T01:12:55.674421+0000","last_peered":"2024-09-21T01:12:55.674421+0000","last_clean":"2024-09-21T01:12:55.674421+0000","last_became_active":"2024-09-21T01:12:11.311120+0000","last_became_peered":"2024-09-21T01:12:11.311120+0000","last_unstale":"2024-09-21T01:12:55.674421+0000","last_undegraded":"2024-09-21T01:12:55.674421+0000","last_fullsized":"2024-09-21T01:12:55.674421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:23.292367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679358+0000","last_change":"2024-09-21T01:12:11.301350+0000","last_active":"2024-09-21T01:12:55.679358+0000","last_peered":"2024-09-21T01:12:55.679358+0000","last_clean":"2024-09-21T01:12:55.679358+0000","last_became_active":"2024-09-21T01:12:11.299746+0000","last_became_peered":"2024-09-21T01:12:11.299746+0000","last_unstale":"2024-09-21T01:12:55.679358+0000","last_undegraded":"2024-09-21T01:12:55.679358+0000","last_fullsized":"2024-09-21T01:12:55.679358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:57.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675539+0000","last_change":"2024-09-21T01:12:09.296499+0000","last_active":"2024-09-21T01:12:55.675539+0000","last_peered":"2024-09-21T01:12:55.675539+0000","last_clean":"2024-09-21T01:12:55.675539+0000","last_became_active":"2024-09-21T01:12:09.296000+0000","last_became_peered":"2024-09-21T01:12:09.296000+0000","last_unstale":"2024-09-21T01:12:55.675539+0000","last_undegraded":"2024-09-21T01:12:55.675539+0000","last_fullsized":"2024-09-21T01:12:55.675539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:37.278200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328152+0000","last_change":"2024-09-21T01:12:11.314014+0000","last_active":"2024-09-21T01:12:56.328152+0000","last_peered":"2024-09-21T01:12:56.328152+0000","last_clean":"2024-09-21T01:12:56.328152+0000","last_became_active":"2024-09-21T01:12:11.312592+0000","last_became_peered":"2024-09-21T01:12:11.312592+0000","last_unstale":"2024-09-21T01:12:56.328152+0000","last_undegraded":"2024-09-21T01:12:56.328152+0000","last_fullsized":"2024-09-21T01:12:56.328152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.074667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675558+0000","last_change":"2024-09-21T01:12:09.297088+0000","last_active":"2024-09-21T01:12:55.675558+0000","last_peered":"2024-09-21T01:12:55.675558+0000","last_clean":"2024-09-21T01:12:55.675558+0000","last_became_active":"2024-09-21T01:12:09.296707+0000","last_became_peered":"2024-09-21T01:12:09.296707+0000","last_unstale":"2024-09-21T01:12:55.675558+0000","last_undegraded":"2024-09-21T01:12:55.675558+0000","last_fullsized":"2024-09-21T01:12:55.675558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:50.138586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676109+0000","last_change":"2024-09-21T01:12:11.300991+0000","last_active":"2024-09-21T01:12:55.676109+0000","last_peered":"2024-09-21T01:12:55.676109+0000","last_clean":"2024-09-21T01:12:55.676109+0000","last_became_active":"2024-09-21T01:12:11.299934+0000","last_became_peered":"2024-09-21T01:12:11.299934+0000","last_unstale":"2024-09-21T01:12:55.676109+0000","last_undegraded":"2024-09-21T01:12:55.676109+0000","last_fullsized":"2024-09-21T01:12:55.676109+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:34.300051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671316+0000","last_change":"2024-09-21T01:12:09.511289+0000","last_active":"2024-09-21T01:12:55.671316+0000","last_peered":"2024-09-21T01:12:55.671316+0000","last_clean":"2024-09-21T01:12:55.671316+0000","last_became_active":"2024-09-21T01:12:09.510879+0000","last_became_peered":"2024-09-21T01:12:09.510879+0000","last_unstale":"2024-09-21T01:12:55.671316+0000","last_undegraded":"2024-09-21T01:12:55.671316+0000","last_fullsized":"2024-09-21T01:12:55.671316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:37.950305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671053+0000","last_change":"2024-09-21T01:12:11.312100+0000","last_active":"2024-09-21T01:12:55.671053+0000","last_peered":"2024-09-21T01:12:55.671053+0000","last_clean":"2024-09-21T01:12:55.671053+0000","last_became_active":"2024-09-21T01:12:11.311731+0000","last_became_peered":"2024-09-21T01:12:11.311731+0000","last_unstale":"2024-09-21T01:12:55.671053+0000","last_undegraded":"2024-09-21T01:12:55.671053+0000","last_fullsized":"2024-09-21T01:12:55.671053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:40.459020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674164+0000","last_change":"2024-09-21T01:12:09.294759+0000","last_active":"2024-09-21T01:12:55.674164+0000","last_peered":"2024-09-21T01:12:55.674164+0000","last_clean":"2024-09-21T01:12:55.674164+0000","last_became_active":"2024-09-21T01:12:09.294391+0000","last_became_peered":"2024-09-21T01:12:09.294391+0000","last_unstale":"2024-09-21T01:12:55.674164+0000","last_undegraded":"2024-09-21T01:12:55.674164+0000","last_fullsized":"2024-09-21T01:12:55.674164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:05.981058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70449,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":328,"num_read_kb":238,"num_write":164,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":211347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776153,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":815104,"data_stored":396084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1519616,"data_stored":1054404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103203,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":831488,"data_stored":396320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299432,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":831488,"data_stored":396240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495660,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1425408,"data_stored":988170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":819200,"data_stored":395709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32592,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712560,"statfs":{"total":95995035648,"available":95961661440,"internally_reserved":0,"allocated":1437696,"data_stored":987463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40316,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704836,"statfs":{"total":95995035648,"available":95953752064,"internally_reserved":0,"allocated":823296,"data_stored":396537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149759,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":396020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":913408,"data_stored":463300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":461950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":396980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:13:16.134 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:13:16.392 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:16.773 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:16 smithi148 ceph-mon[31000]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:16.773 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:16 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:16.773 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:16 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:16.773 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:16 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:16.774 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:16 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:16.774 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:16 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:16.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:16 smithi181 ceph-mon[34811]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:16.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:16 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:16.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:16 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:16.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:16 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:16.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:16 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:16.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:16 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:16.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:16 smithi157 ceph-mon[34140]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:16.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:16 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:16.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:16 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:16.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:16 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:16.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:16 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:16.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:16 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.902+0000 7f6214bd0640 1 -- 172.21.15.148:0/2068265575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6210109df0 msgr2=0x7f6210110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:17.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.902+0000 7f6214bd0640 1 --2- 172.21.15.148:0/2068265575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6210109df0 0x7f6210110620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6208009ca0 tx=0x7f620802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.902+0000 7f6214bd0640 1 -- 172.21.15.148:0/2068265575 shutdown_connections 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.902+0000 7f6214bd0640 1 --2- 172.21.15.148:0/2068265575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6210109df0 0x7f6210110620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.902+0000 7f6214bd0640 1 --2- 172.21.15.148:0/2068265575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62101094a0 0x7f62101098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.902+0000 7f6214bd0640 1 --2- 172.21.15.148:0/2068265575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6210103b60 0x7f6210103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.902+0000 7f6214bd0640 1 -- 172.21.15.148:0/2068265575 >> 172.21.15.148:0/2068265575 conn(0x7f621007b850 msgr2=0x7f621007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.902+0000 7f6214bd0640 1 -- 172.21.15.148:0/2068265575 shutdown_connections 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.902+0000 7f6214bd0640 1 -- 172.21.15.148:0/2068265575 wait complete. 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.903+0000 7f6214bd0640 1 Processor -- start 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.903+0000 7f6214bd0640 1 -- start start 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f6214bd0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6210103b60 0x7f621019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f6214bd0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62101094a0 0x7f621019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f6214bd0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6210109df0 0x7f621019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f6214bd0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6210113ab0 con 0x7f6210109df0 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f6214bd0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6210113930 con 0x7f6210103b60 2024-09-21T01:13:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f6214bd0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6210113c30 con 0x7f62101094a0 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f620ed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6210109df0 0x7f621019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f620ed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6210109df0 0x7f621019fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40868/0 (socket says 172.21.15.148:40868) 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f620ed9d640 1 -- 172.21.15.148:0/1442164164 learned_addr learned my addr 172.21.15.148:0/1442164164 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f6205d9b640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62101094a0 0x7f621019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f620e59c640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6210103b60 0x7f621019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f620ed9d640 1 -- 172.21.15.148:0/1442164164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62101094a0 msgr2=0x7f621019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f620ed9d640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62101094a0 0x7f621019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f620ed9d640 1 -- 172.21.15.148:0/1442164164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6210103b60 msgr2=0x7f621019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f620ed9d640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6210103b60 0x7f621019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f620ed9d640 1 -- 172.21.15.148:0/1442164164 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62101a03b0 con 0x7f6210109df0 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.904+0000 7f620ed9d640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6210109df0 0x7f621019fc80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6208005cc0 tx=0x7f620802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.905+0000 7f6207fff640 1 -- 172.21.15.148:0/1442164164 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208003bf0 con 0x7f6210109df0 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.905+0000 7f6214bd0640 1 -- 172.21.15.148:0/1442164164 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62101a0640 con 0x7f6210109df0 2024-09-21T01:13:17.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.905+0000 7f6207fff640 1 -- 172.21.15.148:0/1442164164 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6208003d90 con 0x7f6210109df0 2024-09-21T01:13:17.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.905+0000 7f6207fff640 1 -- 172.21.15.148:0/1442164164 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620802fbc0 con 0x7f6210109df0 2024-09-21T01:13:17.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.905+0000 7f6214bd0640 1 -- 172.21.15.148:0/1442164164 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62101a6e00 con 0x7f6210109df0 2024-09-21T01:13:17.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.906+0000 7f6214bd0640 1 -- 172.21.15.148:0/1442164164 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6210103f70 con 0x7f6210109df0 2024-09-21T01:13:17.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.907+0000 7f6207fff640 1 -- 172.21.15.148:0/1442164164 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f620802fd60 con 0x7f6210109df0 2024-09-21T01:13:17.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.908+0000 7f6207fff640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f61fc0b65a0 0x7f61fc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:17.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.908+0000 7f620e59c640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f61fc0b65a0 0x7f61fc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:17.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.908+0000 7f6207fff640 1 -- 172.21.15.148:0/1442164164 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f6208108a70 con 0x7f6210109df0 2024-09-21T01:13:17.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.909+0000 7f620e59c640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f61fc0b65a0 0x7f61fc0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f620000bbe0 tx=0x7f620000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:17.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:16.911+0000 7f6207fff640 1 -- 172.21.15.148:0/1442164164 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62080cf1b0 con 0x7f6210109df0 2024-09-21T01:13:17.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.085+0000 7f6214bd0640 1 -- 172.21.15.148:0/1442164164 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6210063800 con 0x7f61fc0b65a0 2024-09-21T01:13:17.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.089+0000 7f6207fff640 1 -- 172.21.15.148:0/1442164164 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258699 (secure 0 0 0) 0x7f6210063800 con 0x7f61fc0b65a0 2024-09-21T01:13:17.092 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:17.093 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-21T01:13:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 -- 172.21.15.148:0/1442164164 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f61fc0b65a0 msgr2=0x7f61fc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f61fc0b65a0 0x7f61fc0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f620000bbe0 tx=0x7f620000b390 comp rx=0 tx=0).stop 2024-09-21T01:13:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 -- 172.21.15.148:0/1442164164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6210109df0 msgr2=0x7f621019fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6210109df0 0x7f621019fc80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6208005cc0 tx=0x7f620802f380 comp rx=0 tx=0).stop 2024-09-21T01:13:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 -- 172.21.15.148:0/1442164164 shutdown_connections 2024-09-21T01:13:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f61fc0b65a0 0x7f61fc0b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6210109df0 0x7f621019fc80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62101094a0 0x7f621019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 --2- 172.21.15.148:0/1442164164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6210103b60 0x7f621019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:17.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 -- 172.21.15.148:0/1442164164 >> 172.21.15.148:0/1442164164 conn(0x7f621007b850 msgr2=0x7f6210105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:17.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 -- 172.21.15.148:0/1442164164 shutdown_connections 2024-09-21T01:13:17.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:17.092+0000 7f6214bd0640 1 -- 172.21.15.148:0/1442164164 wait complete. 2024-09-21T01:13:17.706 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-21T01:13:16.327169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661051,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":429,"num_read_kb":312,"num_write":289,"num_write_kb":2271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390132,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551692,"statfs":{"total":1151940427776,"available":1151540932608,"internally_reserved":0,"allocated":11980800,"data_stored":6729177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003343"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671714+0000","last_change":"2024-09-21T01:12:11.314815+0000","last_active":"2024-09-21T01:12:55.671714+0000","last_peered":"2024-09-21T01:12:55.671714+0000","last_clean":"2024-09-21T01:12:55.671714+0000","last_became_active":"2024-09-21T01:12:11.314139+0000","last_became_peered":"2024-09-21T01:12:11.314139+0000","last_unstale":"2024-09-21T01:12:55.671714+0000","last_undegraded":"2024-09-21T01:12:55.671714+0000","last_fullsized":"2024-09-21T01:12:55.671714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.538846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675365+0000","last_change":"2024-09-21T01:12:11.309915+0000","last_active":"2024-09-21T01:12:55.675365+0000","last_peered":"2024-09-21T01:12:55.675365+0000","last_clean":"2024-09-21T01:12:55.675365+0000","last_became_active":"2024-09-21T01:12:11.309551+0000","last_became_peered":"2024-09-21T01:12:11.309551+0000","last_unstale":"2024-09-21T01:12:55.675365+0000","last_undegraded":"2024-09-21T01:12:55.675365+0000","last_fullsized":"2024-09-21T01:12:55.675365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.568041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676670+0000","last_change":"2024-09-21T01:12:11.306393+0000","last_active":"2024-09-21T01:12:55.676670+0000","last_peered":"2024-09-21T01:12:55.676670+0000","last_clean":"2024-09-21T01:12:55.676670+0000","last_became_active":"2024-09-21T01:12:11.306035+0000","last_became_peered":"2024-09-21T01:12:11.306035+0000","last_unstale":"2024-09-21T01:12:55.676670+0000","last_undegraded":"2024-09-21T01:12:55.676670+0000","last_fullsized":"2024-09-21T01:12:55.676670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:20.528141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784401+0000","last_change":"2024-09-21T01:12:11.302339+0000","last_active":"2024-09-21T01:12:55.784401+0000","last_peered":"2024-09-21T01:12:55.784401+0000","last_clean":"2024-09-21T01:12:55.784401+0000","last_became_active":"2024-09-21T01:12:11.301890+0000","last_became_peered":"2024-09-21T01:12:11.301890+0000","last_unstale":"2024-09-21T01:12:55.784401+0000","last_undegraded":"2024-09-21T01:12:55.784401+0000","last_fullsized":"2024-09-21T01:12:55.784401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:34.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675728+0000","last_change":"2024-09-21T01:12:11.299171+0000","last_active":"2024-09-21T01:12:55.675728+0000","last_peered":"2024-09-21T01:12:55.675728+0000","last_clean":"2024-09-21T01:12:55.675728+0000","last_became_active":"2024-09-21T01:12:11.298764+0000","last_became_peered":"2024-09-21T01:12:11.298764+0000","last_unstale":"2024-09-21T01:12:55.675728+0000","last_undegraded":"2024-09-21T01:12:55.675728+0000","last_fullsized":"2024-09-21T01:12:55.675728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:02.078587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669113+0000","last_change":"2024-09-21T01:12:11.307909+0000","last_active":"2024-09-21T01:12:55.669113+0000","last_peered":"2024-09-21T01:12:55.669113+0000","last_clean":"2024-09-21T01:12:55.669113+0000","last_became_active":"2024-09-21T01:12:11.307546+0000","last_became_peered":"2024-09-21T01:12:11.307546+0000","last_unstale":"2024-09-21T01:12:55.669113+0000","last_undegraded":"2024-09-21T01:12:55.669113+0000","last_fullsized":"2024-09-21T01:12:55.669113+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:48.683684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674277+0000","last_change":"2024-09-21T01:12:11.309402+0000","last_active":"2024-09-21T01:12:55.674277+0000","last_peered":"2024-09-21T01:12:55.674277+0000","last_clean":"2024-09-21T01:12:55.674277+0000","last_became_active":"2024-09-21T01:12:11.309019+0000","last_became_peered":"2024-09-21T01:12:11.309019+0000","last_unstale":"2024-09-21T01:12:55.674277+0000","last_undegraded":"2024-09-21T01:12:55.674277+0000","last_fullsized":"2024-09-21T01:12:55.674277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:55.020239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670562+0000","last_change":"2024-09-21T01:12:11.308589+0000","last_active":"2024-09-21T01:12:55.670562+0000","last_peered":"2024-09-21T01:12:55.670562+0000","last_clean":"2024-09-21T01:12:55.670562+0000","last_became_active":"2024-09-21T01:12:11.308133+0000","last_became_peered":"2024-09-21T01:12:11.308133+0000","last_unstale":"2024-09-21T01:12:55.670562+0000","last_undegraded":"2024-09-21T01:12:55.670562+0000","last_fullsized":"2024-09-21T01:12:55.670562+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:15.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.681115+0000","last_change":"2024-09-21T01:12:55.681017+0000","last_active":"2024-09-21T01:12:55.681115+0000","last_peered":"2024-09-21T01:12:55.681115+0000","last_clean":"2024-09-21T01:12:55.681115+0000","last_became_active":"2024-09-21T01:12:55.680594+0000","last_became_peered":"2024-09-21T01:12:55.680594+0000","last_unstale":"2024-09-21T01:12:55.681115+0000","last_undegraded":"2024-09-21T01:12:55.681115+0000","last_fullsized":"2024-09-21T01:12:55.681115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.847129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669516+0000","last_change":"2024-09-21T01:12:11.311426+0000","last_active":"2024-09-21T01:12:55.669516+0000","last_peered":"2024-09-21T01:12:55.669516+0000","last_clean":"2024-09-21T01:12:55.669516+0000","last_became_active":"2024-09-21T01:12:11.309351+0000","last_became_peered":"2024-09-21T01:12:11.309351+0000","last_unstale":"2024-09-21T01:12:55.669516+0000","last_undegraded":"2024-09-21T01:12:55.669516+0000","last_fullsized":"2024-09-21T01:12:55.669516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:31.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674782+0000","last_change":"2024-09-21T01:12:11.312171+0000","last_active":"2024-09-21T01:12:55.674782+0000","last_peered":"2024-09-21T01:12:55.674782+0000","last_clean":"2024-09-21T01:12:55.674782+0000","last_became_active":"2024-09-21T01:12:11.311542+0000","last_became_peered":"2024-09-21T01:12:11.311542+0000","last_unstale":"2024-09-21T01:12:55.674782+0000","last_undegraded":"2024-09-21T01:12:55.674782+0000","last_fullsized":"2024-09-21T01:12:55.674782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:13.257463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784543+0000","last_change":"2024-09-21T01:12:11.301344+0000","last_active":"2024-09-21T01:12:55.784543+0000","last_peered":"2024-09-21T01:12:55.784543+0000","last_clean":"2024-09-21T01:12:55.784543+0000","last_became_active":"2024-09-21T01:12:11.300593+0000","last_became_peered":"2024-09-21T01:12:11.300593+0000","last_unstale":"2024-09-21T01:12:55.784543+0000","last_undegraded":"2024-09-21T01:12:55.784543+0000","last_fullsized":"2024-09-21T01:12:55.784543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:12.659972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823191+0000","last_change":"2024-09-21T01:12:11.298690+0000","last_active":"2024-09-21T01:12:55.823191+0000","last_peered":"2024-09-21T01:12:55.823191+0000","last_clean":"2024-09-21T01:12:55.823191+0000","last_became_active":"2024-09-21T01:12:11.298418+0000","last_became_peered":"2024-09-21T01:12:11.298418+0000","last_unstale":"2024-09-21T01:12:55.823191+0000","last_undegraded":"2024-09-21T01:12:55.823191+0000","last_fullsized":"2024-09-21T01:12:55.823191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:08.311791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675752+0000","last_change":"2024-09-21T01:12:11.299382+0000","last_active":"2024-09-21T01:12:55.675752+0000","last_peered":"2024-09-21T01:12:55.675752+0000","last_clean":"2024-09-21T01:12:55.675752+0000","last_became_active":"2024-09-21T01:12:11.298428+0000","last_became_peered":"2024-09-21T01:12:11.298428+0000","last_unstale":"2024-09-21T01:12:55.675752+0000","last_undegraded":"2024-09-21T01:12:55.675752+0000","last_fullsized":"2024-09-21T01:12:55.675752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:02.472994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674719+0000","last_change":"2024-09-21T01:12:11.305018+0000","last_active":"2024-09-21T01:12:55.674719+0000","last_peered":"2024-09-21T01:12:55.674719+0000","last_clean":"2024-09-21T01:12:55.674719+0000","last_became_active":"2024-09-21T01:12:11.304607+0000","last_became_peered":"2024-09-21T01:12:11.304607+0000","last_unstale":"2024-09-21T01:12:55.674719+0000","last_undegraded":"2024-09-21T01:12:55.674719+0000","last_fullsized":"2024-09-21T01:12:55.674719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:39.552633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.327961+0000","last_change":"2024-09-21T01:12:11.308846+0000","last_active":"2024-09-21T01:12:56.327961+0000","last_peered":"2024-09-21T01:12:56.327961+0000","last_clean":"2024-09-21T01:12:56.327961+0000","last_became_active":"2024-09-21T01:12:11.308486+0000","last_became_peered":"2024-09-21T01:12:11.308486+0000","last_unstale":"2024-09-21T01:12:56.327961+0000","last_undegraded":"2024-09-21T01:12:56.327961+0000","last_fullsized":"2024-09-21T01:12:56.327961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:29.072947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671796+0000","last_change":"2024-09-21T01:12:11.316277+0000","last_active":"2024-09-21T01:12:55.671796+0000","last_peered":"2024-09-21T01:12:55.671796+0000","last_clean":"2024-09-21T01:12:55.671796+0000","last_became_active":"2024-09-21T01:12:11.315364+0000","last_became_peered":"2024-09-21T01:12:11.315364+0000","last_unstale":"2024-09-21T01:12:55.671796+0000","last_undegraded":"2024-09-21T01:12:55.671796+0000","last_fullsized":"2024-09-21T01:12:55.671796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:50.281556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673807+0000","last_change":"2024-09-21T01:12:11.300761+0000","last_active":"2024-09-21T01:12:55.673807+0000","last_peered":"2024-09-21T01:12:55.673807+0000","last_clean":"2024-09-21T01:12:55.673807+0000","last_became_active":"2024-09-21T01:12:11.300343+0000","last_became_peered":"2024-09-21T01:12:11.300343+0000","last_unstale":"2024-09-21T01:12:55.673807+0000","last_undegraded":"2024-09-21T01:12:55.673807+0000","last_fullsized":"2024-09-21T01:12:55.673807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:29.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674595+0000","last_change":"2024-09-21T01:12:11.305370+0000","last_active":"2024-09-21T01:12:55.674595+0000","last_peered":"2024-09-21T01:12:55.674595+0000","last_clean":"2024-09-21T01:12:55.674595+0000","last_became_active":"2024-09-21T01:12:11.304991+0000","last_became_peered":"2024-09-21T01:12:11.304991+0000","last_unstale":"2024-09-21T01:12:55.674595+0000","last_undegraded":"2024-09-21T01:12:55.674595+0000","last_fullsized":"2024-09-21T01:12:55.674595+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:12.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671227+0000","last_change":"2024-09-21T01:12:11.303981+0000","last_active":"2024-09-21T01:12:55.671227+0000","last_peered":"2024-09-21T01:12:55.671227+0000","last_clean":"2024-09-21T01:12:55.671227+0000","last_became_active":"2024-09-21T01:12:11.303602+0000","last_became_peered":"2024-09-21T01:12:11.303602+0000","last_unstale":"2024-09-21T01:12:55.671227+0000","last_undegraded":"2024-09-21T01:12:55.671227+0000","last_fullsized":"2024-09-21T01:12:55.671227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:24.513365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823170+0000","last_change":"2024-09-21T01:12:11.302849+0000","last_active":"2024-09-21T01:12:55.823170+0000","last_peered":"2024-09-21T01:12:55.823170+0000","last_clean":"2024-09-21T01:12:55.823170+0000","last_became_active":"2024-09-21T01:12:11.302487+0000","last_became_peered":"2024-09-21T01:12:11.302487+0000","last_unstale":"2024-09-21T01:12:55.823170+0000","last_undegraded":"2024-09-21T01:12:55.823170+0000","last_fullsized":"2024-09-21T01:12:55.823170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:44.174213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328126+0000","last_change":"2024-09-21T01:12:11.315578+0000","last_active":"2024-09-21T01:12:56.328126+0000","last_peered":"2024-09-21T01:12:56.328126+0000","last_clean":"2024-09-21T01:12:56.328126+0000","last_became_active":"2024-09-21T01:12:11.315174+0000","last_became_peered":"2024-09-21T01:12:11.315174+0000","last_unstale":"2024-09-21T01:12:56.328126+0000","last_undegraded":"2024-09-21T01:12:56.328126+0000","last_fullsized":"2024-09-21T01:12:56.328126+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:46.172101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670587+0000","last_change":"2024-09-21T01:12:11.308086+0000","last_active":"2024-09-21T01:12:55.670587+0000","last_peered":"2024-09-21T01:12:55.670587+0000","last_clean":"2024-09-21T01:12:55.670587+0000","last_became_active":"2024-09-21T01:12:11.307248+0000","last_became_peered":"2024-09-21T01:12:11.307248+0000","last_unstale":"2024-09-21T01:12:55.670587+0000","last_undegraded":"2024-09-21T01:12:55.670587+0000","last_fullsized":"2024-09-21T01:12:55.670587+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:11.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.678445+0000","last_change":"2024-09-21T01:12:11.301672+0000","last_active":"2024-09-21T01:12:55.678445+0000","last_peered":"2024-09-21T01:12:55.678445+0000","last_clean":"2024-09-21T01:12:55.678445+0000","last_became_active":"2024-09-21T01:12:11.298775+0000","last_became_peered":"2024-09-21T01:12:11.298775+0000","last_unstale":"2024-09-21T01:12:55.678445+0000","last_undegraded":"2024-09-21T01:12:55.678445+0000","last_fullsized":"2024-09-21T01:12:55.678445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:30.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670851+0000","last_change":"2024-09-21T01:12:11.311947+0000","last_active":"2024-09-21T01:12:55.670851+0000","last_peered":"2024-09-21T01:12:55.670851+0000","last_clean":"2024-09-21T01:12:55.670851+0000","last_became_active":"2024-09-21T01:12:11.311616+0000","last_became_peered":"2024-09-21T01:12:11.311616+0000","last_unstale":"2024-09-21T01:12:55.670851+0000","last_undegraded":"2024-09-21T01:12:55.670851+0000","last_fullsized":"2024-09-21T01:12:55.670851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:25.727807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675065+0000","last_change":"2024-09-21T01:12:11.312161+0000","last_active":"2024-09-21T01:12:55.675065+0000","last_peered":"2024-09-21T01:12:55.675065+0000","last_clean":"2024-09-21T01:12:55.675065+0000","last_became_active":"2024-09-21T01:12:11.311781+0000","last_became_peered":"2024-09-21T01:12:11.311781+0000","last_unstale":"2024-09-21T01:12:55.675065+0000","last_undegraded":"2024-09-21T01:12:55.675065+0000","last_fullsized":"2024-09-21T01:12:55.675065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:01.923801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671385+0000","last_change":"2024-09-21T01:12:11.310698+0000","last_active":"2024-09-21T01:12:55.671385+0000","last_peered":"2024-09-21T01:12:55.671385+0000","last_clean":"2024-09-21T01:12:55.671385+0000","last_became_active":"2024-09-21T01:12:11.310226+0000","last_became_peered":"2024-09-21T01:12:11.310226+0000","last_unstale":"2024-09-21T01:12:55.671385+0000","last_undegraded":"2024-09-21T01:12:55.671385+0000","last_fullsized":"2024-09-21T01:12:55.671385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:27.428457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823133+0000","last_change":"2024-09-21T01:12:11.294598+0000","last_active":"2024-09-21T01:12:55.823133+0000","last_peered":"2024-09-21T01:12:55.823133+0000","last_clean":"2024-09-21T01:12:55.823133+0000","last_became_active":"2024-09-21T01:12:11.293899+0000","last_became_peered":"2024-09-21T01:12:11.293899+0000","last_unstale":"2024-09-21T01:12:55.823133+0000","last_undegraded":"2024-09-21T01:12:55.823133+0000","last_fullsized":"2024-09-21T01:12:55.823133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.843199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675358+0000","last_change":"2024-09-21T01:12:11.295143+0000","last_active":"2024-09-21T01:12:55.675358+0000","last_peered":"2024-09-21T01:12:55.675358+0000","last_clean":"2024-09-21T01:12:55.675358+0000","last_became_active":"2024-09-21T01:12:11.294787+0000","last_became_peered":"2024-09-21T01:12:11.294787+0000","last_unstale":"2024-09-21T01:12:55.675358+0000","last_undegraded":"2024-09-21T01:12:55.675358+0000","last_fullsized":"2024-09-21T01:12:55.675358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:34.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679505+0000","last_change":"2024-09-21T01:12:55.679399+0000","last_active":"2024-09-21T01:12:55.679505+0000","last_peered":"2024-09-21T01:12:55.679505+0000","last_clean":"2024-09-21T01:12:55.679505+0000","last_became_active":"2024-09-21T01:12:55.678933+0000","last_became_peered":"2024-09-21T01:12:55.678933+0000","last_unstale":"2024-09-21T01:12:55.679505+0000","last_undegraded":"2024-09-21T01:12:55.679505+0000","last_fullsized":"2024-09-21T01:12:55.679505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:20.204715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.680830+0000","last_change":"2024-09-21T01:12:55.680711+0000","last_active":"2024-09-21T01:12:55.680830+0000","last_peered":"2024-09-21T01:12:55.680830+0000","last_clean":"2024-09-21T01:12:55.680830+0000","last_became_active":"2024-09-21T01:12:55.680257+0000","last_became_peered":"2024-09-21T01:12:55.680257+0000","last_unstale":"2024-09-21T01:12:55.680830+0000","last_undegraded":"2024-09-21T01:12:55.680830+0000","last_fullsized":"2024-09-21T01:12:55.680830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:03.610951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671133+0000","last_change":"2024-09-21T01:12:11.308355+0000","last_active":"2024-09-21T01:12:55.671133+0000","last_peered":"2024-09-21T01:12:55.671133+0000","last_clean":"2024-09-21T01:12:55.671133+0000","last_became_active":"2024-09-21T01:12:11.307919+0000","last_became_peered":"2024-09-21T01:12:11.307919+0000","last_unstale":"2024-09-21T01:12:55.671133+0000","last_undegraded":"2024-09-21T01:12:55.671133+0000","last_fullsized":"2024-09-21T01:12:55.671133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:59.869646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674536+0000","last_change":"2024-09-21T01:12:11.298905+0000","last_active":"2024-09-21T01:12:55.674536+0000","last_peered":"2024-09-21T01:12:55.674536+0000","last_clean":"2024-09-21T01:12:55.674536+0000","last_became_active":"2024-09-21T01:12:11.298512+0000","last_became_peered":"2024-09-21T01:12:11.298512+0000","last_unstale":"2024-09-21T01:12:55.674536+0000","last_undegraded":"2024-09-21T01:12:55.674536+0000","last_fullsized":"2024-09-21T01:12:55.674536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:05.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":85,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:14.363120+0000","last_change":"2024-09-21T01:12:09.294881+0000","last_active":"2024-09-21T01:13:14.363120+0000","last_peered":"2024-09-21T01:13:14.363120+0000","last_clean":"2024-09-21T01:13:14.363120+0000","last_became_active":"2024-09-21T01:12:09.294513+0000","last_became_peered":"2024-09-21T01:12:09.294513+0000","last_unstale":"2024-09-21T01:13:14.363120+0000","last_undegraded":"2024-09-21T01:13:14.363120+0000","last_fullsized":"2024-09-21T01:13:14.363120+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:07.193879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676365+0000","last_change":"2024-09-21T01:12:55.676259+0000","last_active":"2024-09-21T01:12:55.676365+0000","last_peered":"2024-09-21T01:12:55.676365+0000","last_clean":"2024-09-21T01:12:55.676365+0000","last_became_active":"2024-09-21T01:12:55.675810+0000","last_became_peered":"2024-09-21T01:12:55.675810+0000","last_unstale":"2024-09-21T01:12:55.676365+0000","last_undegraded":"2024-09-21T01:12:55.676365+0000","last_fullsized":"2024-09-21T01:12:55.676365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:34.985195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669122+0000","last_change":"2024-09-21T01:12:09.298594+0000","last_active":"2024-09-21T01:12:55.669122+0000","last_peered":"2024-09-21T01:12:55.669122+0000","last_clean":"2024-09-21T01:12:55.669122+0000","last_became_active":"2024-09-21T01:12:09.298130+0000","last_became_peered":"2024-09-21T01:12:09.298130+0000","last_unstale":"2024-09-21T01:12:55.669122+0000","last_undegraded":"2024-09-21T01:12:55.669122+0000","last_fullsized":"2024-09-21T01:12:55.669122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.964507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822858+0000","last_change":"2024-09-21T01:12:09.295997+0000","last_active":"2024-09-21T01:12:55.822858+0000","last_peered":"2024-09-21T01:12:55.822858+0000","last_clean":"2024-09-21T01:12:55.822858+0000","last_became_active":"2024-09-21T01:12:09.295472+0000","last_became_peered":"2024-09-21T01:12:09.295472+0000","last_unstale":"2024-09-21T01:12:55.822858+0000","last_undegraded":"2024-09-21T01:12:55.822858+0000","last_fullsized":"2024-09-21T01:12:55.822858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:25.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670737+0000","last_change":"2024-09-21T01:12:11.306468+0000","last_active":"2024-09-21T01:12:55.670737+0000","last_peered":"2024-09-21T01:12:55.670737+0000","last_clean":"2024-09-21T01:12:55.670737+0000","last_became_active":"2024-09-21T01:12:11.304186+0000","last_became_peered":"2024-09-21T01:12:11.304186+0000","last_unstale":"2024-09-21T01:12:55.670737+0000","last_undegraded":"2024-09-21T01:12:55.670737+0000","last_fullsized":"2024-09-21T01:12:55.670737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:28.564879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.678732+0000","last_change":"2024-09-21T01:12:09.295004+0000","last_active":"2024-09-21T01:12:55.678732+0000","last_peered":"2024-09-21T01:12:55.678732+0000","last_clean":"2024-09-21T01:12:55.678732+0000","last_became_active":"2024-09-21T01:12:09.294655+0000","last_became_peered":"2024-09-21T01:12:09.294655+0000","last_unstale":"2024-09-21T01:12:55.678732+0000","last_undegraded":"2024-09-21T01:12:55.678732+0000","last_fullsized":"2024-09-21T01:12:55.678732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:35.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.672777+0000","last_change":"2024-09-21T01:12:11.304252+0000","last_active":"2024-09-21T01:12:55.672777+0000","last_peered":"2024-09-21T01:12:55.672777+0000","last_clean":"2024-09-21T01:12:55.672777+0000","last_became_active":"2024-09-21T01:12:11.303876+0000","last_became_peered":"2024-09-21T01:12:11.303876+0000","last_unstale":"2024-09-21T01:12:55.672777+0000","last_undegraded":"2024-09-21T01:12:55.672777+0000","last_fullsized":"2024-09-21T01:12:55.672777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:48.460538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":81,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:14.362271+0000","last_change":"2024-09-21T01:12:09.298976+0000","last_active":"2024-09-21T01:13:14.362271+0000","last_peered":"2024-09-21T01:13:14.362271+0000","last_clean":"2024-09-21T01:13:14.362271+0000","last_became_active":"2024-09-21T01:12:09.298664+0000","last_became_peered":"2024-09-21T01:12:09.298664+0000","last_unstale":"2024-09-21T01:13:14.362271+0000","last_undegraded":"2024-09-21T01:13:14.362271+0000","last_fullsized":"2024-09-21T01:13:14.362271+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:58.157391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328582+0000","last_change":"2024-09-21T01:12:11.313400+0000","last_active":"2024-09-21T01:12:56.328582+0000","last_peered":"2024-09-21T01:12:56.328582+0000","last_clean":"2024-09-21T01:12:56.328582+0000","last_became_active":"2024-09-21T01:12:11.312940+0000","last_became_peered":"2024-09-21T01:12:11.312940+0000","last_unstale":"2024-09-21T01:12:56.328582+0000","last_undegraded":"2024-09-21T01:12:56.328582+0000","last_fullsized":"2024-09-21T01:12:56.328582+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:22.224157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674784+0000","last_change":"2024-09-21T01:12:09.299266+0000","last_active":"2024-09-21T01:12:55.674784+0000","last_peered":"2024-09-21T01:12:55.674784+0000","last_clean":"2024-09-21T01:12:55.674784+0000","last_became_active":"2024-09-21T01:12:09.298932+0000","last_became_peered":"2024-09-21T01:12:09.298932+0000","last_unstale":"2024-09-21T01:12:55.674784+0000","last_undegraded":"2024-09-21T01:12:55.674784+0000","last_fullsized":"2024-09-21T01:12:55.674784+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:51.546829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.681771+0000","last_change":"2024-09-21T01:12:55.681618+0000","last_active":"2024-09-21T01:12:55.681771+0000","last_peered":"2024-09-21T01:12:55.681771+0000","last_clean":"2024-09-21T01:12:55.681771+0000","last_became_active":"2024-09-21T01:12:55.681211+0000","last_became_peered":"2024-09-21T01:12:55.681211+0000","last_unstale":"2024-09-21T01:12:55.681771+0000","last_undegraded":"2024-09-21T01:12:55.681771+0000","last_fullsized":"2024-09-21T01:12:55.681771+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:24.588338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679447+0000","last_change":"2024-09-21T01:12:09.511908+0000","last_active":"2024-09-21T01:12:55.679447+0000","last_peered":"2024-09-21T01:12:55.679447+0000","last_clean":"2024-09-21T01:12:55.679447+0000","last_became_active":"2024-09-21T01:12:09.511550+0000","last_became_peered":"2024-09-21T01:12:09.511550+0000","last_unstale":"2024-09-21T01:12:55.679447+0000","last_undegraded":"2024-09-21T01:12:55.679447+0000","last_fullsized":"2024-09-21T01:12:55.679447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:08.743648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328216+0000","last_change":"2024-09-21T01:12:11.316005+0000","last_active":"2024-09-21T01:12:56.328216+0000","last_peered":"2024-09-21T01:12:56.328216+0000","last_clean":"2024-09-21T01:12:56.328216+0000","last_became_active":"2024-09-21T01:12:11.315245+0000","last_became_peered":"2024-09-21T01:12:11.315245+0000","last_unstale":"2024-09-21T01:12:56.328216+0000","last_undegraded":"2024-09-21T01:12:56.328216+0000","last_fullsized":"2024-09-21T01:12:56.328216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:50.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'31","reported_seq":173,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:15.363678+0000","last_change":"2024-09-21T01:12:09.300010+0000","last_active":"2024-09-21T01:13:15.363678+0000","last_peered":"2024-09-21T01:13:15.363678+0000","last_clean":"2024-09-21T01:13:15.363678+0000","last_became_active":"2024-09-21T01:12:09.299652+0000","last_became_peered":"2024-09-21T01:12:09.299652+0000","last_unstale":"2024-09-21T01:13:15.363678+0000","last_undegraded":"2024-09-21T01:13:15.363678+0000","last_fullsized":"2024-09-21T01:13:15.363678+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:18.610597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66448,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":124,"num_write":32,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675413+0000","last_change":"2024-09-21T01:12:11.308675+0000","last_active":"2024-09-21T01:12:55.675413+0000","last_peered":"2024-09-21T01:12:55.675413+0000","last_clean":"2024-09-21T01:12:55.675413+0000","last_became_active":"2024-09-21T01:12:11.308317+0000","last_became_peered":"2024-09-21T01:12:11.308317+0000","last_unstale":"2024-09-21T01:12:55.675413+0000","last_undegraded":"2024-09-21T01:12:55.675413+0000","last_fullsized":"2024-09-21T01:12:55.675413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:56.081404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673306+0000","last_change":"2024-09-21T01:12:09.293716+0000","last_active":"2024-09-21T01:12:55.673306+0000","last_peered":"2024-09-21T01:12:55.673306+0000","last_clean":"2024-09-21T01:12:55.673306+0000","last_became_active":"2024-09-21T01:12:09.293205+0000","last_became_peered":"2024-09-21T01:12:09.293205+0000","last_unstale":"2024-09-21T01:12:55.673306+0000","last_undegraded":"2024-09-21T01:12:55.673306+0000","last_fullsized":"2024-09-21T01:12:55.673306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:29.955953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822913+0000","last_change":"2024-09-21T01:12:11.302736+0000","last_active":"2024-09-21T01:12:55.822913+0000","last_peered":"2024-09-21T01:12:55.822913+0000","last_clean":"2024-09-21T01:12:55.822913+0000","last_became_active":"2024-09-21T01:12:11.302357+0000","last_became_peered":"2024-09-21T01:12:11.302357+0000","last_unstale":"2024-09-21T01:12:55.822913+0000","last_undegraded":"2024-09-21T01:12:55.822913+0000","last_fullsized":"2024-09-21T01:12:55.822913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:34.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.677786+0000","last_change":"2024-09-21T01:12:09.295258+0000","last_active":"2024-09-21T01:12:55.677786+0000","last_peered":"2024-09-21T01:12:55.677786+0000","last_clean":"2024-09-21T01:12:55.677786+0000","last_became_active":"2024-09-21T01:12:09.294872+0000","last_became_peered":"2024-09-21T01:12:09.294872+0000","last_unstale":"2024-09-21T01:12:55.677786+0000","last_undegraded":"2024-09-21T01:12:55.677786+0000","last_fullsized":"2024-09-21T01:12:55.677786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.216960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674608+0000","last_change":"2024-09-21T01:12:11.303413+0000","last_active":"2024-09-21T01:12:55.674608+0000","last_peered":"2024-09-21T01:12:55.674608+0000","last_clean":"2024-09-21T01:12:55.674608+0000","last_became_active":"2024-09-21T01:12:11.303002+0000","last_became_peered":"2024-09-21T01:12:11.303002+0000","last_unstale":"2024-09-21T01:12:55.674608+0000","last_undegraded":"2024-09-21T01:12:55.674608+0000","last_fullsized":"2024-09-21T01:12:55.674608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:55.984699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":85,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:14.362798+0000","last_change":"2024-09-21T01:12:09.297392+0000","last_active":"2024-09-21T01:13:14.362798+0000","last_peered":"2024-09-21T01:13:14.362798+0000","last_clean":"2024-09-21T01:13:14.362798+0000","last_became_active":"2024-09-21T01:12:09.296882+0000","last_became_peered":"2024-09-21T01:12:09.296882+0000","last_unstale":"2024-09-21T01:13:14.362798+0000","last_undegraded":"2024-09-21T01:13:14.362798+0000","last_fullsized":"2024-09-21T01:13:14.362798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.598362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674128+0000","last_change":"2024-09-21T01:12:11.308021+0000","last_active":"2024-09-21T01:12:55.674128+0000","last_peered":"2024-09-21T01:12:55.674128+0000","last_clean":"2024-09-21T01:12:55.674128+0000","last_became_active":"2024-09-21T01:12:11.307643+0000","last_became_peered":"2024-09-21T01:12:11.307643+0000","last_unstale":"2024-09-21T01:12:55.674128+0000","last_undegraded":"2024-09-21T01:12:55.674128+0000","last_fullsized":"2024-09-21T01:12:55.674128+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:55.569855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674898+0000","last_change":"2024-09-21T01:12:09.512120+0000","last_active":"2024-09-21T01:12:55.674898+0000","last_peered":"2024-09-21T01:12:55.674898+0000","last_clean":"2024-09-21T01:12:55.674898+0000","last_became_active":"2024-09-21T01:12:09.511631+0000","last_became_peered":"2024-09-21T01:12:09.511631+0000","last_unstale":"2024-09-21T01:12:55.674898+0000","last_undegraded":"2024-09-21T01:12:55.674898+0000","last_fullsized":"2024-09-21T01:12:55.674898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:13.187219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.677803+0000","last_change":"2024-09-21T01:12:11.301633+0000","last_active":"2024-09-21T01:12:55.677803+0000","last_peered":"2024-09-21T01:12:55.677803+0000","last_clean":"2024-09-21T01:12:55.677803+0000","last_became_active":"2024-09-21T01:12:11.300638+0000","last_became_peered":"2024-09-21T01:12:11.300638+0000","last_unstale":"2024-09-21T01:12:55.677803+0000","last_undegraded":"2024-09-21T01:12:55.677803+0000","last_fullsized":"2024-09-21T01:12:55.677803+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:42.245596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676059+0000","last_change":"2024-09-21T01:12:09.297694+0000","last_active":"2024-09-21T01:12:55.676059+0000","last_peered":"2024-09-21T01:12:55.676059+0000","last_clean":"2024-09-21T01:12:55.676059+0000","last_became_active":"2024-09-21T01:12:09.297127+0000","last_became_peered":"2024-09-21T01:12:09.297127+0000","last_unstale":"2024-09-21T01:12:55.676059+0000","last_undegraded":"2024-09-21T01:12:55.676059+0000","last_fullsized":"2024-09-21T01:12:55.676059+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:35.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671386+0000","last_change":"2024-09-21T01:12:11.303510+0000","last_active":"2024-09-21T01:12:55.671386+0000","last_peered":"2024-09-21T01:12:55.671386+0000","last_clean":"2024-09-21T01:12:55.671386+0000","last_became_active":"2024-09-21T01:12:11.303148+0000","last_became_peered":"2024-09-21T01:12:11.303148+0000","last_unstale":"2024-09-21T01:12:55.671386+0000","last_undegraded":"2024-09-21T01:12:55.671386+0000","last_fullsized":"2024-09-21T01:12:55.671386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:59.338185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823115+0000","last_change":"2024-09-21T01:12:09.293490+0000","last_active":"2024-09-21T01:12:55.823115+0000","last_peered":"2024-09-21T01:12:55.823115+0000","last_clean":"2024-09-21T01:12:55.823115+0000","last_became_active":"2024-09-21T01:12:09.293151+0000","last_became_peered":"2024-09-21T01:12:09.293151+0000","last_unstale":"2024-09-21T01:12:55.823115+0000","last_undegraded":"2024-09-21T01:12:55.823115+0000","last_fullsized":"2024-09-21T01:12:55.823115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:25.153547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674864+0000","last_change":"2024-09-21T01:12:11.311313+0000","last_active":"2024-09-21T01:12:55.674864+0000","last_peered":"2024-09-21T01:12:55.674864+0000","last_clean":"2024-09-21T01:12:55.674864+0000","last_became_active":"2024-09-21T01:12:11.310908+0000","last_became_peered":"2024-09-21T01:12:11.310908+0000","last_unstale":"2024-09-21T01:12:55.674864+0000","last_undegraded":"2024-09-21T01:12:55.674864+0000","last_fullsized":"2024-09-21T01:12:55.674864+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:15.070802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679574+0000","last_change":"2024-09-21T01:12:09.298861+0000","last_active":"2024-09-21T01:12:55.679574+0000","last_peered":"2024-09-21T01:12:55.679574+0000","last_clean":"2024-09-21T01:12:55.679574+0000","last_became_active":"2024-09-21T01:12:09.298504+0000","last_became_peered":"2024-09-21T01:12:09.298504+0000","last_unstale":"2024-09-21T01:12:55.679574+0000","last_undegraded":"2024-09-21T01:12:55.679574+0000","last_fullsized":"2024-09-21T01:12:55.679574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:10.446269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674565+0000","last_change":"2024-09-21T01:12:11.309656+0000","last_active":"2024-09-21T01:12:55.674565+0000","last_peered":"2024-09-21T01:12:55.674565+0000","last_clean":"2024-09-21T01:12:55.674565+0000","last_became_active":"2024-09-21T01:12:11.308515+0000","last_became_peered":"2024-09-21T01:12:11.308515+0000","last_unstale":"2024-09-21T01:12:55.674565+0000","last_undegraded":"2024-09-21T01:12:55.674565+0000","last_fullsized":"2024-09-21T01:12:55.674565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:38.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675314+0000","last_change":"2024-09-21T01:12:09.511434+0000","last_active":"2024-09-21T01:12:55.675314+0000","last_peered":"2024-09-21T01:12:55.675314+0000","last_clean":"2024-09-21T01:12:55.675314+0000","last_became_active":"2024-09-21T01:12:09.511043+0000","last_became_peered":"2024-09-21T01:12:09.511043+0000","last_unstale":"2024-09-21T01:12:55.675314+0000","last_undegraded":"2024-09-21T01:12:55.675314+0000","last_fullsized":"2024-09-21T01:12:55.675314+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:23.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674799+0000","last_change":"2024-09-21T01:12:11.311989+0000","last_active":"2024-09-21T01:12:55.674799+0000","last_peered":"2024-09-21T01:12:55.674799+0000","last_clean":"2024-09-21T01:12:55.674799+0000","last_became_active":"2024-09-21T01:12:11.310338+0000","last_became_peered":"2024-09-21T01:12:11.310338+0000","last_unstale":"2024-09-21T01:12:55.674799+0000","last_undegraded":"2024-09-21T01:12:55.674799+0000","last_fullsized":"2024-09-21T01:12:55.674799+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:12.675575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674409+0000","last_change":"2024-09-21T01:11:01.703479+0000","last_active":"2024-09-21T01:12:55.674409+0000","last_peered":"2024-09-21T01:12:55.674409+0000","last_clean":"2024-09-21T01:12:55.674409+0000","last_became_active":"2024-09-21T01:11:01.697351+0000","last_became_peered":"2024-09-21T01:11:01.697351+0000","last_unstale":"2024-09-21T01:12:55.674409+0000","last_undegraded":"2024-09-21T01:12:55.674409+0000","last_fullsized":"2024-09-21T01:12:55.674409+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_clean_scrub_stamp":"2024-09-21T01:07:43.096984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:18.858448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784499+0000","last_change":"2024-09-21T01:12:09.295468+0000","last_active":"2024-09-21T01:12:55.784499+0000","last_peered":"2024-09-21T01:12:55.784499+0000","last_clean":"2024-09-21T01:12:55.784499+0000","last_became_active":"2024-09-21T01:12:09.295092+0000","last_became_peered":"2024-09-21T01:12:09.295092+0000","last_unstale":"2024-09-21T01:12:55.784499+0000","last_undegraded":"2024-09-21T01:12:55.784499+0000","last_fullsized":"2024-09-21T01:12:55.784499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:08.153176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670981+0000","last_change":"2024-09-21T01:12:11.308460+0000","last_active":"2024-09-21T01:12:55.670981+0000","last_peered":"2024-09-21T01:12:55.670981+0000","last_clean":"2024-09-21T01:12:55.670981+0000","last_became_active":"2024-09-21T01:12:11.307764+0000","last_became_peered":"2024-09-21T01:12:11.307764+0000","last_unstale":"2024-09-21T01:12:55.670981+0000","last_undegraded":"2024-09-21T01:12:55.670981+0000","last_fullsized":"2024-09-21T01:12:55.670981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:32.094902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674341+0000","last_change":"2024-09-21T01:12:09.296477+0000","last_active":"2024-09-21T01:12:55.674341+0000","last_peered":"2024-09-21T01:12:55.674341+0000","last_clean":"2024-09-21T01:12:55.674341+0000","last_became_active":"2024-09-21T01:12:09.296153+0000","last_became_peered":"2024-09-21T01:12:09.296153+0000","last_unstale":"2024-09-21T01:12:55.674341+0000","last_undegraded":"2024-09-21T01:12:55.674341+0000","last_fullsized":"2024-09-21T01:12:55.674341+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:42.380668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822830+0000","last_change":"2024-09-21T01:12:11.297826+0000","last_active":"2024-09-21T01:12:55.822830+0000","last_peered":"2024-09-21T01:12:55.822830+0000","last_clean":"2024-09-21T01:12:55.822830+0000","last_became_active":"2024-09-21T01:12:11.297430+0000","last_became_peered":"2024-09-21T01:12:11.297430+0000","last_unstale":"2024-09-21T01:12:55.822830+0000","last_undegraded":"2024-09-21T01:12:55.822830+0000","last_fullsized":"2024-09-21T01:12:55.822830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:09.130500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:11.358042+0000","last_change":"2024-09-21T01:12:09.511173+0000","last_active":"2024-09-21T01:13:11.358042+0000","last_peered":"2024-09-21T01:13:11.358042+0000","last_clean":"2024-09-21T01:13:11.358042+0000","last_became_active":"2024-09-21T01:12:09.510840+0000","last_became_peered":"2024-09-21T01:12:09.510840+0000","last_unstale":"2024-09-21T01:13:11.358042+0000","last_undegraded":"2024-09-21T01:13:11.358042+0000","last_fullsized":"2024-09-21T01:13:11.358042+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:22.161708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.824933+0000","last_change":"2024-09-21T01:12:55.824825+0000","last_active":"2024-09-21T01:12:55.824933+0000","last_peered":"2024-09-21T01:12:55.824933+0000","last_clean":"2024-09-21T01:12:55.824933+0000","last_became_active":"2024-09-21T01:12:55.824253+0000","last_became_peered":"2024-09-21T01:12:55.824253+0000","last_unstale":"2024-09-21T01:12:55.824933+0000","last_undegraded":"2024-09-21T01:12:55.824933+0000","last_fullsized":"2024-09-21T01:12:55.824933+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:14.580270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674696+0000","last_change":"2024-09-21T01:12:09.295447+0000","last_active":"2024-09-21T01:12:55.674696+0000","last_peered":"2024-09-21T01:12:55.674696+0000","last_clean":"2024-09-21T01:12:55.674696+0000","last_became_active":"2024-09-21T01:12:09.295057+0000","last_became_peered":"2024-09-21T01:12:09.295057+0000","last_unstale":"2024-09-21T01:12:55.674696+0000","last_undegraded":"2024-09-21T01:12:55.674696+0000","last_fullsized":"2024-09-21T01:12:55.674696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:59.389877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669259+0000","last_change":"2024-09-21T01:12:11.304636+0000","last_active":"2024-09-21T01:12:55.669259+0000","last_peered":"2024-09-21T01:12:55.669259+0000","last_clean":"2024-09-21T01:12:55.669259+0000","last_became_active":"2024-09-21T01:12:11.303318+0000","last_became_peered":"2024-09-21T01:12:11.303318+0000","last_unstale":"2024-09-21T01:12:55.669259+0000","last_undegraded":"2024-09-21T01:12:55.669259+0000","last_fullsized":"2024-09-21T01:12:55.669259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:39.377686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679281+0000","last_change":"2024-09-21T01:12:55.679156+0000","last_active":"2024-09-21T01:12:55.679281+0000","last_peered":"2024-09-21T01:12:55.679281+0000","last_clean":"2024-09-21T01:12:55.679281+0000","last_became_active":"2024-09-21T01:12:55.678638+0000","last_became_peered":"2024-09-21T01:12:55.678638+0000","last_unstale":"2024-09-21T01:12:55.679281+0000","last_undegraded":"2024-09-21T01:12:55.679281+0000","last_fullsized":"2024-09-21T01:12:55.679281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.784868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669377+0000","last_change":"2024-09-21T01:12:11.305558+0000","last_active":"2024-09-21T01:12:55.669377+0000","last_peered":"2024-09-21T01:12:55.669377+0000","last_clean":"2024-09-21T01:12:55.669377+0000","last_became_active":"2024-09-21T01:12:11.304934+0000","last_became_peered":"2024-09-21T01:12:11.304934+0000","last_unstale":"2024-09-21T01:12:55.669377+0000","last_undegraded":"2024-09-21T01:12:55.669377+0000","last_fullsized":"2024-09-21T01:12:55.669377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:52.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675716+0000","last_change":"2024-09-21T01:12:09.511384+0000","last_active":"2024-09-21T01:12:55.675716+0000","last_peered":"2024-09-21T01:12:55.675716+0000","last_clean":"2024-09-21T01:12:55.675716+0000","last_became_active":"2024-09-21T01:12:09.511006+0000","last_became_peered":"2024-09-21T01:12:09.511006+0000","last_unstale":"2024-09-21T01:12:55.675716+0000","last_undegraded":"2024-09-21T01:12:55.675716+0000","last_fullsized":"2024-09-21T01:12:55.675716+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:56.580855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823258+0000","last_change":"2024-09-21T01:12:11.304912+0000","last_active":"2024-09-21T01:12:55.823258+0000","last_peered":"2024-09-21T01:12:55.823258+0000","last_clean":"2024-09-21T01:12:55.823258+0000","last_became_active":"2024-09-21T01:12:11.304536+0000","last_became_peered":"2024-09-21T01:12:11.304536+0000","last_unstale":"2024-09-21T01:12:55.823258+0000","last_undegraded":"2024-09-21T01:12:55.823258+0000","last_fullsized":"2024-09-21T01:12:55.823258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:45.037231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673929+0000","last_change":"2024-09-21T01:12:09.294680+0000","last_active":"2024-09-21T01:12:55.673929+0000","last_peered":"2024-09-21T01:12:55.673929+0000","last_clean":"2024-09-21T01:12:55.673929+0000","last_became_active":"2024-09-21T01:12:09.294289+0000","last_became_peered":"2024-09-21T01:12:09.294289+0000","last_unstale":"2024-09-21T01:12:55.673929+0000","last_undegraded":"2024-09-21T01:12:55.673929+0000","last_fullsized":"2024-09-21T01:12:55.673929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.824781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670991+0000","last_change":"2024-09-21T01:12:11.305192+0000","last_active":"2024-09-21T01:12:55.670991+0000","last_peered":"2024-09-21T01:12:55.670991+0000","last_clean":"2024-09-21T01:12:55.670991+0000","last_became_active":"2024-09-21T01:12:11.304761+0000","last_became_peered":"2024-09-21T01:12:11.304761+0000","last_unstale":"2024-09-21T01:12:55.670991+0000","last_undegraded":"2024-09-21T01:12:55.670991+0000","last_fullsized":"2024-09-21T01:12:55.670991+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:58.429511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784602+0000","last_change":"2024-09-21T01:12:09.455476+0000","last_active":"2024-09-21T01:12:55.784602+0000","last_peered":"2024-09-21T01:12:55.784602+0000","last_clean":"2024-09-21T01:12:55.784602+0000","last_became_active":"2024-09-21T01:12:09.454981+0000","last_became_peered":"2024-09-21T01:12:09.454981+0000","last_unstale":"2024-09-21T01:12:55.784602+0000","last_undegraded":"2024-09-21T01:12:55.784602+0000","last_fullsized":"2024-09-21T01:12:55.784602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:27.790928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676141+0000","last_change":"2024-09-21T01:12:11.300631+0000","last_active":"2024-09-21T01:12:55.676141+0000","last_peered":"2024-09-21T01:12:55.676141+0000","last_clean":"2024-09-21T01:12:55.676141+0000","last_became_active":"2024-09-21T01:12:11.300179+0000","last_became_peered":"2024-09-21T01:12:11.300179+0000","last_unstale":"2024-09-21T01:12:55.676141+0000","last_undegraded":"2024-09-21T01:12:55.676141+0000","last_fullsized":"2024-09-21T01:12:55.676141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:23.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328302+0000","last_change":"2024-09-21T01:12:09.511406+0000","last_active":"2024-09-21T01:12:56.328302+0000","last_peered":"2024-09-21T01:12:56.328302+0000","last_clean":"2024-09-21T01:12:56.328302+0000","last_became_active":"2024-09-21T01:12:09.511117+0000","last_became_peered":"2024-09-21T01:12:09.511117+0000","last_unstale":"2024-09-21T01:12:56.328302+0000","last_undegraded":"2024-09-21T01:12:56.328302+0000","last_fullsized":"2024-09-21T01:12:56.328302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:18.100466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674303+0000","last_change":"2024-09-21T01:12:11.306933+0000","last_active":"2024-09-21T01:12:55.674303+0000","last_peered":"2024-09-21T01:12:55.674303+0000","last_clean":"2024-09-21T01:12:55.674303+0000","last_became_active":"2024-09-21T01:12:11.306516+0000","last_became_peered":"2024-09-21T01:12:11.306516+0000","last_unstale":"2024-09-21T01:12:55.674303+0000","last_undegraded":"2024-09-21T01:12:55.674303+0000","last_fullsized":"2024-09-21T01:12:55.674303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:40.524953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670767+0000","last_change":"2024-09-21T01:12:09.297506+0000","last_active":"2024-09-21T01:12:55.670767+0000","last_peered":"2024-09-21T01:12:55.670767+0000","last_clean":"2024-09-21T01:12:55.670767+0000","last_became_active":"2024-09-21T01:12:09.297139+0000","last_became_peered":"2024-09-21T01:12:09.297139+0000","last_unstale":"2024-09-21T01:12:55.670767+0000","last_undegraded":"2024-09-21T01:12:55.670767+0000","last_fullsized":"2024-09-21T01:12:55.670767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:05.641171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671193+0000","last_change":"2024-09-21T01:12:11.314053+0000","last_active":"2024-09-21T01:12:55.671193+0000","last_peered":"2024-09-21T01:12:55.671193+0000","last_clean":"2024-09-21T01:12:55.671193+0000","last_became_active":"2024-09-21T01:12:11.313681+0000","last_became_peered":"2024-09-21T01:12:11.313681+0000","last_unstale":"2024-09-21T01:12:55.671193+0000","last_undegraded":"2024-09-21T01:12:55.671193+0000","last_fullsized":"2024-09-21T01:12:55.671193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.108030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674195+0000","last_change":"2024-09-21T01:12:09.298602+0000","last_active":"2024-09-21T01:12:55.674195+0000","last_peered":"2024-09-21T01:12:55.674195+0000","last_clean":"2024-09-21T01:12:55.674195+0000","last_became_active":"2024-09-21T01:12:09.297295+0000","last_became_peered":"2024-09-21T01:12:09.297295+0000","last_unstale":"2024-09-21T01:12:55.674195+0000","last_undegraded":"2024-09-21T01:12:55.674195+0000","last_fullsized":"2024-09-21T01:12:55.674195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:27.253290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671086+0000","last_change":"2024-09-21T01:12:11.306120+0000","last_active":"2024-09-21T01:12:55.671086+0000","last_peered":"2024-09-21T01:12:55.671086+0000","last_clean":"2024-09-21T01:12:55.671086+0000","last_became_active":"2024-09-21T01:12:11.305771+0000","last_became_peered":"2024-09-21T01:12:11.305771+0000","last_unstale":"2024-09-21T01:12:55.671086+0000","last_undegraded":"2024-09-21T01:12:55.671086+0000","last_fullsized":"2024-09-21T01:12:55.671086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:38.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.685158+0000","last_change":"2024-09-21T01:12:55.684585+0000","last_active":"2024-09-21T01:12:55.685158+0000","last_peered":"2024-09-21T01:12:55.685158+0000","last_clean":"2024-09-21T01:12:55.685158+0000","last_became_active":"2024-09-21T01:12:55.677011+0000","last_became_peered":"2024-09-21T01:12:55.677011+0000","last_unstale":"2024-09-21T01:12:55.685158+0000","last_undegraded":"2024-09-21T01:12:55.685158+0000","last_fullsized":"2024-09-21T01:12:55.685158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:09.563212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674421+0000","last_change":"2024-09-21T01:12:11.312392+0000","last_active":"2024-09-21T01:12:55.674421+0000","last_peered":"2024-09-21T01:12:55.674421+0000","last_clean":"2024-09-21T01:12:55.674421+0000","last_became_active":"2024-09-21T01:12:11.311120+0000","last_became_peered":"2024-09-21T01:12:11.311120+0000","last_unstale":"2024-09-21T01:12:55.674421+0000","last_undegraded":"2024-09-21T01:12:55.674421+0000","last_fullsized":"2024-09-21T01:12:55.674421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:23.292367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679358+0000","last_change":"2024-09-21T01:12:11.301350+0000","last_active":"2024-09-21T01:12:55.679358+0000","last_peered":"2024-09-21T01:12:55.679358+0000","last_clean":"2024-09-21T01:12:55.679358+0000","last_became_active":"2024-09-21T01:12:11.299746+0000","last_became_peered":"2024-09-21T01:12:11.299746+0000","last_unstale":"2024-09-21T01:12:55.679358+0000","last_undegraded":"2024-09-21T01:12:55.679358+0000","last_fullsized":"2024-09-21T01:12:55.679358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:57.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675539+0000","last_change":"2024-09-21T01:12:09.296499+0000","last_active":"2024-09-21T01:12:55.675539+0000","last_peered":"2024-09-21T01:12:55.675539+0000","last_clean":"2024-09-21T01:12:55.675539+0000","last_became_active":"2024-09-21T01:12:09.296000+0000","last_became_peered":"2024-09-21T01:12:09.296000+0000","last_unstale":"2024-09-21T01:12:55.675539+0000","last_undegraded":"2024-09-21T01:12:55.675539+0000","last_fullsized":"2024-09-21T01:12:55.675539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:37.278200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328152+0000","last_change":"2024-09-21T01:12:11.314014+0000","last_active":"2024-09-21T01:12:56.328152+0000","last_peered":"2024-09-21T01:12:56.328152+0000","last_clean":"2024-09-21T01:12:56.328152+0000","last_became_active":"2024-09-21T01:12:11.312592+0000","last_became_peered":"2024-09-21T01:12:11.312592+0000","last_unstale":"2024-09-21T01:12:56.328152+0000","last_undegraded":"2024-09-21T01:12:56.328152+0000","last_fullsized":"2024-09-21T01:12:56.328152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.074667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675558+0000","last_change":"2024-09-21T01:12:09.297088+0000","last_active":"2024-09-21T01:12:55.675558+0000","last_peered":"2024-09-21T01:12:55.675558+0000","last_clean":"2024-09-21T01:12:55.675558+0000","last_became_active":"2024-09-21T01:12:09.296707+0000","last_became_peered":"2024-09-21T01:12:09.296707+0000","last_unstale":"2024-09-21T01:12:55.675558+0000","last_undegraded":"2024-09-21T01:12:55.675558+0000","last_fullsized":"2024-09-21T01:12:55.675558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:50.138586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676109+0000","last_change":"2024-09-21T01:12:11.300991+0000","last_active":"2024-09-21T01:12:55.676109+0000","last_peered":"2024-09-21T01:12:55.676109+0000","last_clean":"2024-09-21T01:12:55.676109+0000","last_became_active":"2024-09-21T01:12:11.299934+0000","last_became_peered":"2024-09-21T01:12:11.299934+0000","last_unstale":"2024-09-21T01:12:55.676109+0000","last_undegraded":"2024-09-21T01:12:55.676109+0000","last_fullsized":"2024-09-21T01:12:55.676109+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:34.300051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671316+0000","last_change":"2024-09-21T01:12:09.511289+0000","last_active":"2024-09-21T01:12:55.671316+0000","last_peered":"2024-09-21T01:12:55.671316+0000","last_clean":"2024-09-21T01:12:55.671316+0000","last_became_active":"2024-09-21T01:12:09.510879+0000","last_became_peered":"2024-09-21T01:12:09.510879+0000","last_unstale":"2024-09-21T01:12:55.671316+0000","last_undegraded":"2024-09-21T01:12:55.671316+0000","last_fullsized":"2024-09-21T01:12:55.671316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:37.950305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671053+0000","last_change":"2024-09-21T01:12:11.312100+0000","last_active":"2024-09-21T01:12:55.671053+0000","last_peered":"2024-09-21T01:12:55.671053+0000","last_clean":"2024-09-21T01:12:55.671053+0000","last_became_active":"2024-09-21T01:12:11.311731+0000","last_became_peered":"2024-09-21T01:12:11.311731+0000","last_unstale":"2024-09-21T01:12:55.671053+0000","last_undegraded":"2024-09-21T01:12:55.671053+0000","last_fullsized":"2024-09-21T01:12:55.671053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:40.459020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674164+0000","last_change":"2024-09-21T01:12:09.294759+0000","last_active":"2024-09-21T01:12:55.674164+0000","last_peered":"2024-09-21T01:12:55.674164+0000","last_clean":"2024-09-21T01:12:55.674164+0000","last_became_active":"2024-09-21T01:12:09.294391+0000","last_became_peered":"2024-09-21T01:12:09.294391+0000","last_unstale":"2024-09-21T01:12:55.674164+0000","last_undegraded":"2024-09-21T01:12:55.674164+0000","last_fullsized":"2024-09-21T01:12:55.674164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:05.981058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70449,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":353,"num_read_kb":248,"num_write":164,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":211347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776154,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":815104,"data_stored":396084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939679,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36836,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708316,"statfs":{"total":95995035648,"available":95957315584,"internally_reserved":0,"allocated":1519616,"data_stored":1054404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":831488,"data_stored":396320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299433,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":831488,"data_stored":396240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495661,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1425408,"data_stored":988170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":819200,"data_stored":395709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790009,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32592,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712560,"statfs":{"total":95995035648,"available":95961661440,"internally_reserved":0,"allocated":1437696,"data_stored":987463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40316,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704836,"statfs":{"total":95995035648,"available":95953752064,"internally_reserved":0,"allocated":823296,"data_stored":396537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149760,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":396020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":913408,"data_stored":463300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":461950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":396980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:13:17.710 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T01:13:17.710 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T01:13:17.710 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T01:13:17.710 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T01:13:17.957 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:18.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:18 smithi148 ceph-mon[31000]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:18.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:18 smithi148 ceph-mon[31000]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:18.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.404+0000 7f79f1da3640 1 -- 172.21.15.148:0/2121373550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79ec107be0 msgr2=0x7f79ec107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.404+0000 7f79f1da3640 1 --2- 172.21.15.148:0/2121373550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79ec107be0 0x7f79ec107ff0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009900 tx=0x7f79d402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.404+0000 7f79f1da3640 1 -- 172.21.15.148:0/2121373550 shutdown_connections 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.404+0000 7f79f1da3640 1 --2- 172.21.15.148:0/2121373550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79ec107be0 0x7f79ec107ff0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.404+0000 7f79f1da3640 1 --2- 172.21.15.148:0/2121373550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79ec108530 0x7f79ec10ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.404+0000 7f79f1da3640 1 --2- 172.21.15.148:0/2121373550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec1022a0 0x7f79ec1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.404+0000 7f79f1da3640 1 -- 172.21.15.148:0/2121373550 >> 172.21.15.148:0/2121373550 conn(0x7f79ec079ec0 msgr2=0x7f79ec07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.404+0000 7f79f1da3640 1 -- 172.21.15.148:0/2121373550 shutdown_connections 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.404+0000 7f79f1da3640 1 -- 172.21.15.148:0/2121373550 wait complete. 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.405+0000 7f79f1da3640 1 Processor -- start 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.405+0000 7f79f1da3640 1 -- start start 2024-09-21T01:13:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79f1da3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec1022a0 0x7f79ec199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79f1da3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79ec107be0 0x7f79ec199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79f1da3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79ec108530 0x7f79ec19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79f1da3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec1121a0 con 0x7f79ec108530 2024-09-21T01:13:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79f1da3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec112020 con 0x7f79ec107be0 2024-09-21T01:13:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79f1da3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec112320 con 0x7f79ec1022a0 2024-09-21T01:13:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79ebfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79ec108530 0x7f79ec19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79ebfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79ec108530 0x7f79ec19ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40898/0 (socket says 172.21.15.148:40898) 2024-09-21T01:13:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79ebfff640 1 -- 172.21.15.148:0/499420492 learned_addr learned my addr 172.21.15.148:0/499420492 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79eaffd640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79ec107be0 0x7f79ec199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79eb7fe640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec1022a0 0x7f79ec199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79ebfff640 1 -- 172.21.15.148:0/499420492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec1022a0 msgr2=0x7f79ec199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79ebfff640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec1022a0 0x7f79ec199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79ebfff640 1 -- 172.21.15.148:0/499420492 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79ec107be0 msgr2=0x7f79ec199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79ebfff640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79ec107be0 0x7f79ec199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79ebfff640 1 -- 172.21.15.148:0/499420492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec19f3b0 con 0x7f79ec108530 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79eaffd640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79ec107be0 0x7f79ec199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79ebfff640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79ec108530 0x7f79ec19ed40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f79e400cce0 tx=0x7f79e400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79e8ff9640 1 -- 172.21.15.148:0/499420492 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e400f450 con 0x7f79ec108530 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79e8ff9640 1 -- 172.21.15.148:0/499420492 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79e400faa0 con 0x7f79ec108530 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79f1da3640 1 -- 172.21.15.148:0/499420492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ec19f6a0 con 0x7f79ec108530 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79e8ff9640 1 -- 172.21.15.148:0/499420492 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4018b70 con 0x7f79ec108530 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.406+0000 7f79f1da3640 1 -- 172.21.15.148:0/499420492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ec19fb60 con 0x7f79ec108530 2024-09-21T01:13:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.407+0000 7f79f1da3640 1 -- 172.21.15.148:0/499420492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ec1026b0 con 0x7f79ec108530 2024-09-21T01:13:18.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.409+0000 7f79e8ff9640 1 -- 172.21.15.148:0/499420492 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f79e4018d10 con 0x7f79ec108530 2024-09-21T01:13:18.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.410+0000 7f79e8ff9640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f79d80b6650 0x7f79d80b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:18.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.410+0000 7f79eb7fe640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f79d80b6650 0x7f79d80b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:18.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.410+0000 7f79e8ff9640 1 -- 172.21.15.148:0/499420492 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f79e40e7a10 con 0x7f79ec108530 2024-09-21T01:13:18.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.410+0000 7f79eb7fe640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f79d80b6650 0x7f79d80b8b60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f79dc005e10 tx=0x7f79dc005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:18.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.413+0000 7f79e8ff9640 1 -- 172.21.15.148:0/499420492 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79e4014030 con 0x7f79ec108530 2024-09-21T01:13:18.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.629+0000 7f79f1da3640 1 -- 172.21.15.148:0/499420492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f79ec19a630 con 0x7f79ec108530 2024-09-21T01:13:18.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.629+0000 7f79e8ff9640 1 -- 172.21.15.148:0/499420492 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f79e40ae180 con 0x7f79ec108530 2024-09-21T01:13:18.630 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:18.631 INFO:teuthology.orchestra.run.smithi148.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T01:13:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 -- 172.21.15.148:0/499420492 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f79d80b6650 msgr2=0x7f79d80b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f79d80b6650 0x7f79d80b8b60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f79dc005e10 tx=0x7f79dc005da0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 -- 172.21.15.148:0/499420492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79ec108530 msgr2=0x7f79ec19ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79ec108530 0x7f79ec19ed40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f79e400cce0 tx=0x7f79e400a620 comp rx=0 tx=0).stop 2024-09-21T01:13:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 -- 172.21.15.148:0/499420492 shutdown_connections 2024-09-21T01:13:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f79d80b6650 0x7f79d80b8b60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79ec108530 0x7f79ec19ed40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79ec107be0 0x7f79ec199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 --2- 172.21.15.148:0/499420492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79ec1022a0 0x7f79ec199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 -- 172.21.15.148:0/499420492 >> 172.21.15.148:0/499420492 conn(0x7f79ec079ec0 msgr2=0x7f79ec1049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:18.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 -- 172.21.15.148:0/499420492 shutdown_connections 2024-09-21T01:13:18.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:18.632+0000 7f79f1da3640 1 -- 172.21.15.148:0/499420492 wait complete. 2024-09-21T01:13:18.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:18 smithi181 ceph-mon[34811]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:18.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:18 smithi181 ceph-mon[34811]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:18.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:18 smithi157 ceph-mon[34140]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:18.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:18 smithi157 ceph-mon[34140]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:19.269 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T01:13:19.269 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:19.518 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:19.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:19 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/499420492' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T01:13:19.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:19 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/499420492' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T01:13:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:19 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/499420492' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T01:13:20.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.020+0000 7f86e1b8d640 1 -- 172.21.15.148:0/957316239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc109e10 msgr2=0x7f86dc110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:20.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.020+0000 7f86e1b8d640 1 --2- 172.21.15.148:0/957316239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc109e10 0x7f86dc110640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009ca0 tx=0x7f86d402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:20.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.020+0000 7f86e1b8d640 1 -- 172.21.15.148:0/957316239 shutdown_connections 2024-09-21T01:13:20.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.020+0000 7f86e1b8d640 1 --2- 172.21.15.148:0/957316239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc109e10 0x7f86dc110640 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:20.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.020+0000 7f86e1b8d640 1 --2- 172.21.15.148:0/957316239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86dc1094c0 0x7f86dc1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:20.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.020+0000 7f86e1b8d640 1 --2- 172.21.15.148:0/957316239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86dc103b80 0x7f86dc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:20.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.020+0000 7f86e1b8d640 1 -- 172.21.15.148:0/957316239 >> 172.21.15.148:0/957316239 conn(0x7f86dc0ff5d0 msgr2=0x7f86dc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:20.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.020+0000 7f86e1b8d640 1 -- 172.21.15.148:0/957316239 shutdown_connections 2024-09-21T01:13:20.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.020+0000 7f86e1b8d640 1 -- 172.21.15.148:0/957316239 wait complete. 2024-09-21T01:13:20.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.020+0000 7f86e1b8d640 1 Processor -- start 2024-09-21T01:13:20.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86e1b8d640 1 -- start start 2024-09-21T01:13:20.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86e1b8d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86dc103b80 0x7f86dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:20.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86e1b8d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86dc1094c0 0x7f86dc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86e1b8d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc109e10 0x7f86dc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86e1b8d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc113b50 con 0x7f86dc109e10 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86e1b8d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc1139d0 con 0x7f86dc1094c0 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86e1b8d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc113cd0 con 0x7f86dc103b80 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86dbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc109e10 0x7f86dc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86dbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc109e10 0x7f86dc076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40908/0 (socket says 172.21.15.148:40908) 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86dbfff640 1 -- 172.21.15.148:0/4115230339 learned_addr learned my addr 172.21.15.148:0/4115230339 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86d3fff640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86dc1094c0 0x7f86dc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86db7fe640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86dc103b80 0x7f86dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86dbfff640 1 -- 172.21.15.148:0/4115230339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86dc103b80 msgr2=0x7f86dc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86dbfff640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86dc103b80 0x7f86dc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86dbfff640 1 -- 172.21.15.148:0/4115230339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86dc1094c0 msgr2=0x7f86dc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86dbfff640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86dc1094c0 0x7f86dc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:20.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.021+0000 7f86dbfff640 1 -- 172.21.15.148:0/4115230339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc1a8840 con 0x7f86dc109e10 2024-09-21T01:13:20.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.022+0000 7f86dbfff640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc109e10 0x7f86dc076190 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f86d4005cc0 tx=0x7f86d402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:20.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.022+0000 7f86d97fa640 1 -- 172.21.15.148:0/4115230339 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4003bf0 con 0x7f86dc109e10 2024-09-21T01:13:20.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.022+0000 7f86d97fa640 1 -- 172.21.15.148:0/4115230339 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86d4003d90 con 0x7f86dc109e10 2024-09-21T01:13:20.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.022+0000 7f86d97fa640 1 -- 172.21.15.148:0/4115230339 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d402fbc0 con 0x7f86dc109e10 2024-09-21T01:13:20.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.022+0000 7f86e1b8d640 1 -- 172.21.15.148:0/4115230339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86dc1a8ad0 con 0x7f86dc109e10 2024-09-21T01:13:20.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.022+0000 7f86e1b8d640 1 -- 172.21.15.148:0/4115230339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86dc1a8fc0 con 0x7f86dc109e10 2024-09-21T01:13:20.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.023+0000 7f86e1b8d640 1 -- 172.21.15.148:0/4115230339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86dc103f90 con 0x7f86dc109e10 2024-09-21T01:13:20.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.024+0000 7f86d97fa640 1 -- 172.21.15.148:0/4115230339 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f86d402fd60 con 0x7f86dc109e10 2024-09-21T01:13:20.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.025+0000 7f86d97fa640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f86c80b65a0 0x7f86c80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:20.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.025+0000 7f86db7fe640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f86c80b65a0 0x7f86c80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:20.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.025+0000 7f86d97fa640 1 -- 172.21.15.148:0/4115230339 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f86d41089d0 con 0x7f86dc109e10 2024-09-21T01:13:20.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.026+0000 7f86db7fe640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f86c80b65a0 0x7f86c80b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86dc077160 tx=0x7f86cc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:20.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.029+0000 7f86d97fa640 1 -- 172.21.15.148:0/4115230339 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86d40cf110 con 0x7f86dc109e10 2024-09-21T01:13:20.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.242+0000 7f86e1b8d640 1 -- 172.21.15.148:0/4115230339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86dc02e640 con 0x7f86dc109e10 2024-09-21T01:13:20.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.243+0000 7f86d97fa640 1 -- 172.21.15.148:0/4115230339 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11926 (secure 0 0 0) 0x7f86d40098b0 con 0x7f86dc109e10 2024-09-21T01:13:20.244 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:20.244 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":23,"btime":"2024-09-21T01:12:23:525439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:12:22.780555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24646,24631]},"id":1}]} 2024-09-21T01:13:20.244 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 23 2024-09-21T01:13:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 -- 172.21.15.148:0/4115230339 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f86c80b65a0 msgr2=0x7f86c80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f86c80b65a0 0x7f86c80b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86dc077160 tx=0x7f86cc008040 comp rx=0 tx=0).stop 2024-09-21T01:13:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 -- 172.21.15.148:0/4115230339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc109e10 msgr2=0x7f86dc076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc109e10 0x7f86dc076190 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f86d4005cc0 tx=0x7f86d402f380 comp rx=0 tx=0).stop 2024-09-21T01:13:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 -- 172.21.15.148:0/4115230339 shutdown_connections 2024-09-21T01:13:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f86c80b65a0 0x7f86c80b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86dc109e10 0x7f86dc076190 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86dc1094c0 0x7f86dc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 --2- 172.21.15.148:0/4115230339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86dc103b80 0x7f86dc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 -- 172.21.15.148:0/4115230339 >> 172.21.15.148:0/4115230339 conn(0x7f86dc0ff5d0 msgr2=0x7f86dc1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 -- 172.21.15.148:0/4115230339 shutdown_connections 2024-09-21T01:13:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:20.245+0000 7f86e1b8d640 1 -- 172.21.15.148:0/4115230339 wait complete. 2024-09-21T01:13:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:20 smithi148 ceph-mon[31000]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:20 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4115230339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:20 smithi181 ceph-mon[34811]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:20 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/4115230339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:20.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:20 smithi157 ceph-mon[34140]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:20.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:20 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/4115230339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:20.813 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:21.057 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.562+0000 7f38f2a60640 1 -- 172.21.15.148:0/1779095760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ec1094d0 msgr2=0x7f38ec1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.562+0000 7f38f2a60640 1 --2- 172.21.15.148:0/1779095760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ec1094d0 0x7f38ec1098e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009900 tx=0x7f38d402a410 comp rx=0 tx=0).stop 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.562+0000 7f38f2a60640 1 -- 172.21.15.148:0/1779095760 shutdown_connections 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.562+0000 7f38f2a60640 1 --2- 172.21.15.148:0/1779095760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ec1094d0 0x7f38ec1098e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.562+0000 7f38f2a60640 1 --2- 172.21.15.148:0/1779095760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38ec109e20 0x7f38ec110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.562+0000 7f38f2a60640 1 --2- 172.21.15.148:0/1779095760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec103b90 0x7f38ec103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.562+0000 7f38f2a60640 1 -- 172.21.15.148:0/1779095760 >> 172.21.15.148:0/1779095760 conn(0x7f38ec0ff600 msgr2=0x7f38ec101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.562+0000 7f38f2a60640 1 -- 172.21.15.148:0/1779095760 shutdown_connections 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.562+0000 7f38f2a60640 1 -- 172.21.15.148:0/1779095760 wait complete. 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.563+0000 7f38f2a60640 1 Processor -- start 2024-09-21T01:13:21.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.563+0000 7f38f2a60640 1 -- start start 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.563+0000 7f38f2a60640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec103b90 0x7f38ec19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.563+0000 7f38f2a60640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38ec1094d0 0x7f38ec19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.563+0000 7f38f2a60640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ec109e20 0x7f38ec19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.563+0000 7f38f2a60640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec113b20 con 0x7f38ec109e20 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.563+0000 7f38f2a60640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec1139a0 con 0x7f38ec1094d0 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.563+0000 7f38f2a60640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec113ca0 con 0x7f38ec103b90 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f0ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ec109e20 0x7f38ec19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f0ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ec109e20 0x7f38ec19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40922/0 (socket says 172.21.15.148:40922) 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f0ffd640 1 -- 172.21.15.148:0/3519637576 learned_addr learned my addr 172.21.15.148:0/3519637576 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38e3fff640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38ec1094d0 0x7f38ec19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38ebfff640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec103b90 0x7f38ec19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:21.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f0ffd640 1 -- 172.21.15.148:0/3519637576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec103b90 msgr2=0x7f38ec19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f0ffd640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec103b90 0x7f38ec19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f0ffd640 1 -- 172.21.15.148:0/3519637576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38ec1094d0 msgr2=0x7f38ec19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f0ffd640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38ec1094d0 0x7f38ec19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f0ffd640 1 -- 172.21.15.148:0/3519637576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec1a0500 con 0x7f38ec109e20 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f0ffd640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ec109e20 0x7f38ec19fdd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f38e400b970 tx=0x7f38e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38e9ffb640 1 -- 172.21.15.148:0/3519637576 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4019070 con 0x7f38ec109e20 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38e9ffb640 1 -- 172.21.15.148:0/3519637576 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38e4014440 con 0x7f38ec109e20 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f2a60640 1 -- 172.21.15.148:0/3519637576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec1a07f0 con 0x7f38ec109e20 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38e9ffb640 1 -- 172.21.15.148:0/3519637576 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e40075d0 con 0x7f38ec109e20 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.564+0000 7f38f2a60640 1 -- 172.21.15.148:0/3519637576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec1a6f50 con 0x7f38ec109e20 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.565+0000 7f38f2a60640 1 -- 172.21.15.148:0/3519637576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ec103fa0 con 0x7f38ec109e20 2024-09-21T01:13:21.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.567+0000 7f38e9ffb640 1 -- 172.21.15.148:0/3519637576 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f38e401c070 con 0x7f38ec109e20 2024-09-21T01:13:21.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.568+0000 7f38e9ffb640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38d80b6620 0x7f38d80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:21.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.568+0000 7f38ebfff640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38d80b6620 0x7f38d80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:21.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.568+0000 7f38e9ffb640 1 -- 172.21.15.148:0/3519637576 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f38e40e6d70 con 0x7f38ec109e20 2024-09-21T01:13:21.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.568+0000 7f38ebfff640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38d80b6620 0x7f38d80b8b30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f38dc005fd0 tx=0x7f38dc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:21.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.571+0000 7f38e9ffb640 1 -- 172.21.15.148:0/3519637576 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38e40b1890 con 0x7f38ec109e20 2024-09-21T01:13:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.784+0000 7f38f2a60640 1 -- 172.21.15.148:0/3519637576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38ec19b6c0 con 0x7f38ec109e20 2024-09-21T01:13:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.785+0000 7f38e9ffb640 1 -- 172.21.15.148:0/3519637576 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11926 (secure 0 0 0) 0x7f38e40b67d0 con 0x7f38ec109e20 2024-09-21T01:13:21.786 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:21.786 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":23,"btime":"2024-09-21T01:12:23:525439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:12:22.780555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24646,24631]},"id":1}]} 2024-09-21T01:13:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 23 2024-09-21T01:13:21.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.787+0000 7f38f2a60640 1 -- 172.21.15.148:0/3519637576 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38d80b6620 msgr2=0x7f38d80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:21.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.787+0000 7f38f2a60640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38d80b6620 0x7f38d80b8b30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f38dc005fd0 tx=0x7f38dc005850 comp rx=0 tx=0).stop 2024-09-21T01:13:21.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.787+0000 7f38f2a60640 1 -- 172.21.15.148:0/3519637576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ec109e20 msgr2=0x7f38ec19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.787+0000 7f38f2a60640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ec109e20 0x7f38ec19fdd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f38e400b970 tx=0x7f38e400be30 comp rx=0 tx=0).stop 2024-09-21T01:13:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.787+0000 7f38f2a60640 1 -- 172.21.15.148:0/3519637576 shutdown_connections 2024-09-21T01:13:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.787+0000 7f38f2a60640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f38d80b6620 0x7f38d80b8b30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.787+0000 7f38f2a60640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38ec109e20 0x7f38ec19fdd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.787+0000 7f38f2a60640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38ec1094d0 0x7f38ec19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.787+0000 7f38f2a60640 1 --2- 172.21.15.148:0/3519637576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38ec103b90 0x7f38ec19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.787+0000 7f38f2a60640 1 -- 172.21.15.148:0/3519637576 >> 172.21.15.148:0/3519637576 conn(0x7f38ec0ff600 msgr2=0x7f38ec101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.788+0000 7f38f2a60640 1 -- 172.21.15.148:0/3519637576 shutdown_connections 2024-09-21T01:13:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:21.788+0000 7f38f2a60640 1 -- 172.21.15.148:0/3519637576 wait complete. 2024-09-21T01:13:22.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:22 smithi148 ceph-mon[31000]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T01:13:22.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:22 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3519637576' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:22.454 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:13:22.699 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:22 smithi181 ceph-mon[34811]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T01:13:22.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:22 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3519637576' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:22.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:22 smithi157 ceph-mon[34140]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T01:13:22.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:22 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3519637576' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:23.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.160+0000 7f25fbfdd640 1 -- 172.21.15.148:0/1886811782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f4105310 msgr2=0x7f25f410d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:23.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.160+0000 7f25fbfdd640 1 --2- 172.21.15.148:0/1886811782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f4105310 0x7f25f410d860 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009900 tx=0x7f25f002a410 comp rx=0 tx=0).stop 2024-09-21T01:13:23.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.160+0000 7f25fbfdd640 1 -- 172.21.15.148:0/1886811782 shutdown_connections 2024-09-21T01:13:23.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.160+0000 7f25fbfdd640 1 --2- 172.21.15.148:0/1886811782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f4105310 0x7f25f410d860 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.160+0000 7f25fbfdd640 1 --2- 172.21.15.148:0/1886811782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f410de20 0x7f25f4110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.160+0000 7f25fbfdd640 1 --2- 172.21.15.148:0/1886811782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f41049c0 0x7f25f4104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.160+0000 7f25fbfdd640 1 -- 172.21.15.148:0/1886811782 >> 172.21.15.148:0/1886811782 conn(0x7f25f4079710 msgr2=0x7f25f4079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.160+0000 7f25fbfdd640 1 -- 172.21.15.148:0/1886811782 shutdown_connections 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.160+0000 7f25fbfdd640 1 -- 172.21.15.148:0/1886811782 wait complete. 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25fbfdd640 1 Processor -- start 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25fbfdd640 1 -- start start 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25fbfdd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f41049c0 0x7f25f419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25fbfdd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f4105310 0x7f25f419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25fbfdd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f410de20 0x7f25f419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:23.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25fbfdd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f25f4113ae0 con 0x7f25f4105310 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25fbfdd640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f25f4113960 con 0x7f25f41049c0 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25fbfdd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f25f4113c60 con 0x7f25f410de20 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25f9578640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f4105310 0x7f25f419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25f9578640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f4105310 0x7f25f419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40938/0 (socket says 172.21.15.148:40938) 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.161+0000 7f25f9578640 1 -- 172.21.15.148:0/4039460304 learned_addr learned my addr 172.21.15.148:0/4039460304 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25fa57a640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f410de20 0x7f25f419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25f9d79640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f41049c0 0x7f25f419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25f9578640 1 -- 172.21.15.148:0/4039460304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f410de20 msgr2=0x7f25f419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25f9578640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f410de20 0x7f25f419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25f9578640 1 -- 172.21.15.148:0/4039460304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f41049c0 msgr2=0x7f25f419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:23.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25f9578640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f41049c0 0x7f25f419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25f9578640 1 -- 172.21.15.148:0/4039460304 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f41a0460 con 0x7f25f4105310 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25fa57a640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f410de20 0x7f25f419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25f9d79640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f41049c0 0x7f25f419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25f9578640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f4105310 0x7f25f419aa90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f25f002a930 tx=0x7f25f0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25e6ffd640 1 -- 172.21.15.148:0/4039460304 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f003f030 con 0x7f25f4105310 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25e6ffd640 1 -- 172.21.15.148:0/4039460304 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f0003cb0 con 0x7f25f4105310 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25fbfdd640 1 -- 172.21.15.148:0/4039460304 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f41a06f0 con 0x7f25f4105310 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25e6ffd640 1 -- 172.21.15.148:0/4039460304 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0035070 con 0x7f25f4105310 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.162+0000 7f25fbfdd640 1 -- 172.21.15.148:0/4039460304 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f41a6eb0 con 0x7f25f4105310 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.163+0000 7f25fbfdd640 1 -- 172.21.15.148:0/4039460304 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f406c280 con 0x7f25f4105310 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.165+0000 7f25e6ffd640 1 -- 172.21.15.148:0/4039460304 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f25f0042030 con 0x7f25f4105310 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.165+0000 7f25e6ffd640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25e00b6620 0x7f25e00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:23.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.165+0000 7f25f9d79640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25e00b6620 0x7f25e00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:23.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.166+0000 7f25e6ffd640 1 -- 172.21.15.148:0/4039460304 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f25f0107b10 con 0x7f25f4105310 2024-09-21T01:13:23.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.166+0000 7f25f9d79640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25e00b6620 0x7f25e00b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f25e8006fd0 tx=0x7f25e8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:23.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.170+0000 7f25e6ffd640 1 -- 172.21.15.148:0/4039460304 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25f00ce250 con 0x7f25f4105310 2024-09-21T01:13:23.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.353+0000 7f25fbfdd640 1 -- 172.21.15.148:0/4039460304 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25f419b620 con 0x7f25f4105310 2024-09-21T01:13:23.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.354+0000 7f25e6ffd640 1 -- 172.21.15.148:0/4039460304 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22837 (secure 0 0 0) 0x7f25f00d2630 con 0x7f25f4105310 2024-09-21T01:13:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:23.356 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":76,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:55.664651+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 -- 172.21.15.148:0/4039460304 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25e00b6620 msgr2=0x7f25e00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25e00b6620 0x7f25e00b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f25e8006fd0 tx=0x7f25e8008040 comp rx=0 tx=0).stop 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 -- 172.21.15.148:0/4039460304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f4105310 msgr2=0x7f25f419aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f4105310 0x7f25f419aa90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f25f002a930 tx=0x7f25f0004270 comp rx=0 tx=0).stop 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 -- 172.21.15.148:0/4039460304 shutdown_connections 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f25e00b6620 0x7f25e00b8b30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f4105310 0x7f25f419aa90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25f410de20 0x7f25f419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 --2- 172.21.15.148:0/4039460304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25f41049c0 0x7f25f419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 -- 172.21.15.148:0/4039460304 >> 172.21.15.148:0/4039460304 conn(0x7f25f4079710 msgr2=0x7f25f4100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 -- 172.21.15.148:0/4039460304 shutdown_connections 2024-09-21T01:13:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:23.357+0000 7f25fbfdd640 1 -- 172.21.15.148:0/4039460304 wait complete. 2024-09-21T01:13:23.972 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:24.228 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:24 smithi148 ceph-mon[31000]: pgmap v320: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:24 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4039460304' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:24.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:24 smithi181 ceph-mon[34811]: pgmap v320: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:24.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:24 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/4039460304' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:24.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.722+0000 7ff291f19640 1 -- 172.21.15.148:0/3374070463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c108670 msgr2=0x7ff28c108a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:24.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.722+0000 7ff291f19640 1 --2- 172.21.15.148:0/3374070463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c108670 0x7ff28c108a80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff280009900 tx=0x7ff28002a410 comp rx=0 tx=0).stop 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.722+0000 7ff291f19640 1 -- 172.21.15.148:0/3374070463 shutdown_connections 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.722+0000 7ff291f19640 1 --2- 172.21.15.148:0/3374070463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c108670 0x7ff28c108a80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.722+0000 7ff291f19640 1 --2- 172.21.15.148:0/3374070463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff28c108fc0 0x7ff28c10f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.722+0000 7ff291f19640 1 --2- 172.21.15.148:0/3374070463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff28c103230 0x7ff28c103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.722+0000 7ff291f19640 1 -- 172.21.15.148:0/3374070463 >> 172.21.15.148:0/3374070463 conn(0x7ff28c079ea0 msgr2=0x7ff28c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.722+0000 7ff291f19640 1 -- 172.21.15.148:0/3374070463 shutdown_connections 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.722+0000 7ff291f19640 1 -- 172.21.15.148:0/3374070463 wait complete. 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff291f19640 1 Processor -- start 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff291f19640 1 -- start start 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff291f19640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff28c103230 0x7ff28c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff291f19640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c108670 0x7ff28c199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff291f19640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff28c108fc0 0x7ff28c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff291f19640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c112ca0 con 0x7ff28c108670 2024-09-21T01:13:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff291f19640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c112b20 con 0x7ff28c108fc0 2024-09-21T01:13:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff291f19640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c112e20 con 0x7ff28c103230 2024-09-21T01:13:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff28affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c108670 0x7ff28c199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff28affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c108670 0x7ff28c199d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40956/0 (socket says 172.21.15.148:40956) 2024-09-21T01:13:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.723+0000 7ff28affd640 1 -- 172.21.15.148:0/1454142921 learned_addr learned my addr 172.21.15.148:0/1454142921 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff28b7fe640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff28c103230 0x7ff28c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff28bfff640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff28c108fc0 0x7ff28c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff28affd640 1 -- 172.21.15.148:0/1454142921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff28c103230 msgr2=0x7ff28c199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff28affd640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff28c103230 0x7ff28c199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff28affd640 1 -- 172.21.15.148:0/1454142921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff28c108fc0 msgr2=0x7ff28c19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff28affd640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff28c108fc0 0x7ff28c19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff28affd640 1 -- 172.21.15.148:0/1454142921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28c19f700 con 0x7ff28c108670 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff28affd640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c108670 0x7ff28c199d30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff28002a930 tx=0x7ff280004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff288ff9640 1 -- 172.21.15.148:0/1454142921 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28003f030 con 0x7ff28c108670 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff288ff9640 1 -- 172.21.15.148:0/1454142921 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff280003cb0 con 0x7ff28c108670 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff291f19640 1 -- 172.21.15.148:0/1454142921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28c19f990 con 0x7ff28c108670 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff288ff9640 1 -- 172.21.15.148:0/1454142921 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280035070 con 0x7ff28c108670 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.724+0000 7ff291f19640 1 -- 172.21.15.148:0/1454142921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff28c1a6150 con 0x7ff28c108670 2024-09-21T01:13:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.725+0000 7ff291f19640 1 -- 172.21.15.148:0/1454142921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff28c104040 con 0x7ff28c108670 2024-09-21T01:13:24.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.727+0000 7ff288ff9640 1 -- 172.21.15.148:0/1454142921 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7ff280042030 con 0x7ff28c108670 2024-09-21T01:13:24.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.727+0000 7ff288ff9640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2740b65a0 0x7ff2740b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:24.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.728+0000 7ff28b7fe640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2740b65a0 0x7ff2740b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:24.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.728+0000 7ff288ff9640 1 -- 172.21.15.148:0/1454142921 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7ff280107f90 con 0x7ff28c108670 2024-09-21T01:13:24.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.728+0000 7ff28b7fe640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2740b65a0 0x7ff2740b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0058c0 tx=0x7ff27c00a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:24.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.731+0000 7ff288ff9640 1 -- 172.21.15.148:0/1454142921 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2800ce6d0 con 0x7ff28c108670 2024-09-21T01:13:24.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:24 smithi157 ceph-mon[34140]: pgmap v320: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:24.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:24 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/4039460304' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:24.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.947+0000 7ff291f19640 1 -- 172.21.15.148:0/1454142921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff28c06b9a0 con 0x7ff28c108670 2024-09-21T01:13:24.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.948+0000 7ff288ff9640 1 -- 172.21.15.148:0/1454142921 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11926 (secure 0 0 0) 0x7ff2800d2ab0 con 0x7ff28c108670 2024-09-21T01:13:24.949 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:24.949 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":23,"btime":"2024-09-21T01:12:23:525439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:12:22.780555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24646,24631]},"id":1}]} 2024-09-21T01:13:24.949 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 23 2024-09-21T01:13:24.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.950+0000 7ff291f19640 1 -- 172.21.15.148:0/1454142921 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2740b65a0 msgr2=0x7ff2740b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:24.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.950+0000 7ff291f19640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2740b65a0 0x7ff2740b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0058c0 tx=0x7ff27c00a4c0 comp rx=0 tx=0).stop 2024-09-21T01:13:24.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.950+0000 7ff291f19640 1 -- 172.21.15.148:0/1454142921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c108670 msgr2=0x7ff28c199d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:24.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.950+0000 7ff291f19640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c108670 0x7ff28c199d30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff28002a930 tx=0x7ff280004270 comp rx=0 tx=0).stop 2024-09-21T01:13:24.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.951+0000 7ff291f19640 1 -- 172.21.15.148:0/1454142921 shutdown_connections 2024-09-21T01:13:24.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.951+0000 7ff291f19640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2740b65a0 0x7ff2740b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:24.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.951+0000 7ff291f19640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c108670 0x7ff28c199d30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:24.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.951+0000 7ff291f19640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff28c108fc0 0x7ff28c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:24.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.951+0000 7ff291f19640 1 --2- 172.21.15.148:0/1454142921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff28c103230 0x7ff28c199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:24.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.951+0000 7ff291f19640 1 -- 172.21.15.148:0/1454142921 >> 172.21.15.148:0/1454142921 conn(0x7ff28c079ea0 msgr2=0x7ff28c1067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:24.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.951+0000 7ff291f19640 1 -- 172.21.15.148:0/1454142921 shutdown_connections 2024-09-21T01:13:24.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:24.951+0000 7ff291f19640 1 -- 172.21.15.148:0/1454142921 wait complete. 2024-09-21T01:13:25.536 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T01:12:11.894283+0000', 'modified': '2024-09-21T01:12:22.780555+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24665, 'mds_1': 24646, 'mds_2': 24631}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24599': {'gid': 24599, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.157:6835/2996859376', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 2996859376}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 2996859376}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24619': {'gid': 24619, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/685827281', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 685827281}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 685827281}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.157:6837/3732138486', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6836', 'nonce': 3732138486}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 3732138486}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.181:6837/3446561094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3446561094}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3446561094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24646': {'gid': 24646, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.181:6839/2036386246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 2036386246}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 2036386246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24665': {'gid': 24665, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.157:6839/762884269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 762884269}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 762884269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24665, 'qdb_cluster': [24665, 24646, 24631]} 2024-09-21T01:13:25.536 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T01:13:25.536 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T01:13:25.559 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:25 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1454142921' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:25.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:25 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1454142921' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:25.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:25 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1454142921' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:25.781 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:26.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.235+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2830674024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff644105190 msgr2=0x7ff6441055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.235+0000 7ff64a1b0640 1 --2- 172.21.15.148:0/2830674024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff644105190 0x7ff6441055a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff638009900 tx=0x7ff63802a410 comp rx=0 tx=0).stop 2024-09-21T01:13:26.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.235+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2830674024 shutdown_connections 2024-09-21T01:13:26.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.235+0000 7ff64a1b0640 1 --2- 172.21.15.148:0/2830674024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff644105190 0x7ff6441055a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.235+0000 7ff64a1b0640 1 --2- 172.21.15.148:0/2830674024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff644105ae0 0x7ff64410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.235+0000 7ff64a1b0640 1 --2- 172.21.15.148:0/2830674024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6441031c0 0x7ff6441035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.235+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2830674024 >> 172.21.15.148:0/2830674024 conn(0x7ff644077c60 msgr2=0x7ff6440780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:26.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.235+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2830674024 shutdown_connections 2024-09-21T01:13:26.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.235+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2830674024 wait complete. 2024-09-21T01:13:26.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.236+0000 7ff64a1b0640 1 Processor -- start 2024-09-21T01:13:26.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.236+0000 7ff64a1b0640 1 -- start start 2024-09-21T01:13:26.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff64a1b0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6441031c0 0x7ff644199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff64a1b0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff644105190 0x7ff644199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff64a1b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff644105ae0 0x7ff64419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff64a1b0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff644112980 con 0x7ff644105ae0 2024-09-21T01:13:26.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff64a1b0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff644112800 con 0x7ff644105190 2024-09-21T01:13:26.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff64a1b0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff644112b00 con 0x7ff6441031c0 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff643fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff644105ae0 0x7ff64419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff643fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff644105ae0 0x7ff64419ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40838/0 (socket says 172.21.15.148:40838) 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff643fff640 1 -- 172.21.15.148:0/2958326230 learned_addr learned my addr 172.21.15.148:0/2958326230 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff642ffd640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff644105190 0x7ff644199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff6437fe640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6441031c0 0x7ff644199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff643fff640 1 -- 172.21.15.148:0/2958326230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6441031c0 msgr2=0x7ff644199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff643fff640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6441031c0 0x7ff644199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff643fff640 1 -- 172.21.15.148:0/2958326230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff644105190 msgr2=0x7ff644199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff643fff640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff644105190 0x7ff644199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff643fff640 1 -- 172.21.15.148:0/2958326230 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64419f2e0 con 0x7ff644105ae0 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.237+0000 7ff643fff640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff644105ae0 0x7ff64419ebb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00ebb0 tx=0x7ff63c007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.238+0000 7ff640ff9640 1 -- 172.21.15.148:0/2958326230 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c007ca0 con 0x7ff644105ae0 2024-09-21T01:13:26.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.238+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2958326230 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64419f570 con 0x7ff644105ae0 2024-09-21T01:13:26.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.238+0000 7ff640ff9640 1 -- 172.21.15.148:0/2958326230 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff63c007e40 con 0x7ff644105ae0 2024-09-21T01:13:26.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.238+0000 7ff640ff9640 1 -- 172.21.15.148:0/2958326230 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0057d0 con 0x7ff644105ae0 2024-09-21T01:13:26.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.238+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2958326230 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff644101e20 con 0x7ff644105ae0 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.240+0000 7ff650724740 1 Processor -- start 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.240+0000 7ff640ff9640 1 -- 172.21.15.148:0/2958326230 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7ff63c00c460 con 0x7ff644105ae0 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff650724740 1 -- start start 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff650724740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bcaef60 0x55b16c054f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff650724740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc860a0 0x55b16c055440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff650724740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc8e280 0x55b16c055980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff650724740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b16bfccc10 con 0x55b16bc8e280 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff650724740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55b16bfbc040 con 0x55b16bc860a0 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff650724740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b16bfbfe50 con 0x55b16bcaef60 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff642ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc8e280 0x55b16c055980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff642ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc8e280 0x55b16c055980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40848/0 (socket says 172.21.15.148:40848) 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff642ffd640 1 -- 172.21.15.148:0/3914367108 learned_addr learned my addr 172.21.15.148:0/3914367108 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff6437fe640 1 --2- 172.21.15.148:0/3914367108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc860a0 0x55b16c055440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff642ffd640 1 --2- 172.21.15.148:0/3914367108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bcaef60 0x55b16c054f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff6437fe640 1 -- 172.21.15.148:0/3914367108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bcaef60 msgr2=0x55b16c054f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff6437fe640 1 --2- 172.21.15.148:0/3914367108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bcaef60 0x55b16c054f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff6437fe640 1 -- 172.21.15.148:0/3914367108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc8e280 msgr2=0x55b16c055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff6437fe640 1 --2- 172.21.15.148:0/3914367108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc8e280 0x55b16c055980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff6437fe640 1 -- 172.21.15.148:0/3914367108 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16bd1a540 con 0x55b16bc860a0 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.241+0000 7ff640ff9640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff62c0b65a0 0x7ff62c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.242+0000 7ff642ffd640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff62c0b65a0 0x7ff62c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.242+0000 7ff6437fe640 1 --2- 172.21.15.148:0/3914367108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc860a0 0x55b16c055440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff634004630 tx=0x7ff63400bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5d07d313e585317 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.242+0000 7ff640ff9640 1 -- 172.21.15.148:0/2958326230 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7ff63c0e89b0 con 0x7ff644105ae0 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.242+0000 7ff629ffb640 1 -- 172.21.15.148:0/3914367108 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634003b50 con 0x55b16bc860a0 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.242+0000 7ff629ffb640 1 -- 172.21.15.148:0/3914367108 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff634015070 con 0x55b16bc860a0 2024-09-21T01:13:26.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.242+0000 7ff629ffb640 1 -- 172.21.15.148:0/3914367108 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634004be0 con 0x55b16bc860a0 2024-09-21T01:13:26.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff650724740 1 -- 172.21.15.148:0/3914367108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc860a0 msgr2=0x55b16c055440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff642ffd640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff62c0b65a0 0x7ff62c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff638032fd0 tx=0x7ff638005780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:26.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff650724740 1 --2- 172.21.15.148:0/3914367108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc860a0 0x55b16c055440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff634004630 tx=0x7ff63400bb20 comp rx=0 tx=0).stop 2024-09-21T01:13:26.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff650724740 1 -- 172.21.15.148:0/3914367108 shutdown_connections 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff650724740 1 --2- 172.21.15.148:0/3914367108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc8e280 0x55b16c055980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff650724740 1 --2- 172.21.15.148:0/3914367108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc860a0 0x55b16c055440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff650724740 1 --2- 172.21.15.148:0/3914367108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bcaef60 0x55b16c054f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff650724740 1 -- 172.21.15.148:0/3914367108 >> 172.21.15.148:0/3914367108 conn(0x55b16bca3350 msgr2=0x55b16c052df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff650724740 1 -- 172.21.15.148:0/3914367108 shutdown_connections 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff650724740 1 -- 172.21.15.148:0/3914367108 wait complete. 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.243+0000 7ff650724740 1 -- start start 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff650724740 1 Processor -- start 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff650724740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc860a0 0x55b16c0609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff650724740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc8e280 0x55b16c060f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff650724740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bcaef60 0x55b16c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff650724740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b16be1d5f0 con 0x55b16bcaef60 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff650724740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55b16bf57010 con 0x55b16bc8e280 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff650724740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b16c0636e0 con 0x55b16bc860a0 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff650724740 10 client.0 _ll_register_callbacks cb 0x55b16bfb6340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff643fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bcaef60 0x55b16c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff643fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bcaef60 0x55b16c06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40854/0 (socket says 172.21.15.148:40854) 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff643fff640 1 -- 172.21.15.148:0/2046584973 learned_addr learned my addr 172.21.15.148:0/2046584973 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff6437fe640 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc860a0 0x55b16c0609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff642ffd640 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc8e280 0x55b16c060f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff643fff640 1 -- 172.21.15.148:0/2046584973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc860a0 msgr2=0x55b16c0609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff643fff640 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc860a0 0x55b16c0609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff643fff640 1 -- 172.21.15.148:0/2046584973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc8e280 msgr2=0x55b16c060f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff643fff640 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc8e280 0x55b16c060f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.244+0000 7ff643fff640 1 -- 172.21.15.148:0/2046584973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16bf84a00 con 0x55b16bcaef60 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.245+0000 7ff642ffd640 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc8e280 0x55b16c060f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.245+0000 7ff643fff640 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bcaef60 0x55b16c06c9d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0ab070 tx=0x7ff63c00e2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d337a9ac89f2169 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.245+0000 7ff622ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.245+0000 7ff622ffd640 1 -- 172.21.15.148:0/2046584973 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0b34d0 con 0x55b16bcaef60 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.245+0000 7ff622ffd640 1 -- 172.21.15.148:0/2046584973 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7ff63c0b31b0 con 0x55b16bcaef60 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.245+0000 7ff650724740 1 -- 172.21.15.148:0/2046584973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff634015070 con 0x55b16bcaef60 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.245+0000 7ff622ffd640 1 -- 172.21.15.148:0/2046584973 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff63c0b8410 con 0x55b16bcaef60 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.245+0000 7ff650724740 10 client.15150 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.245+0000 7ff650724740 1 -- 172.21.15.148:0/2046584973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55b16c06f600 con 0x55b16bcaef60 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.245+0000 7ff622ffd640 1 -- 172.21.15.148:0/2046584973 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff634015070 con 0x55b16bcaef60 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.246+0000 7ff622ffd640 1 -- 172.21.15.148:0/2046584973 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7ff63c0b4660 con 0x55b16bcaef60 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.246+0000 7ff650724740 10 client.15150 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.246+0000 7ff650724740 10 client.15150 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T01:13:26.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.246+0000 7ff650724740 20 client.15150 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:26.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.246+0000 7ff650724740 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55b16bc6d8e0 0x55b16c0730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.246+0000 7ff650724740 4 client.15150 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:13:26.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.246+0000 7ff650724740 1 -- 172.21.15.148:0/2046584973 --> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b16bfceb60 con 0x55b16bc6d8e0 2024-09-21T01:13:26.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.247+0000 7ff6437fe640 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55b16bc6d8e0 0x55b16c0730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.247+0000 7ff622ffd640 10 client.15150 ms_handle_connect on v2:172.21.15.181:6836/3446561094 2024-09-21T01:13:26.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.247+0000 7ff6437fe640 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55b16bc6d8e0 0x55b16c0730f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c5619e1c02386a4 server_cookie=ab54033c83f3a1eb in_seq=0 out_seq=0 2024-09-21T01:13:26.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff622ffd640 1 -- 172.21.15.148:0/2046584973 <== mds.2 v2:172.21.15.181:6836/3446561094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b16bfceb60 con 0x55b16bc6d8e0 2024-09-21T01:13:26.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff622ffd640 10 client.15150 handle_command_reply: tid=0 2024-09-21T01:13:26.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 client.15150 shutdown 2024-09-21T01:13:26.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 -- 172.21.15.148:0/2046584973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bcaef60 msgr2=0x55b16c06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bcaef60 0x55b16c06c9d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0ab070 tx=0x7ff63c00e2d0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 -- 172.21.15.148:0/2046584973 shutdown_connections 2024-09-21T01:13:26.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55b16bc6d8e0 0x55b16c0730f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bcaef60 0x55b16c06c9d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff622ffd640 0 client.15150 ms_handle_reset on v2:172.21.15.181:6836/3446561094 2024-09-21T01:13:26.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc8e280 0x55b16c060f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 --2- 172.21.15.148:0/2046584973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc860a0 0x55b16c0609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 -- 172.21.15.148:0/2046584973 >> 172.21.15.148:0/2046584973 conn(0x55b16bca3350 msgr2=0x55b16c058090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:26.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 -- 172.21.15.148:0/2046584973 shutdown_connections 2024-09-21T01:13:26.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 1 -- 172.21.15.148:0/2046584973 wait complete. 2024-09-21T01:13:26.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.248+0000 7ff650724740 20 client.15150 trim_cache size 0 max 16384 2024-09-21T01:13:26.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff650724740 1 Processor -- start 2024-09-21T01:13:26.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff650724740 1 -- start start 2024-09-21T01:13:26.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff650724740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc6d8e0 0x55b16c05b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff650724740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c04dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff650724740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 0x55b16c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff650724740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b16c071430 con 0x55b16bc860a0 2024-09-21T01:13:26.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff650724740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55b16c071b00 con 0x55b16bc6d8e0 2024-09-21T01:13:26.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff650724740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b16c0721d0 con 0x55b16bc8e280 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff642ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c04dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff642ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c04dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40864/0 (socket says 172.21.15.148:40864) 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.266+0000 7ff642ffd640 1 -- 172.21.15.148:0/2887729571 learned_addr learned my addr 172.21.15.148:0/2887729571 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff643fff640 1 --2- 172.21.15.148:0/2887729571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 0x55b16c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff6437fe640 1 --2- 172.21.15.148:0/2887729571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc6d8e0 0x55b16c05b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff642ffd640 1 -- 172.21.15.148:0/2887729571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 msgr2=0x55b16c06c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff642ffd640 1 --2- 172.21.15.148:0/2887729571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 0x55b16c06c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff642ffd640 1 -- 172.21.15.148:0/2887729571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc6d8e0 msgr2=0x55b16c05b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff642ffd640 1 --2- 172.21.15.148:0/2887729571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc6d8e0 0x55b16c05b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff642ffd640 1 -- 172.21.15.148:0/2887729571 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16c057790 con 0x55b16bc860a0 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff642ffd640 1 --2- 172.21.15.148:0/2887729571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c04dad0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff638009230 tx=0x7ff638009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e2e9b76933edbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff6297fa640 1 -- 172.21.15.148:0/2887729571 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638035040 con 0x55b16bc860a0 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff6297fa640 1 -- 172.21.15.148:0/2887729571 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff638003aa0 con 0x55b16bc860a0 2024-09-21T01:13:26.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.267+0000 7ff6297fa640 1 -- 172.21.15.148:0/2887729571 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638054aa0 con 0x55b16bc860a0 2024-09-21T01:13:26.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.268+0000 7ff650724740 1 -- 172.21.15.148:0/2887729571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 msgr2=0x55b16c04dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.268+0000 7ff650724740 1 --2- 172.21.15.148:0/2887729571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c04dad0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff638009230 tx=0x7ff638009260 comp rx=0 tx=0).stop 2024-09-21T01:13:26.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.268+0000 7ff650724740 1 -- 172.21.15.148:0/2887729571 shutdown_connections 2024-09-21T01:13:26.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.268+0000 7ff650724740 1 --2- 172.21.15.148:0/2887729571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c04dad0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.268+0000 7ff650724740 1 --2- 172.21.15.148:0/2887729571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 0x55b16c06c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.268+0000 7ff650724740 1 --2- 172.21.15.148:0/2887729571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc6d8e0 0x55b16c05b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.268+0000 7ff650724740 1 -- 172.21.15.148:0/2887729571 >> 172.21.15.148:0/2887729571 conn(0x55b16bca3350 msgr2=0x55b16c05f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.268+0000 7ff650724740 1 -- 172.21.15.148:0/2887729571 shutdown_connections 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.268+0000 7ff650724740 1 -- 172.21.15.148:0/2887729571 wait complete. 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff650724740 1 -- start start 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff650724740 1 Processor -- start 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff650724740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc6d8e0 0x55b16c07b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff650724740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c07b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff650724740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 0x55b16c0742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff650724740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b16c072f70 con 0x55b16bc860a0 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff650724740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55b16c0728a0 con 0x55b16bc6d8e0 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff650724740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b16c073640 con 0x55b16bc8e280 2024-09-21T01:13:26.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff650724740 10 client.0 _ll_register_callbacks cb 0x7ff63c0ab170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff642ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c07b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff642ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c07b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40880/0 (socket says 172.21.15.148:40880) 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff642ffd640 1 -- 172.21.15.148:0/803047530 learned_addr learned my addr 172.21.15.148:0/803047530 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.269+0000 7ff6437fe640 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc6d8e0 0x55b16c07b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff643fff640 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 0x55b16c0742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff642ffd640 1 -- 172.21.15.148:0/803047530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 msgr2=0x55b16c0742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff642ffd640 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 0x55b16c0742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff642ffd640 1 -- 172.21.15.148:0/803047530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc6d8e0 msgr2=0x55b16c07b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff642ffd640 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc6d8e0 0x55b16c07b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff642ffd640 1 -- 172.21.15.148:0/803047530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16c07c130 con 0x55b16bc860a0 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff643fff640 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 0x55b16c0742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:26.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff642ffd640 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c07b890 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff63802a450 tx=0x7ff638004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe31dc187e0dff75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff622ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff622ffd640 1 -- 172.21.15.148:0/803047530 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63805c070 con 0x55b16bc860a0 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff622ffd640 1 -- 172.21.15.148:0/803047530 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7ff6380035f0 con 0x55b16bc860a0 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff650724740 1 -- 172.21.15.148:0/803047530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff638003aa0 con 0x55b16bc860a0 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff622ffd640 1 -- 172.21.15.148:0/803047530 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff638068050 con 0x55b16bc860a0 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff650724740 10 client.15156 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.270+0000 7ff650724740 1 -- 172.21.15.148:0/803047530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55b16c0e2f90 con 0x55b16bc860a0 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.271+0000 7ff622ffd640 1 -- 172.21.15.148:0/803047530 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff638003aa0 con 0x55b16bc860a0 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.271+0000 7ff622ffd640 1 -- 172.21.15.148:0/803047530 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7ff638054a20 con 0x55b16bc860a0 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.271+0000 7ff650724740 10 client.15156 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.271+0000 7ff650724740 10 client.15156 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.271+0000 7ff650724740 20 client.15156 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.271+0000 7ff650724740 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55b16bcaef60 0x55b16c0e62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.271+0000 7ff650724740 4 client.15156 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:13:26.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.271+0000 7ff650724740 1 -- 172.21.15.148:0/803047530 --> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] -- command(tid 0: {"prefix": "status"}) -- 0x55b16bfca610 con 0x55b16bcaef60 2024-09-21T01:13:26.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.271+0000 7ff6437fe640 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55b16bcaef60 0x55b16c0e62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff622ffd640 10 client.15156 ms_handle_connect on v2:172.21.15.181:6836/3446561094 2024-09-21T01:13:26.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff6437fe640 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55b16bcaef60 0x55b16c0e62b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=94e029a13e1c1170 server_cookie=f0f6738e44631bff in_seq=0 out_seq=0 2024-09-21T01:13:26.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff622ffd640 1 -- 172.21.15.148:0/803047530 <== mds.2 v2:172.21.15.181:6836/3446561094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b16bfca610 con 0x55b16bcaef60 2024-09-21T01:13:26.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff622ffd640 10 client.15156 handle_command_reply: tid=0 2024-09-21T01:13:26.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 client.15156 shutdown 2024-09-21T01:13:26.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 -- 172.21.15.148:0/803047530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 msgr2=0x55b16c07b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c07b890 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff63802a450 tx=0x7ff638004530 comp rx=0 tx=0).stop 2024-09-21T01:13:26.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 -- 172.21.15.148:0/803047530 shutdown_connections 2024-09-21T01:13:26.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55b16bcaef60 0x55b16c0e62b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b16bc860a0 0x55b16c07b890 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b16bc8e280 0x55b16c0742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff622ffd640 0 client.15156 ms_handle_reset on v2:172.21.15.181:6836/3446561094 2024-09-21T01:13:26.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 --2- 172.21.15.148:0/803047530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b16bc6d8e0 0x55b16c07b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 -- 172.21.15.148:0/803047530 >> 172.21.15.148:0/803047530 conn(0x55b16bca3350 msgr2=0x55b16c0513b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:26.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 -- 172.21.15.148:0/803047530 shutdown_connections 2024-09-21T01:13:26.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.272+0000 7ff650724740 1 -- 172.21.15.148:0/803047530 wait complete. 2024-09-21T01:13:26.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff650724740 20 client.15156 trim_cache size 0 max 16384 2024-09-21T01:13:26.278 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:13:26.278 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "3872f802-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:13:26.278 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 2, 2024-09-21T01:13:26.278 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24631, 2024-09-21T01:13:26.279 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-21T01:13:26.279 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-21T01:13:26.279 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-21T01:13:26.279 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 65.748687794999995, 2024-09-21T01:13:26.279 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 23, 2024-09-21T01:13:26.279 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 76, 2024-09-21T01:13:26.279 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:13:26.279 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 97.622613474000005 2024-09-21T01:13:26.279 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2958326230 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff62c0b65a0 msgr2=0x7ff62c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff62c0b65a0 0x7ff62c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff638032fd0 tx=0x7ff638005780 comp rx=0 tx=0).stop 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2958326230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff644105ae0 msgr2=0x7ff64419ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff644105ae0 0x7ff64419ebb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00ebb0 tx=0x7ff63c007590 comp rx=0 tx=0).stop 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2958326230 shutdown_connections 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff62c0b65a0 0x7ff62c0b8ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff644105ae0 0x7ff64419ebb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff644105190 0x7ff644199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 --2- 172.21.15.148:0/2958326230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6441031c0 0x7ff644199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2958326230 >> 172.21.15.148:0/2958326230 conn(0x7ff644077c60 msgr2=0x7ff644106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2958326230 shutdown_connections 2024-09-21T01:13:26.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:26.273+0000 7ff64a1b0640 1 -- 172.21.15.148:0/2958326230 wait complete. 2024-09-21T01:13:26.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:26 smithi148 ceph-mon[31000]: pgmap v321: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:26.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:26 smithi181 ceph-mon[34811]: pgmap v321: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:26.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:26 smithi157 ceph-mon[34140]: pgmap v321: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:26.985 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T01:13:27.274 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:27.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.751+0000 7fa5ff693640 1 -- 172.21.15.148:0/2539503823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5f8108d50 msgr2=0x7fa5f810f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.751+0000 7fa5ff693640 1 --2- 172.21.15.148:0/2539503823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5f8108d50 0x7fa5f810f580 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009ca0 tx=0x7fa5f002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.751+0000 7fa5ff693640 1 -- 172.21.15.148:0/2539503823 shutdown_connections 2024-09-21T01:13:27.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.751+0000 7fa5ff693640 1 --2- 172.21.15.148:0/2539503823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5f8108d50 0x7fa5f810f580 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.751+0000 7fa5ff693640 1 --2- 172.21.15.148:0/2539503823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5f8108400 0x7fa5f8108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.751+0000 7fa5ff693640 1 --2- 172.21.15.148:0/2539503823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f81031d0 0x7fa5f81035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.751+0000 7fa5ff693640 1 -- 172.21.15.148:0/2539503823 >> 172.21.15.148:0/2539503823 conn(0x7fa5f8079f90 msgr2=0x7fa5f807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:27.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.751+0000 7fa5ff693640 1 -- 172.21.15.148:0/2539503823 shutdown_connections 2024-09-21T01:13:27.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.751+0000 7fa5ff693640 1 -- 172.21.15.148:0/2539503823 wait complete. 2024-09-21T01:13:27.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.751+0000 7fa5ff693640 1 Processor -- start 2024-09-21T01:13:27.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5ff693640 1 -- start start 2024-09-21T01:13:27.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5ff693640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f81031d0 0x7fa5f819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5ff693640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5f8108400 0x7fa5f819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5ff693640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5f8108d50 0x7fa5f819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5ff693640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8112a10 con 0x7fa5f8108d50 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5ff693640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8112890 con 0x7fa5f8108400 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5ff693640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8112b90 con 0x7fa5f81031d0 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fdc30640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5f8108d50 0x7fa5f819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fdc30640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5f8108d50 0x7fa5f819fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40900/0 (socket says 172.21.15.148:40900) 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fdc30640 1 -- 172.21.15.148:0/1846410090 learned_addr learned my addr 172.21.15.148:0/1846410090 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5f8108400 0x7fa5f819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f81031d0 0x7fa5f819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fdc30640 1 -- 172.21.15.148:0/1846410090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f81031d0 msgr2=0x7fa5f819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fdc30640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f81031d0 0x7fa5f819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fdc30640 1 -- 172.21.15.148:0/1846410090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5f8108400 msgr2=0x7fa5f819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fdc30640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5f8108400 0x7fa5f819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fdc30640 1 -- 172.21.15.148:0/1846410090 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f81a03e0 con 0x7fa5f8108d50 2024-09-21T01:13:27.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.752+0000 7fa5fdc30640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5f8108d50 0x7fa5f819fd70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0005cc0 tx=0x7fa5f002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:27.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.753+0000 7fa5ee7fc640 1 -- 172.21.15.148:0/1846410090 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0003bf0 con 0x7fa5f8108d50 2024-09-21T01:13:27.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.753+0000 7fa5ff693640 1 -- 172.21.15.148:0/1846410090 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f81a0670 con 0x7fa5f8108d50 2024-09-21T01:13:27.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.753+0000 7fa5ee7fc640 1 -- 172.21.15.148:0/1846410090 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5f0003d90 con 0x7fa5f8108d50 2024-09-21T01:13:27.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.753+0000 7fa5ee7fc640 1 -- 172.21.15.148:0/1846410090 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f002fbc0 con 0x7fa5f8108d50 2024-09-21T01:13:27.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.753+0000 7fa5ff693640 1 -- 172.21.15.148:0/1846410090 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f81a0bb0 con 0x7fa5f8108d50 2024-09-21T01:13:27.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.755+0000 7fa605c07740 1 Processor -- start 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.755+0000 7fa5ee7fc640 1 -- 172.21.15.148:0/1846410090 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fa5f002fd60 con 0x7fa5f8108d50 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa605c07740 1 -- start start 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa605c07740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29c9dcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa605c07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9dd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa605c07740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29c9dd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa605c07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f29c954c10 con 0x55f29c60e0a0 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa605c07740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55f29c944040 con 0x55f29c636f60 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa605c07740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f29c947e50 con 0x55f29c616280 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fd42f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9dd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fd42f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9dd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40914/0 (socket says 172.21.15.148:40914) 2024-09-21T01:13:27.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fd42f640 1 -- 172.21.15.148:0/3892672528 learned_addr learned my addr 172.21.15.148:0/3892672528 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/3892672528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29c9dd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/3892672528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29c9dcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fd42f640 1 -- 172.21.15.148:0/3892672528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 msgr2=0x55f29c9dd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/3892672528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29c9dd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fd42f640 1 -- 172.21.15.148:0/3892672528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 msgr2=0x55f29c9dcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/3892672528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29c9dcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5ee7fc640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa5e40b65d0 0x7fa5e40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fd42f640 1 -- 172.21.15.148:0/3892672528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f29c6a2540 con 0x55f29c60e0a0 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.756+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/3892672528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29c9dcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.757+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/3892672528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9dd440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800cc60 tx=0x7fa5e800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bda40f6dc56e346 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.757+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa5e40b65d0 0x7fa5e40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.757+0000 7fa5ee7fc640 1 -- 172.21.15.148:0/1846410090 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fa5f0108810 con 0x7fa5f8108d50 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.757+0000 7fa5e37fe640 1 -- 172.21.15.148:0/3892672528 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8014070 con 0x55f29c60e0a0 2024-09-21T01:13:27.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.757+0000 7fa5e37fe640 1 -- 172.21.15.148:0/3892672528 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5e80047a0 con 0x55f29c60e0a0 2024-09-21T01:13:27.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.757+0000 7fa5e37fe640 1 -- 172.21.15.148:0/3892672528 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8010690 con 0x55f29c60e0a0 2024-09-21T01:13:27.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 -- 172.21.15.148:0/3892672528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 msgr2=0x55f29c9dd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa5e40b65d0 0x7fa5e40b8ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400b620 tx=0x7fa5f400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:27.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 --2- 172.21.15.148:0/3892672528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9dd440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800cc60 tx=0x7fa5e800e720 comp rx=0 tx=0).stop 2024-09-21T01:13:27.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 -- 172.21.15.148:0/3892672528 shutdown_connections 2024-09-21T01:13:27.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 --2- 172.21.15.148:0/3892672528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9dd440 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 --2- 172.21.15.148:0/3892672528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29c9dd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 --2- 172.21.15.148:0/3892672528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29c9dcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 -- 172.21.15.148:0/3892672528 >> 172.21.15.148:0/3892672528 conn(0x55f29c62b350 msgr2=0x55f29c9dadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 -- 172.21.15.148:0/3892672528 shutdown_connections 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 -- 172.21.15.148:0/3892672528 wait complete. 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 -- start start 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.758+0000 7fa605c07740 1 Processor -- start 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa605c07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa605c07740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29c9ed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa605c07740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29c9f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa605c07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f29c7a55f0 con 0x55f29c60e0a0 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa605c07740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55f29c8df010 con 0x55f29c636f60 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa605c07740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f29c9efa40 con 0x55f29c616280 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa605c07740 10 client.0 _ll_register_callbacks cb 0x55f29c93e340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:27.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fd42f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fd42f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9ecdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40916/0 (socket says 172.21.15.148:40916) 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fd42f640 1 -- 172.21.15.148:0/3547494039 learned_addr learned my addr 172.21.15.148:0/3547494039 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29c9ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fdc30640 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29c9f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fd42f640 1 -- 172.21.15.148:0/3547494039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 msgr2=0x55f29c9ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29c9ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fd42f640 1 -- 172.21.15.148:0/3547494039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 msgr2=0x55f29c9f8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29c9f8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fd42f640 1 -- 172.21.15.148:0/3547494039 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f29c90ca00 con 0x55f29c60e0a0 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.759+0000 7fa5fdc30640 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29c9f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9ecdc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800cc30 tx=0x7fa5e8005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83c5d91855840e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa5e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/3547494039 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8014070 con 0x55f29c60e0a0 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/3547494039 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fa5e8010630 con 0x55f29c60e0a0 2024-09-21T01:13:27.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa605c07740 1 -- 172.21.15.148:0/3547494039 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5e80047a0 con 0x55f29c60e0a0 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/3547494039 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa5e80055e0 con 0x55f29c60e0a0 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa605c07740 10 client.15168 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa605c07740 1 -- 172.21.15.148:0/3547494039 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55f29c9fb8f0 con 0x55f29c60e0a0 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/3547494039 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5e80047a0 con 0x55f29c60e0a0 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/3547494039 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fa5e80185a0 con 0x55f29c60e0a0 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa605c07740 10 client.15168 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa605c07740 10 client.15168 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa605c07740 20 client.15168 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa605c07740 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55f29c5f58e0 0x55f29c9ff030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa605c07740 4 client.15168 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.760+0000 7fa605c07740 1 -- 172.21.15.148:0/3547494039 --> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f29c956b60 con 0x55f29c5f58e0 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.761+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55f29c5f58e0 0x55f29c9ff030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.761+0000 7fa5e0ff9640 10 client.15168 ms_handle_connect on v2:172.21.15.181:6838/2036386246 2024-09-21T01:13:27.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.761+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55f29c5f58e0 0x55f29c9ff030 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=583a6e84e773628b server_cookie=3e128c386f1e34cd in_seq=0 out_seq=0 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/3547494039 <== mds.1 v2:172.21.15.181:6838/2036386246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f29c956b60 con 0x55f29c5f58e0 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa5e0ff9640 10 client.15168 handle_command_reply: tid=0 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 client.15168 shutdown 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 -- 172.21.15.148:0/3547494039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 msgr2=0x55f29c9ecdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9ecdc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800cc30 tx=0x7fa5e8005230 comp rx=0 tx=0).stop 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 -- 172.21.15.148:0/3547494039 shutdown_connections 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55f29c5f58e0 0x55f29c9ff030 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29c9f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29c9ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 --2- 172.21.15.148:0/3547494039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29c9ecdc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 -- 172.21.15.148:0/3547494039 >> 172.21.15.148:0/3547494039 conn(0x55f29c62b350 msgr2=0x55f29c9d93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa5e0ff9640 0 client.15168 ms_handle_reset on v2:172.21.15.181:6838/2036386246 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 -- 172.21.15.148:0/3547494039 shutdown_connections 2024-09-21T01:13:27.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 1 -- 172.21.15.148:0/3547494039 wait complete. 2024-09-21T01:13:27.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.762+0000 7fa605c07740 20 client.15168 trim_cache size 0 max 16384 2024-09-21T01:13:27.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.780+0000 7fa605c07740 1 Processor -- start 2024-09-21T01:13:27.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.780+0000 7fa605c07740 1 -- start start 2024-09-21T01:13:27.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.780+0000 7fa605c07740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c60e0a0 0x55f29c9f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.780+0000 7fa605c07740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c616280 0x55f29c9f9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.780+0000 7fa605c07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c636f60 0x55f29c9d93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.780+0000 7fa605c07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f29c9fd370 con 0x55f29c636f60 2024-09-21T01:13:27.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa605c07740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55f29c9fda40 con 0x55f29c616280 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa605c07740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f29c9fe110 con 0x55f29c60e0a0 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5fdc30640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c636f60 0x55f29c9d93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5fdc30640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c636f60 0x55f29c9d93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40926/0 (socket says 172.21.15.148:40926) 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5fdc30640 1 -- 172.21.15.148:0/3747531324 learned_addr learned my addr 172.21.15.148:0/3747531324 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/3747531324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c60e0a0 0x55f29c9f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5fdc30640 1 -- 172.21.15.148:0/3747531324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c60e0a0 msgr2=0x55f29c9f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5fdc30640 1 --2- 172.21.15.148:0/3747531324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c60e0a0 0x55f29c9f8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5fdc30640 1 -- 172.21.15.148:0/3747531324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c616280 msgr2=0x55f29c9f9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5fdc30640 1 --2- 172.21.15.148:0/3747531324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c616280 0x55f29c9f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5fdc30640 1 -- 172.21.15.148:0/3747531324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f29c9db6e0 con 0x55f29c636f60 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5fdc30640 1 --2- 172.21.15.148:0/3747531324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c636f60 0x55f29c9d93b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00ce550 tx=0x7fa5f00cdfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b8b1c1685d37c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5e2ffd640 1 -- 172.21.15.148:0/3747531324 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00098b0 con 0x55f29c636f60 2024-09-21T01:13:27.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5e2ffd640 1 -- 172.21.15.148:0/3747531324 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5f0036040 con 0x55f29c636f60 2024-09-21T01:13:27.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.781+0000 7fa5e2ffd640 1 -- 172.21.15.148:0/3747531324 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00d7de0 con 0x55f29c636f60 2024-09-21T01:13:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.782+0000 7fa605c07740 1 -- 172.21.15.148:0/3747531324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c636f60 msgr2=0x55f29c9d93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.782+0000 7fa605c07740 1 --2- 172.21.15.148:0/3747531324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c636f60 0x55f29c9d93b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00ce550 tx=0x7fa5f00cdfc0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.782+0000 7fa605c07740 1 -- 172.21.15.148:0/3747531324 shutdown_connections 2024-09-21T01:13:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.782+0000 7fa605c07740 1 --2- 172.21.15.148:0/3747531324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c636f60 0x55f29c9d93b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.782+0000 7fa605c07740 1 --2- 172.21.15.148:0/3747531324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c616280 0x55f29c9f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.782+0000 7fa605c07740 1 --2- 172.21.15.148:0/3747531324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c60e0a0 0x55f29c9f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.782+0000 7fa605c07740 1 -- 172.21.15.148:0/3747531324 >> 172.21.15.148:0/3747531324 conn(0x55f29c62b350 msgr2=0x55f29c9ecda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.782+0000 7fa605c07740 1 -- 172.21.15.148:0/3747531324 shutdown_connections 2024-09-21T01:13:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.782+0000 7fa605c07740 1 -- 172.21.15.148:0/3747531324 wait complete. 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.782+0000 7fa605c07740 1 -- start start 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa605c07740 1 Processor -- start 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa605c07740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29ca02020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa605c07740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29ca025e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa605c07740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29ca06090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa605c07740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f29c9feeb0 con 0x55f29c60e0a0 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa605c07740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55f29c9fe7e0 con 0x55f29c636f60 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa605c07740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f29c9ff580 con 0x55f29c616280 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa605c07740 10 client.0 _ll_register_callbacks cb 0x7fa5f400b6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa5fd42f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29ca02020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa5fd42f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29ca02020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40930/0 (socket says 172.21.15.148:40930) 2024-09-21T01:13:27.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa5fd42f640 1 -- 172.21.15.148:0/2615124415 learned_addr learned my addr 172.21.15.148:0/2615124415 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29ca025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa5fd42f640 1 -- 172.21.15.148:0/2615124415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 msgr2=0x55f29ca025e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa5fdc30640 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29ca06090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29ca025e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa5fd42f640 1 -- 172.21.15.148:0/2615124415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 msgr2=0x55f29ca06090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29ca06090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.783+0000 7fa5fd42f640 1 -- 172.21.15.148:0/2615124415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f29c9df810 con 0x55f29c60e0a0 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa5fd42f640 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29ca02020 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800cc60 tx=0x7fa5e8018e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b11febc6890722f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa5e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/2615124415 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8014040 con 0x55f29c60e0a0 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/2615124415 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fa5e8004040 con 0x55f29c60e0a0 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa605c07740 1 -- 172.21.15.148:0/2615124415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f0036040 con 0x55f29c60e0a0 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/2615124415 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa5e800c830 con 0x55f29c60e0a0 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa605c07740 10 client.15174 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa605c07740 1 -- 172.21.15.148:0/2615124415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55f29ca078f0 con 0x55f29c60e0a0 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/2615124415 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5f0036040 con 0x55f29c60e0a0 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/2615124415 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fa5e8003a70 con 0x55f29c60e0a0 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa605c07740 10 client.15174 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa605c07740 10 client.15174 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.784+0000 7fa605c07740 20 client.15174 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa605c07740 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55f29c5cac90 0x55f29ca6d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa605c07740 4 client.15174 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa605c07740 1 -- 172.21.15.148:0/2615124415 --> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] -- command(tid 0: {"prefix": "status"}) -- 0x55f29c952610 con 0x55f29c5cac90 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55f29c5cac90 0x55f29ca6d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa5e0ff9640 10 client.15174 ms_handle_connect on v2:172.21.15.181:6838/2036386246 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa5fcc2e640 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55f29c5cac90 0x55f29ca6d460 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e40d12f69c826ea server_cookie=45bbc646bebeb201 in_seq=0 out_seq=0 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa5e0ff9640 1 -- 172.21.15.148:0/2615124415 <== mds.1 v2:172.21.15.181:6838/2036386246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f29c952610 con 0x55f29c5cac90 2024-09-21T01:13:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa5e0ff9640 10 client.15174 handle_command_reply: tid=0 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa605c07740 1 client.15174 shutdown 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa605c07740 1 -- 172.21.15.148:0/2615124415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 msgr2=0x55f29ca02020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.785+0000 7fa605c07740 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29ca02020 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800cc60 tx=0x7fa5e8018e10 comp rx=0 tx=0).stop 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa605c07740 1 -- 172.21.15.148:0/2615124415 shutdown_connections 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa605c07740 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55f29c5cac90 0x55f29ca6d460 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa605c07740 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f29c636f60 0x55f29ca06090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa605c07740 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f29c616280 0x55f29ca025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa605c07740 1 --2- 172.21.15.148:0/2615124415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f29c60e0a0 0x55f29ca02020 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa605c07740 1 -- 172.21.15.148:0/2615124415 >> 172.21.15.148:0/2615124415 conn(0x55f29c62b350 msgr2=0x55f29c9e7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa5e0ff9640 0 client.15174 ms_handle_reset on v2:172.21.15.181:6838/2036386246 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa605c07740 1 -- 172.21.15.148:0/2615124415 shutdown_connections 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa605c07740 1 -- 172.21.15.148:0/2615124415 wait complete. 2024-09-21T01:13:27.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa605c07740 20 client.15174 trim_cache size 0 max 16384 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "3872f802-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 1, 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24646, 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 68.272020006000005, 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 23, 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 76, 2024-09-21T01:13:27.792 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:13:27.793 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 94.151340177999998 2024-09-21T01:13:27.793 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa5ff693640 1 -- 172.21.15.148:0/1846410090 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa5e40b65d0 msgr2=0x7fa5e40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa5ff693640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa5e40b65d0 0x7fa5e40b8ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400b620 tx=0x7fa5f400b390 comp rx=0 tx=0).stop 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa5ff693640 1 -- 172.21.15.148:0/1846410090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5f8108d50 msgr2=0x7fa5f819fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa5ff693640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5f8108d50 0x7fa5f819fd70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0005cc0 tx=0x7fa5f002f380 comp rx=0 tx=0).stop 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa5ff693640 1 -- 172.21.15.148:0/1846410090 shutdown_connections 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa5ff693640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa5e40b65d0 0x7fa5e40b8ae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa5ff693640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5f8108d50 0x7fa5f819fd70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa5ff693640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5f8108400 0x7fa5f819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.786+0000 7fa5ff693640 1 --2- 172.21.15.148:0/1846410090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f81031d0 0x7fa5f819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.787+0000 7fa5ff693640 1 -- 172.21.15.148:0/1846410090 >> 172.21.15.148:0/1846410090 conn(0x7fa5f8079f90 msgr2=0x7fa5f8101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.787+0000 7fa5ff693640 1 -- 172.21.15.148:0/1846410090 shutdown_connections 2024-09-21T01:13:27.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:27.787+0000 7fa5ff693640 1 -- 172.21.15.148:0/1846410090 wait complete. 2024-09-21T01:13:28.518 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T01:13:28.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:28 smithi148 ceph-mon[31000]: pgmap v322: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:28.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:28 smithi181 ceph-mon[34811]: pgmap v322: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:28.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:28 smithi157 ceph-mon[34140]: pgmap v322: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:28.762 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:29.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.249+0000 7f66eb09c640 1 -- 172.21.15.148:0/992765352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66e4108460 msgr2=0x7f66e4108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:29.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.249+0000 7f66eb09c640 1 --2- 172.21.15.148:0/992765352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66e4108460 0x7f66e4108870 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66d0009900 tx=0x7f66d002a410 comp rx=0 tx=0).stop 2024-09-21T01:13:29.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.249+0000 7f66eb09c640 1 -- 172.21.15.148:0/992765352 shutdown_connections 2024-09-21T01:13:29.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.249+0000 7f66eb09c640 1 --2- 172.21.15.148:0/992765352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66e4108460 0x7f66e4108870 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.249+0000 7f66eb09c640 1 --2- 172.21.15.148:0/992765352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66e4108db0 0x7f66e410f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.249+0000 7f66eb09c640 1 --2- 172.21.15.148:0/992765352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e41031f0 0x7f66e4103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.249+0000 7f66eb09c640 1 -- 172.21.15.148:0/992765352 >> 172.21.15.148:0/992765352 conn(0x7f66e4079ec0 msgr2=0x7f66e407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:29.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.249+0000 7f66eb09c640 1 -- 172.21.15.148:0/992765352 shutdown_connections 2024-09-21T01:13:29.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.249+0000 7f66eb09c640 1 -- 172.21.15.148:0/992765352 wait complete. 2024-09-21T01:13:29.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.250+0000 7f66eb09c640 1 Processor -- start 2024-09-21T01:13:29.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.250+0000 7f66eb09c640 1 -- start start 2024-09-21T01:13:29.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.250+0000 7f66eb09c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e41031f0 0x7f66e419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.250+0000 7f66eb09c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66e4108460 0x7f66e419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.250+0000 7f66eb09c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66e4108db0 0x7f66e419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.250+0000 7f66eb09c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4112a70 con 0x7f66e4108db0 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.250+0000 7f66eb09c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f66e41128f0 con 0x7f66e4108460 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.250+0000 7f66eb09c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4112bf0 con 0x7f66e41031f0 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.250+0000 7f66e9639640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66e4108db0 0x7f66e419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.250+0000 7f66e9639640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66e4108db0 0x7f66e419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40940/0 (socket says 172.21.15.148:40940) 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e9639640 1 -- 172.21.15.148:0/2423206894 learned_addr learned my addr 172.21.15.148:0/2423206894 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e8e38640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e41031f0 0x7f66e419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e3fff640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66e4108460 0x7f66e419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e9639640 1 -- 172.21.15.148:0/2423206894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e41031f0 msgr2=0x7f66e419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e9639640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e41031f0 0x7f66e419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e9639640 1 -- 172.21.15.148:0/2423206894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66e4108460 msgr2=0x7f66e419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:29.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e9639640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66e4108460 0x7f66e419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e9639640 1 -- 172.21.15.148:0/2423206894 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e41a0500 con 0x7f66e4108db0 2024-09-21T01:13:29.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e9639640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66e4108db0 0x7f66e419fdd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00cad0 tx=0x7f66dc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:29.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e1ffb640 1 -- 172.21.15.148:0/2423206894 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00ae20 con 0x7f66e4108db0 2024-09-21T01:13:29.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66eb09c640 1 -- 172.21.15.148:0/2423206894 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e41a07f0 con 0x7f66e4108db0 2024-09-21T01:13:29.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e1ffb640 1 -- 172.21.15.148:0/2423206894 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66dc005020 con 0x7f66e4108db0 2024-09-21T01:13:29.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66e1ffb640 1 -- 172.21.15.148:0/2423206894 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00f6b0 con 0x7f66e4108db0 2024-09-21T01:13:29.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.251+0000 7f66eb09c640 1 -- 172.21.15.148:0/2423206894 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e41a6f50 con 0x7f66e4108db0 2024-09-21T01:13:29.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.254+0000 7f66e1ffb640 1 -- 172.21.15.148:0/2423206894 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f66dc0051d0 con 0x7f66e4108db0 2024-09-21T01:13:29.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.254+0000 7f66f1610740 1 Processor -- start 2024-09-21T01:13:29.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.254+0000 7f66f1610740 1 -- start start 2024-09-21T01:13:29.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.254+0000 7f66f1610740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb8637f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.254+0000 7f66f1610740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8638440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.254+0000 7f66f1610740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 0x558eb8638980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.254+0000 7f66f1610740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558eb85afc10 con 0x558eb8291f60 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.254+0000 7f66f1610740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x558eb859f040 con 0x558eb8271280 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.254+0000 7f66f1610740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558eb85a2e50 con 0x558eb82690a0 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb8637f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb8637f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40944/0 (socket says 172.21.15.148:40944) 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e3fff640 1 -- 172.21.15.148:0/2617745280 learned_addr learned my addr 172.21.15.148:0/2617745280 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e1ffb640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f66d40b65a0 0x7f66d40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e8e38640 1 --2- 172.21.15.148:0/2617745280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8638440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e3fff640 1 --2- 172.21.15.148:0/2617745280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 0x558eb8638980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e9639640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f66d40b65a0 0x7f66d40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e3fff640 1 -- 172.21.15.148:0/2617745280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 msgr2=0x558eb8638440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e3fff640 1 --2- 172.21.15.148:0/2617745280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8638440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e3fff640 1 -- 172.21.15.148:0/2617745280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 msgr2=0x558eb8638980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e3fff640 1 --2- 172.21.15.148:0/2617745280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 0x558eb8638980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e3fff640 1 -- 172.21.15.148:0/2617745280 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eb82fd540 con 0x558eb8291f60 2024-09-21T01:13:29.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e1ffb640 1 -- 172.21.15.148:0/2423206894 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f66dc0e7550 con 0x7f66e4108db0 2024-09-21T01:13:29.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e3fff640 1 --2- 172.21.15.148:0/2617745280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb8637f00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f66d002a930 tx=0x7f66d0009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa1f86e66f5c0e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:29.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66e9639640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f66d40b65a0 0x7f66d40b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0ad290 tx=0x7f66dc0a1e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:29.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.255+0000 7f66ceffd640 1 -- 172.21.15.148:0/2617745280 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0035050 con 0x558eb8291f60 2024-09-21T01:13:29.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.256+0000 7f66ceffd640 1 -- 172.21.15.148:0/2617745280 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66d00318b0 con 0x558eb8291f60 2024-09-21T01:13:29.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.256+0000 7f66ceffd640 1 -- 172.21.15.148:0/2617745280 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0004920 con 0x558eb8291f60 2024-09-21T01:13:29.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.256+0000 7f66f1610740 1 -- 172.21.15.148:0/2617745280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 msgr2=0x558eb8637f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:29.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.256+0000 7f66f1610740 1 --2- 172.21.15.148:0/2617745280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb8637f00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f66d002a930 tx=0x7f66d0009640 comp rx=0 tx=0).stop 2024-09-21T01:13:29.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.256+0000 7f66f1610740 1 -- 172.21.15.148:0/2617745280 shutdown_connections 2024-09-21T01:13:29.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.256+0000 7f66f1610740 1 --2- 172.21.15.148:0/2617745280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 0x558eb8638980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.256+0000 7f66f1610740 1 --2- 172.21.15.148:0/2617745280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8638440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.256+0000 7f66f1610740 1 --2- 172.21.15.148:0/2617745280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb8637f00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.256+0000 7f66f1610740 1 -- 172.21.15.148:0/2617745280 >> 172.21.15.148:0/2617745280 conn(0x558eb8286350 msgr2=0x558eb8635df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:29.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.257+0000 7f66f1610740 1 -- 172.21.15.148:0/2617745280 shutdown_connections 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.257+0000 7f66f1610740 1 -- 172.21.15.148:0/2617745280 wait complete. 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.257+0000 7f66f1610740 1 -- start start 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.257+0000 7f66f1610740 1 Processor -- start 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66f1610740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8643a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66f1610740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8271280 0x558eb8643f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66f1610740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8291f60 0x558eb864f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66f1610740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558eb84005f0 con 0x558eb8271280 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66f1610740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x558eb853a010 con 0x558eb8291f60 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66f1610740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558eb8646680 con 0x558eb82690a0 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66f1610740 10 client.0 _ll_register_callbacks cb 0x558eb8599340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e8e38640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8271280 0x558eb8643f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e8e38640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8271280 0x558eb8643f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40958/0 (socket says 172.21.15.148:40958) 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e8e38640 1 -- 172.21.15.148:0/826454021 learned_addr learned my addr 172.21.15.148:0/826454021 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e3fff640 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8291f60 0x558eb864f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e3fff640 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8643a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e8e38640 1 -- 172.21.15.148:0/826454021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 msgr2=0x558eb8643a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e8e38640 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8643a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e8e38640 1 -- 172.21.15.148:0/826454021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8291f60 msgr2=0x558eb864f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e8e38640 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8291f60 0x558eb864f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e8e38640 1 -- 172.21.15.148:0/826454021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eb8567a00 con 0x558eb8271280 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e3fff640 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8643a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66e8e38640 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8271280 0x558eb8643f70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f66d80106b0 tx=0x7f66d8010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3183366674fb826 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66c3fff640 1 -- 172.21.15.148:0/826454021 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d801d060 con 0x558eb8271280 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66f1610740 1 -- 172.21.15.148:0/826454021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66d00318b0 con 0x558eb8271280 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.258+0000 7f66c3fff640 1 -- 172.21.15.148:0/826454021 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f66d800eda0 con 0x558eb8271280 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66c3fff640 1 -- 172.21.15.148:0/826454021 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f66d8018430 con 0x558eb8271280 2024-09-21T01:13:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66f1610740 10 client.15186 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66f1610740 1 -- 172.21.15.148:0/826454021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x558eb8652680 con 0x558eb8271280 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66c3fff640 1 -- 172.21.15.148:0/826454021 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66d00318b0 con 0x558eb8271280 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66c3fff640 1 -- 172.21.15.148:0/826454021 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f66d80225b0 con 0x558eb8271280 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66f1610740 10 client.15186 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66f1610740 10 client.15186 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66f1610740 20 client.15186 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66f1610740 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558eb82508e0 0x558eb8656550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66f1610740 4 client.15186 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66f1610740 1 -- 172.21.15.148:0/826454021 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eb85b1b60 con 0x558eb82508e0 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.259+0000 7f66e3fff640 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558eb82508e0 0x558eb8656550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.260+0000 7f66c3fff640 10 client.15186 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.260+0000 7f66e3fff640 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558eb82508e0 0x558eb8656550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8648020d29df940a server_cookie=f2f08bd5d11ab931 in_seq=0 out_seq=0 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66c3fff640 1 -- 172.21.15.148:0/826454021 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558eb85b1b60 con 0x558eb82508e0 2024-09-21T01:13:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66c3fff640 10 client.15186 handle_command_reply: tid=0 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 client.15186 shutdown 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 -- 172.21.15.148:0/826454021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8271280 msgr2=0x558eb8643f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8271280 0x558eb8643f70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f66d80106b0 tx=0x7f66d8010b70 comp rx=0 tx=0).stop 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 -- 172.21.15.148:0/826454021 shutdown_connections 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558eb82508e0 0x558eb8656550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8271280 0x558eb8643f70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8291f60 0x558eb864f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66c3fff640 0 client.15186 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 --2- 172.21.15.148:0/826454021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8643a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 -- 172.21.15.148:0/826454021 >> 172.21.15.148:0/826454021 conn(0x558eb8286350 msgr2=0x558eb863b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 -- 172.21.15.148:0/826454021 shutdown_connections 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 1 -- 172.21.15.148:0/826454021 wait complete. 2024-09-21T01:13:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.261+0000 7f66f1610740 20 client.15186 trim_cache size 0 max 16384 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66f1610740 1 Processor -- start 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66f1610740 1 -- start start 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66f1610740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8642d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66f1610740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 0x558eb863e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66f1610740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb863ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66f1610740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558eb8654890 con 0x558eb8291f60 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66f1610740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x558eb8654f60 con 0x558eb8271280 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66f1610740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558eb8655630 con 0x558eb82690a0 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66e3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb863ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66e3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb863ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40960/0 (socket says 172.21.15.148:40960) 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.279+0000 7f66e3fff640 1 -- 172.21.15.148:0/2659897403 learned_addr learned my addr 172.21.15.148:0/2659897403 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66e3fff640 1 --2- 172.21.15.148:0/2659897403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8642d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66e3fff640 1 -- 172.21.15.148:0/2659897403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 msgr2=0x558eb8642d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66e3fff640 1 --2- 172.21.15.148:0/2659897403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8642d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66e3fff640 1 -- 172.21.15.148:0/2659897403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 msgr2=0x558eb863e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66e8e38640 1 --2- 172.21.15.148:0/2659897403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 0x558eb863e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66e3fff640 1 --2- 172.21.15.148:0/2659897403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 0x558eb863e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66e3fff640 1 -- 172.21.15.148:0/2659897403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eb863ad60 con 0x558eb8291f60 2024-09-21T01:13:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66e8e38640 1 --2- 172.21.15.148:0/2659897403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 0x558eb863e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66e3fff640 1 --2- 172.21.15.148:0/2659897403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb863ef20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f66d0006010 tx=0x7f66d0009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26fc98be875fcc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66ce7fc640 1 -- 172.21.15.148:0/2659897403 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0059070 con 0x558eb8291f60 2024-09-21T01:13:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66ce7fc640 1 -- 172.21.15.148:0/2659897403 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66d0004230 con 0x558eb8291f60 2024-09-21T01:13:29.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.280+0000 7f66ce7fc640 1 -- 172.21.15.148:0/2659897403 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d004f070 con 0x558eb8291f60 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 -- 172.21.15.148:0/2659897403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 msgr2=0x558eb863ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 --2- 172.21.15.148:0/2659897403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb863ef20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f66d0006010 tx=0x7f66d0009640 comp rx=0 tx=0).stop 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 -- 172.21.15.148:0/2659897403 shutdown_connections 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 --2- 172.21.15.148:0/2659897403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb863ef20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 --2- 172.21.15.148:0/2659897403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb8271280 0x558eb863e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 --2- 172.21.15.148:0/2659897403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb82690a0 0x558eb8642d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 -- 172.21.15.148:0/2659897403 >> 172.21.15.148:0/2659897403 conn(0x558eb8286350 msgr2=0x558eb8643a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 -- 172.21.15.148:0/2659897403 shutdown_connections 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 -- 172.21.15.148:0/2659897403 wait complete. 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 -- start start 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.281+0000 7f66f1610740 1 Processor -- start 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66f1610740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb82690a0 0x558eb8658d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66f1610740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb8271280 0x558eb8659270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66f1610740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb86597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66f1610740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558eb86563d0 con 0x558eb8291f60 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66f1610740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x558eb8655d00 con 0x558eb82690a0 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66f1610740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558eb8656aa0 con 0x558eb8271280 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66f1610740 10 client.0 _ll_register_callbacks cb 0x7f66d800b5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb86597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb86597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40966/0 (socket says 172.21.15.148:40966) 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e3fff640 1 -- 172.21.15.148:0/4102359250 learned_addr learned my addr 172.21.15.148:0/4102359250 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e3fff640 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb82690a0 0x558eb8658d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e8e38640 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb8271280 0x558eb8659270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e3fff640 1 -- 172.21.15.148:0/4102359250 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb8271280 msgr2=0x558eb8659270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e3fff640 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb8271280 0x558eb8659270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e3fff640 1 -- 172.21.15.148:0/4102359250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb82690a0 msgr2=0x558eb8658d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:29.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e3fff640 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb82690a0 0x558eb8658d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e3fff640 1 -- 172.21.15.148:0/4102359250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eb865dee0 con 0x558eb8291f60 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e8e38640 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb8271280 0x558eb8659270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66e3fff640 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb86597b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f66d0033000 tx=0x7f66d0003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215ed856ae1f7208 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.282+0000 7f66c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66c3fff640 1 -- 172.21.15.148:0/4102359250 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0059070 con 0x558eb8291f60 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66c3fff640 1 -- 172.21.15.148:0/4102359250 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f66d00037f0 con 0x558eb8291f60 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66f1610740 1 -- 172.21.15.148:0/4102359250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66d0004230 con 0x558eb8291f60 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66c3fff640 1 -- 172.21.15.148:0/4102359250 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f66d004f040 con 0x558eb8291f60 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66f1610740 10 client.15192 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66f1610740 1 -- 172.21.15.148:0/4102359250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x558eb865f0d0 con 0x558eb8291f60 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66c3fff640 1 -- 172.21.15.148:0/4102359250 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66d0004230 con 0x558eb8291f60 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66c3fff640 1 -- 172.21.15.148:0/4102359250 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f66d0049410 con 0x558eb8291f60 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66f1610740 10 client.15192 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:29.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66f1610740 10 client.15192 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66f1610740 20 client.15192 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66f1610740 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558eb8225c90 0x558eb86c4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66f1610740 4 client.15192 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.283+0000 7f66f1610740 1 -- 172.21.15.148:0/4102359250 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "status"}) -- 0x558eb85ad610 con 0x558eb8225c90 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66e8e38640 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558eb8225c90 0x558eb86c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66c3fff640 10 client.15192 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66e8e38640 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558eb8225c90 0x558eb86c4470 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2369605828c3890f server_cookie=e692949da86f4cac in_seq=0 out_seq=0 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66c3fff640 1 -- 172.21.15.148:0/4102359250 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558eb85ad610 con 0x558eb8225c90 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66c3fff640 10 client.15192 handle_command_reply: tid=0 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66f1610740 1 client.15192 shutdown 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66f1610740 1 -- 172.21.15.148:0/4102359250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 msgr2=0x558eb86597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66f1610740 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb86597b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f66d0033000 tx=0x7f66d0003c90 comp rx=0 tx=0).stop 2024-09-21T01:13:29.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66f1610740 1 -- 172.21.15.148:0/4102359250 shutdown_connections 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66f1610740 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558eb8225c90 0x558eb86c4470 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66f1610740 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558eb8291f60 0x558eb86597b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66c3fff640 0 client.15192 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66f1610740 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb8271280 0x558eb8659270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66f1610740 1 --2- 172.21.15.148:0/4102359250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558eb82690a0 0x558eb8658d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.284+0000 7f66f1610740 1 -- 172.21.15.148:0/4102359250 >> 172.21.15.148:0/4102359250 conn(0x558eb8286350 msgr2=0x558eb863e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.285+0000 7f66f1610740 1 -- 172.21.15.148:0/4102359250 shutdown_connections 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.285+0000 7f66f1610740 1 -- 172.21.15.148:0/4102359250 wait complete. 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.285+0000 7f66f1610740 20 client.15192 trim_cache size 0 max 16384 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:13:29.290 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "3872f802-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24665, 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 76.967900181000005, 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 23, 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 76, 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 87.505179741999996 2024-09-21T01:13:29.291 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:13:29.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.285+0000 7f66eb09c640 1 -- 172.21.15.148:0/2423206894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f66d40b65a0 msgr2=0x7f66d40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:29.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.285+0000 7f66eb09c640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f66d40b65a0 0x7f66d40b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0ad290 tx=0x7f66dc0a1e40 comp rx=0 tx=0).stop 2024-09-21T01:13:29.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.285+0000 7f66eb09c640 1 -- 172.21.15.148:0/2423206894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66e4108db0 msgr2=0x7f66e419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:29.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.285+0000 7f66eb09c640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66e4108db0 0x7f66e419fdd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00cad0 tx=0x7f66dc00cf90 comp rx=0 tx=0).stop 2024-09-21T01:13:29.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.286+0000 7f66eb09c640 1 -- 172.21.15.148:0/2423206894 shutdown_connections 2024-09-21T01:13:29.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.286+0000 7f66eb09c640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f66d40b65a0 0x7f66d40b8ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.286+0000 7f66eb09c640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66e4108db0 0x7f66e419fdd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.286+0000 7f66eb09c640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66e4108460 0x7f66e419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.286+0000 7f66eb09c640 1 --2- 172.21.15.148:0/2423206894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66e41031f0 0x7f66e419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:29.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.286+0000 7f66eb09c640 1 -- 172.21.15.148:0/2423206894 >> 172.21.15.148:0/2423206894 conn(0x7f66e4079ec0 msgr2=0x7f66e41013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:29.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.286+0000 7f66eb09c640 1 -- 172.21.15.148:0/2423206894 shutdown_connections 2024-09-21T01:13:29.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:29.286+0000 7f66eb09c640 1 -- 172.21.15.148:0/2423206894 wait complete. 2024-09-21T01:13:29.995 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T01:13:29.995 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T01:13:30.005 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T01:13:30.006 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T01:13:30.251 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:30.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:30 smithi148 ceph-mon[31000]: pgmap v323: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T01:13:30.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:30 smithi181 ceph-mon[34811]: pgmap v323: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T01:13:30.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:30 smithi157 ceph-mon[34140]: pgmap v323: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T01:13:30.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.752+0000 7f42dd245640 1 -- 172.21.15.148:0/1088852838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d81040a0 msgr2=0x7f42d810aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:30.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.752+0000 7f42dd245640 1 --2- 172.21.15.148:0/1088852838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d81040a0 0x7f42d810aa40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009ca0 tx=0x7f42d002a950 comp rx=0 tx=0).stop 2024-09-21T01:13:30.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.752+0000 7f42dd245640 1 -- 172.21.15.148:0/1088852838 shutdown_connections 2024-09-21T01:13:30.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.752+0000 7f42dd245640 1 --2- 172.21.15.148:0/1088852838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d81040a0 0x7f42d810aa40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.752+0000 7f42dd245640 1 --2- 172.21.15.148:0/1088852838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42d8103700 0x7f42d8103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.752+0000 7f42dd245640 1 --2- 172.21.15.148:0/1088852838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42d8102670 0x7f42d8102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.752+0000 7f42dd245640 1 -- 172.21.15.148:0/1088852838 >> 172.21.15.148:0/1088852838 conn(0x7f42d80fdfe0 msgr2=0x7f42d8100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:30.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.752+0000 7f42dd245640 1 -- 172.21.15.148:0/1088852838 shutdown_connections 2024-09-21T01:13:30.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.752+0000 7f42dd245640 1 -- 172.21.15.148:0/1088852838 wait complete. 2024-09-21T01:13:30.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42dd245640 1 Processor -- start 2024-09-21T01:13:30.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42dd245640 1 -- start start 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42dd245640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42d8102670 0x7f42d8199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42dd245640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42d8103700 0x7f42d819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42dd245640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d81040a0 0x7f42d819b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42dd245640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42d810e2a0 con 0x7f42d81040a0 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42dd245640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f42d810e120 con 0x7f42d8102670 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42dd245640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f42d810e420 con 0x7f42d8103700 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42d759e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d81040a0 0x7f42d819b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42d759e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d81040a0 0x7f42d819b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40982/0 (socket says 172.21.15.148:40982) 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.753+0000 7f42d759e640 1 -- 172.21.15.148:0/361438204 learned_addr learned my addr 172.21.15.148:0/361438204 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42d659c640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42d8103700 0x7f42d819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42d6d9d640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42d8102670 0x7f42d8199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42d759e640 1 -- 172.21.15.148:0/361438204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42d8103700 msgr2=0x7f42d819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42d759e640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42d8103700 0x7f42d819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42d759e640 1 -- 172.21.15.148:0/361438204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42d8102670 msgr2=0x7f42d8199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42d759e640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42d8102670 0x7f42d8199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42d759e640 1 -- 172.21.15.148:0/361438204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d819b920 con 0x7f42d81040a0 2024-09-21T01:13:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42d759e640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d81040a0 0x7f42d819b190 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f42d0006010 tx=0x7f42d0031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42cffff640 1 -- 172.21.15.148:0/361438204 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0034040 con 0x7f42d81040a0 2024-09-21T01:13:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42dd245640 1 -- 172.21.15.148:0/361438204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d819bbb0 con 0x7f42d81040a0 2024-09-21T01:13:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42cffff640 1 -- 172.21.15.148:0/361438204 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42d0004040 con 0x7f42d81040a0 2024-09-21T01:13:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42cffff640 1 -- 172.21.15.148:0/361438204 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d00456e0 con 0x7f42d81040a0 2024-09-21T01:13:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.754+0000 7f42dd245640 1 -- 172.21.15.148:0/361438204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d81a21d0 con 0x7f42d81040a0 2024-09-21T01:13:30.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.755+0000 7f42dd245640 1 -- 172.21.15.148:0/361438204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d81a24c0 con 0x7f42d81040a0 2024-09-21T01:13:30.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.757+0000 7f42cffff640 1 -- 172.21.15.148:0/361438204 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f42d0037020 con 0x7f42d81040a0 2024-09-21T01:13:30.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.757+0000 7f42cffff640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f42c40b65a0 0x7f42c40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:30.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.758+0000 7f42d6d9d640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f42c40b65a0 0x7f42c40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:30.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.758+0000 7f42cffff640 1 -- 172.21.15.148:0/361438204 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f42d0108910 con 0x7f42d81040a0 2024-09-21T01:13:30.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.758+0000 7f42d6d9d640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f42c40b65a0 0x7f42c40b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f42c8005e10 tx=0x7f42c8005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:30.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.761+0000 7f42cffff640 1 -- 172.21.15.148:0/361438204 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42d0083710 con 0x7f42d81040a0 2024-09-21T01:13:30.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.958+0000 7f42dd245640 1 -- 172.21.15.148:0/361438204 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f42d81a2690 con 0x7f42c40b65a0 2024-09-21T01:13:30.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.959+0000 7f42cffff640 1 -- 172.21.15.148:0/361438204 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f42d81a2690 con 0x7f42c40b65a0 2024-09-21T01:13:30.960 INFO:teuthology.orchestra.run.smithi148.stdout:Backend: cephadm 2024-09-21T01:13:30.960 INFO:teuthology.orchestra.run.smithi148.stdout:Available: Yes 2024-09-21T01:13:30.960 INFO:teuthology.orchestra.run.smithi148.stdout:Paused: No 2024-09-21T01:13:30.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.961+0000 7f42dd245640 1 -- 172.21.15.148:0/361438204 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f42c40b65a0 msgr2=0x7f42c40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:30.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.961+0000 7f42dd245640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f42c40b65a0 0x7f42c40b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f42c8005e10 tx=0x7f42c8005da0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.961+0000 7f42dd245640 1 -- 172.21.15.148:0/361438204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d81040a0 msgr2=0x7f42d819b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:30.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.961+0000 7f42dd245640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d81040a0 0x7f42d819b190 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f42d0006010 tx=0x7f42d0031cb0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.962+0000 7f42dd245640 1 -- 172.21.15.148:0/361438204 shutdown_connections 2024-09-21T01:13:30.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.962+0000 7f42dd245640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f42c40b65a0 0x7f42c40b8ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.962+0000 7f42dd245640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d81040a0 0x7f42d819b190 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.962+0000 7f42dd245640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42d8103700 0x7f42d819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.962+0000 7f42dd245640 1 --2- 172.21.15.148:0/361438204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42d8102670 0x7f42d8199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.962+0000 7f42dd245640 1 -- 172.21.15.148:0/361438204 >> 172.21.15.148:0/361438204 conn(0x7f42d80fdfe0 msgr2=0x7f42d80ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:30.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.962+0000 7f42dd245640 1 -- 172.21.15.148:0/361438204 shutdown_connections 2024-09-21T01:13:30.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:30.962+0000 7f42dd245640 1 -- 172.21.15.148:0/361438204 wait complete. 2024-09-21T01:13:31.600 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T01:13:31.844 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:32.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.290+0000 7eff4646f640 1 -- 172.21.15.148:0/2431545986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff401036d0 msgr2=0x7eff40103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.290+0000 7eff4646f640 1 --2- 172.21.15.148:0/2431545986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff401036d0 0x7eff40103ae0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7eff34009900 tx=0x7eff3402a480 comp rx=0 tx=0).stop 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.290+0000 7eff4646f640 1 -- 172.21.15.148:0/2431545986 shutdown_connections 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.290+0000 7eff4646f640 1 --2- 172.21.15.148:0/2431545986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff401036d0 0x7eff40103ae0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.290+0000 7eff4646f640 1 --2- 172.21.15.148:0/2431545986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff40104070 0x7eff4010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.290+0000 7eff4646f640 1 --2- 172.21.15.148:0/2431545986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff40102640 0x7eff40102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.290+0000 7eff4646f640 1 -- 172.21.15.148:0/2431545986 >> 172.21.15.148:0/2431545986 conn(0x7eff400fdfb0 msgr2=0x7eff40100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.290+0000 7eff4646f640 1 -- 172.21.15.148:0/2431545986 shutdown_connections 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.290+0000 7eff4646f640 1 -- 172.21.15.148:0/2431545986 wait complete. 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.291+0000 7eff4646f640 1 Processor -- start 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.291+0000 7eff4646f640 1 -- start start 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff4646f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff40102640 0x7eff4019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff4646f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff401036d0 0x7eff4019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:32.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff4646f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff40104070 0x7eff4019b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff4646f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7eff4010e300 con 0x7eff401036d0 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff4646f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7eff4010e180 con 0x7eff40102640 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff4646f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff4010e480 con 0x7eff40104070 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff3f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff401036d0 0x7eff4019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff3f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff401036d0 0x7eff4019a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40994/0 (socket says 172.21.15.148:40994) 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff3f7fe640 1 -- 172.21.15.148:0/1968713767 learned_addr learned my addr 172.21.15.148:0/1968713767 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff44a0c640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff40104070 0x7eff4019b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff3ffff640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff40102640 0x7eff4019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff3f7fe640 1 -- 172.21.15.148:0/1968713767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff40104070 msgr2=0x7eff4019b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff3f7fe640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff40104070 0x7eff4019b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff3f7fe640 1 -- 172.21.15.148:0/1968713767 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff40102640 msgr2=0x7eff4019a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff3f7fe640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff40102640 0x7eff4019a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff3f7fe640 1 -- 172.21.15.148:0/1968713767 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4019ba80 con 0x7eff401036d0 2024-09-21T01:13:32.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.292+0000 7eff3f7fe640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff401036d0 0x7eff4019a6c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7eff34006010 tx=0x7eff340043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:32.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.293+0000 7eff3d7fa640 1 -- 172.21.15.148:0/1968713767 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3403f030 con 0x7eff401036d0 2024-09-21T01:13:32.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.293+0000 7eff3d7fa640 1 -- 172.21.15.148:0/1968713767 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff34003cb0 con 0x7eff401036d0 2024-09-21T01:13:32.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.293+0000 7eff4646f640 1 -- 172.21.15.148:0/1968713767 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4019bd10 con 0x7eff401036d0 2024-09-21T01:13:32.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.293+0000 7eff3d7fa640 1 -- 172.21.15.148:0/1968713767 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34035070 con 0x7eff401036d0 2024-09-21T01:13:32.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.293+0000 7eff4646f640 1 -- 172.21.15.148:0/1968713767 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff40104c30 con 0x7eff401036d0 2024-09-21T01:13:32.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.294+0000 7eff4646f640 1 -- 172.21.15.148:0/1968713767 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff40102ab0 con 0x7eff401036d0 2024-09-21T01:13:32.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.296+0000 7eff3d7fa640 1 -- 172.21.15.148:0/1968713767 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7eff34042030 con 0x7eff401036d0 2024-09-21T01:13:32.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.297+0000 7eff3d7fa640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7eff280b6620 0x7eff280b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:32.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.297+0000 7eff3ffff640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7eff280b6620 0x7eff280b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:32.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.297+0000 7eff3d7fa640 1 -- 172.21.15.148:0/1968713767 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7eff341081c0 con 0x7eff401036d0 2024-09-21T01:13:32.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.297+0000 7eff3ffff640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7eff280b6620 0x7eff280b8b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7eff3000de30 tx=0x7eff3000f040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:32.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.300+0000 7eff3d7fa640 1 -- 172.21.15.148:0/1968713767 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff340ce900 con 0x7eff401036d0 2024-09-21T01:13:32.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.501+0000 7eff4646f640 1 -- 172.21.15.148:0/1968713767 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7eff400fffc0 con 0x7eff280b6620 2024-09-21T01:13:32.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.513+0000 7eff3d7fa640 1 -- 172.21.15.148:0/1968713767 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7eff400fffc0 con 0x7eff280b6620 2024-09-21T01:13:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:13:32.514 INFO:teuthology.orchestra.run.smithi148.stdout:mds.a smithi148 running (93s) 16s ago 93s 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 9e47f141c712 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.b smithi157 running (91s) 23s ago 90s 94.0M - 19.3.0-5120-g18432218 ddce307e1f32 bacbd2badd57 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.c smithi181 running (104s) 23s ago 103s 86.3M - 19.3.0-5120-g18432218 ddce307e1f32 daa2361f1b80 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.d smithi148 running (111s) 16s ago 111s 82.0M - 19.3.0-5120-g18432218 ddce307e1f32 da72c55fed30 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.e smithi157 running (109s) 23s ago 108s 84.3M - 19.3.0-5120-g18432218 ddce307e1f32 2e6363a72bc6 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.f smithi181 running (106s) 23s ago 106s 87.7M - 19.3.0-5120-g18432218 ddce307e1f32 2dc2a45cc738 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.g smithi148 running (96s) 16s ago 95s 84.3M - 19.3.0-5120-g18432218 ddce307e1f32 5aa5722d4555 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.h smithi157 running (101s) 23s ago 101s 85.6M - 19.3.0-5120-g18432218 ddce307e1f32 633b15a168d2 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.i smithi181 running (99s) 23s ago 98s 85.7M - 19.3.0-5120-g18432218 ddce307e1f32 18d5f9f638a2 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.j smithi148 running (114s) 16s ago 114s 84.4M - 19.3.0-5120-g18432218 ddce307e1f32 57470ec5d478 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.k smithi157 running (117s) 23s ago 117s 81.7M - 19.3.0-5120-g18432218 ddce307e1f32 78d7bf103632 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mds.l smithi181 running (2m) 23s ago 119s 81.6M - 19.3.0-5120-g18432218 ddce307e1f32 cdaf53a052f0 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.x smithi148 *:9283,8765 running (9m) 16s ago 9m 590M - 19.3.0-5120-g18432218 ddce307e1f32 64a898c42ae5 2024-09-21T01:13:32.515 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.y smithi157 *:8443,8765 running (7m) 23s ago 7m 526M - 19.3.0-5120-g18432218 ddce307e1f32 6f70a2281cf5 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.z smithi181 *:8443,8765 running (7m) 23s ago 7m 524M - 19.3.0-5120-g18432218 ddce307e1f32 afd1a6783ed9 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:mon.a smithi148 running (9m) 16s ago 9m 120M 2048M 19.3.0-5120-g18432218 ddce307e1f32 b56d7e839ccb 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:mon.b smithi157 running (7m) 23s ago 7m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 536e2bd2bddf 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:mon.c smithi181 running (8m) 23s ago 8m 108M 2048M 19.3.0-5120-g18432218 ddce307e1f32 b2348bede97b 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (6m) 16s ago 6m 117M 4272M 19.3.0-5120-g18432218 ddce307e1f32 621bd46d84ba 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi157 running (6m) 23s ago 6m 115M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0287cc72429a 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi181 running (6m) 23s ago 6m 125M 4272M 19.3.0-5120-g18432218 ddce307e1f32 03a0da39bc16 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi148 running (5m) 16s ago 5m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 eff5c66ef626 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (5m) 23s ago 5m 118M 4272M 19.3.0-5120-g18432218 ddce307e1f32 3ce4c327bd6c 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi181 running (4m) 23s ago 4m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 8d0c77c91597 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.6 smithi148 running (4m) 16s ago 4m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 01b17111167b 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.7 smithi157 running (3m) 23s ago 3m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ec5773995332 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.8 smithi181 running (3m) 23s ago 3m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 4ea80c4211b4 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.9 smithi148 running (3m) 16s ago 3m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ace83319757f 2024-09-21T01:13:32.516 INFO:teuthology.orchestra.run.smithi148.stdout:osd.10 smithi157 running (2m) 23s ago 2m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 d287c9caf1fd 2024-09-21T01:13:32.517 INFO:teuthology.orchestra.run.smithi148.stdout:osd.11 smithi181 running (2m) 23s ago 2m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 4246881716a6 2024-09-21T01:13:32.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 -- 172.21.15.148:0/1968713767 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7eff280b6620 msgr2=0x7eff280b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:32.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7eff280b6620 0x7eff280b8b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7eff3000de30 tx=0x7eff3000f040 comp rx=0 tx=0).stop 2024-09-21T01:13:32.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 -- 172.21.15.148:0/1968713767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff401036d0 msgr2=0x7eff4019a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:32.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff401036d0 0x7eff4019a6c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7eff34006010 tx=0x7eff340043b0 comp rx=0 tx=0).stop 2024-09-21T01:13:32.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 -- 172.21.15.148:0/1968713767 shutdown_connections 2024-09-21T01:13:32.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7eff280b6620 0x7eff280b8b30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:32.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff401036d0 0x7eff4019a6c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:32.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff40104070 0x7eff4019b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:32.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 --2- 172.21.15.148:0/1968713767 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff40102640 0x7eff4019a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:32.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 -- 172.21.15.148:0/1968713767 >> 172.21.15.148:0/1968713767 conn(0x7eff400fdfb0 msgr2=0x7eff400ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:32.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 -- 172.21.15.148:0/1968713767 shutdown_connections 2024-09-21T01:13:32.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:32.516+0000 7eff4646f640 1 -- 172.21.15.148:0/1968713767 wait complete. 2024-09-21T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:32 smithi148 ceph-mon[31000]: pgmap v324: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:32 smithi148 ceph-mon[31000]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:32.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:32 smithi181 ceph-mon[34811]: pgmap v324: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T01:13:32.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:32 smithi181 ceph-mon[34811]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:32.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:32 smithi157 ceph-mon[34140]: pgmap v324: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T01:13:32.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:32 smithi157 ceph-mon[34140]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:33.124 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T01:13:33.371 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:33.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.880+0000 7f9fcc064640 1 -- 172.21.15.148:0/3838549451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fc4104070 msgr2=0x7f9fc410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:33.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.880+0000 7f9fcc064640 1 --2- 172.21.15.148:0/3838549451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fc4104070 0x7f9fc410aa10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009900 tx=0x7f9fb402a480 comp rx=0 tx=0).stop 2024-09-21T01:13:33.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.880+0000 7f9fcc064640 1 -- 172.21.15.148:0/3838549451 shutdown_connections 2024-09-21T01:13:33.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.880+0000 7f9fcc064640 1 --2- 172.21.15.148:0/3838549451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fc4104070 0x7f9fc410aa10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:33.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.880+0000 7f9fcc064640 1 --2- 172.21.15.148:0/3838549451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc41036d0 0x7f9fc4103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:33.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.880+0000 7f9fcc064640 1 --2- 172.21.15.148:0/3838549451 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fc4102640 0x7f9fc4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:33.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.880+0000 7f9fcc064640 1 -- 172.21.15.148:0/3838549451 >> 172.21.15.148:0/3838549451 conn(0x7f9fc40fdfb0 msgr2=0x7f9fc4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.881+0000 7f9fcc064640 1 -- 172.21.15.148:0/3838549451 shutdown_connections 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.881+0000 7f9fcc064640 1 -- 172.21.15.148:0/3838549451 wait complete. 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.881+0000 7f9fcc064640 1 Processor -- start 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.881+0000 7f9fcc064640 1 -- start start 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fcc064640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fc4102640 0x7f9fc4198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fcc064640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc41036d0 0x7f9fc4199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fcc064640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fc4104070 0x7f9fc419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fcc064640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc410e290 con 0x7f9fc4102640 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fcc064640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc410e110 con 0x7f9fc41036d0 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fcc064640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc410e410 con 0x7f9fc4104070 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc9e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fc4102640 0x7f9fc4198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc9e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fc4102640 0x7f9fc4198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41006/0 (socket says 172.21.15.148:41006) 2024-09-21T01:13:33.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc9e00640 1 -- 172.21.15.148:0/2899839685 learned_addr learned my addr 172.21.15.148:0/2899839685 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fca601640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fc4104070 0x7f9fc419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc95ff640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc41036d0 0x7f9fc4199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc9e00640 1 -- 172.21.15.148:0/2899839685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fc4104070 msgr2=0x7f9fc419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc9e00640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fc4104070 0x7f9fc419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc9e00640 1 -- 172.21.15.148:0/2899839685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc41036d0 msgr2=0x7f9fc4199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc9e00640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc41036d0 0x7f9fc4199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc9e00640 1 -- 172.21.15.148:0/2899839685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc419a8c0 con 0x7f9fc4102640 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc95ff640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc41036d0 0x7f9fc4199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc9e00640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fc4102640 0x7f9fc4198e90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00eb90 tx=0x7f9fbc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc2ffd640 1 -- 172.21.15.148:0/2899839685 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc004d20 con 0x7f9fc4102640 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc2ffd640 1 -- 172.21.15.148:0/2899839685 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fbc00ee90 con 0x7f9fc4102640 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fc2ffd640 1 -- 172.21.15.148:0/2899839685 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc010670 con 0x7f9fc4102640 2024-09-21T01:13:33.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.882+0000 7f9fcc064640 1 -- 172.21.15.148:0/2899839685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc419abb0 con 0x7f9fc4102640 2024-09-21T01:13:33.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.883+0000 7f9fcc064640 1 -- 172.21.15.148:0/2899839685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc41a12b0 con 0x7f9fc4102640 2024-09-21T01:13:33.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.884+0000 7f9fcc064640 1 -- 172.21.15.148:0/2899839685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc4109820 con 0x7f9fc4102640 2024-09-21T01:13:33.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.885+0000 7f9fc2ffd640 1 -- 172.21.15.148:0/2899839685 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f9fbc005020 con 0x7f9fc4102640 2024-09-21T01:13:33.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.886+0000 7f9fc2ffd640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fac0b65a0 0x7f9fac0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:33.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.886+0000 7f9fc95ff640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fac0b65a0 0x7f9fac0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:33.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.886+0000 7f9fc2ffd640 1 -- 172.21.15.148:0/2899839685 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f9fbc0e7b70 con 0x7f9fc4102640 2024-09-21T01:13:33.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.886+0000 7f9fc95ff640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fac0b65a0 0x7f9fac0b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009c20 tx=0x7f9fb8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:33.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:33.890+0000 7f9fc2ffd640 1 -- 172.21.15.148:0/2899839685 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9fbc0ae2b0 con 0x7f9fc4102640 2024-09-21T01:13:34.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.079+0000 7f9fcc064640 1 -- 172.21.15.148:0/2899839685 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f9fc4063800 con 0x7f9fac0b65a0 2024-09-21T01:13:34.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.086+0000 7f9fc2ffd640 1 -- 172.21.15.148:0/2899839685 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f9fc4063800 con 0x7f9fac0b65a0 2024-09-21T01:13:34.087 INFO:teuthology.orchestra.run.smithi148.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T01:13:34.087 INFO:teuthology.orchestra.run.smithi148.stdout:mds.all 12/12 25s ago 2m smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T01:13:34.087 INFO:teuthology.orchestra.run.smithi148.stdout:mgr 3/3 25s ago 7m smithi148=x;smithi157=y;smithi181=z;count:3 2024-09-21T01:13:34.087 INFO:teuthology.orchestra.run.smithi148.stdout:mon 3/3 25s ago 8m smithi148:172.21.15.148=a;smithi157:172.21.15.157=b;smithi181:172.21.15.181=c;count:3 2024-09-21T01:13:34.087 INFO:teuthology.orchestra.run.smithi148.stdout:osd 12 25s ago - 2024-09-21T01:13:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 -- 172.21.15.148:0/2899839685 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fac0b65a0 msgr2=0x7f9fac0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fac0b65a0 0x7f9fac0b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009c20 tx=0x7f9fb8005f90 comp rx=0 tx=0).stop 2024-09-21T01:13:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 -- 172.21.15.148:0/2899839685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fc4102640 msgr2=0x7f9fc4198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fc4102640 0x7f9fc4198e90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00eb90 tx=0x7f9fbc00c6a0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 -- 172.21.15.148:0/2899839685 shutdown_connections 2024-09-21T01:13:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9fac0b65a0 0x7f9fac0b8ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fc4104070 0x7f9fc419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9fc41036d0 0x7f9fc4199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 --2- 172.21.15.148:0/2899839685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fc4102640 0x7f9fc4198e90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 -- 172.21.15.148:0/2899839685 >> 172.21.15.148:0/2899839685 conn(0x7f9fc40fdfb0 msgr2=0x7f9fc41069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:34.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 -- 172.21.15.148:0/2899839685 shutdown_connections 2024-09-21T01:13:34.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:34.089+0000 7f9fcc064640 1 -- 172.21.15.148:0/2899839685 wait complete. 2024-09-21T01:13:34.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:34 smithi148 ceph-mon[31000]: pgmap v325: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T01:13:34.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:34 smithi148 ceph-mon[31000]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:34.707 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T01:13:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:34 smithi181 ceph-mon[34811]: pgmap v325: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T01:13:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:34 smithi181 ceph-mon[34811]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:34.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:34 smithi157 ceph-mon[34140]: pgmap v325: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T01:13:34.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:34 smithi157 ceph-mon[34140]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:34.952 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:35.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:35 smithi148 ceph-mon[31000]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:35.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.401+0000 7f0f79c05640 1 -- 172.21.15.148:0/3982000536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f741037f0 msgr2=0x7f0f7410a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:35.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.401+0000 7f0f79c05640 1 --2- 172.21.15.148:0/3982000536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f741037f0 0x7f0f7410a190 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009ca0 tx=0x7f0f6c02a950 comp rx=0 tx=0).stop 2024-09-21T01:13:35.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.401+0000 7f0f79c05640 1 -- 172.21.15.148:0/3982000536 shutdown_connections 2024-09-21T01:13:35.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.401+0000 7f0f79c05640 1 --2- 172.21.15.148:0/3982000536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f741037f0 0x7f0f7410a190 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.401+0000 7f0f79c05640 1 --2- 172.21.15.148:0/3982000536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f74102e50 0x7f0f74103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.401+0000 7f0f79c05640 1 --2- 172.21.15.148:0/3982000536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f74101dc0 0x7f0f74102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.401+0000 7f0f79c05640 1 -- 172.21.15.148:0/3982000536 >> 172.21.15.148:0/3982000536 conn(0x7f0f740fd770 msgr2=0x7f0f740ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.401+0000 7f0f79c05640 1 -- 172.21.15.148:0/3982000536 shutdown_connections 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.401+0000 7f0f79c05640 1 -- 172.21.15.148:0/3982000536 wait complete. 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.402+0000 7f0f79c05640 1 Processor -- start 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.402+0000 7f0f79c05640 1 -- start start 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f79c05640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f74101dc0 0x7f0f74198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f79c05640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f74102e50 0x7f0f741994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f79c05640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f741037f0 0x7f0f7419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f79c05640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7410da00 con 0x7f0f741037f0 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f79c05640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7410d880 con 0x7f0f74102e50 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f79c05640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7410db80 con 0x7f0f74101dc0 2024-09-21T01:13:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f73fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f741037f0 0x7f0f7419a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f73fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f741037f0 0x7f0f7419a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41022/0 (socket says 172.21.15.148:41022) 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f73fff640 1 -- 172.21.15.148:0/4070318715 learned_addr learned my addr 172.21.15.148:0/4070318715 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f72ffd640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f74102e50 0x7f0f741994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f737fe640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f74101dc0 0x7f0f74198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f73fff640 1 -- 172.21.15.148:0/4070318715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f74101dc0 msgr2=0x7f0f74198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f73fff640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f74101dc0 0x7f0f74198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f73fff640 1 -- 172.21.15.148:0/4070318715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f74102e50 msgr2=0x7f0f741994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f73fff640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f74102e50 0x7f0f741994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f73fff640 1 -- 172.21.15.148:0/4070318715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7419a860 con 0x7f0f741037f0 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f73fff640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f741037f0 0x7f0f7419a040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c006010 tx=0x7f0f6c02fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f70ff9640 1 -- 172.21.15.148:0/4070318715 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c034040 con 0x7f0f741037f0 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f79c05640 1 -- 172.21.15.148:0/4070318715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7419aaf0 con 0x7f0f741037f0 2024-09-21T01:13:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f70ff9640 1 -- 172.21.15.148:0/4070318715 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f6c0308f0 con 0x7f0f741037f0 2024-09-21T01:13:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f70ff9640 1 -- 172.21.15.148:0/4070318715 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c039450 con 0x7f0f741037f0 2024-09-21T01:13:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.403+0000 7f0f79c05640 1 -- 172.21.15.148:0/4070318715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f741a1080 con 0x7f0f741037f0 2024-09-21T01:13:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.405+0000 7f0f79c05640 1 -- 172.21.15.148:0/4070318715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f74109960 con 0x7f0f741037f0 2024-09-21T01:13:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.406+0000 7f0f70ff9640 1 -- 172.21.15.148:0/4070318715 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f0f6c037020 con 0x7f0f741037f0 2024-09-21T01:13:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.406+0000 7f0f70ff9640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0f5c0b65a0 0x7f0f5c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.407+0000 7f0f737fe640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0f5c0b65a0 0x7f0f5c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.407+0000 7f0f70ff9640 1 -- 172.21.15.148:0/4070318715 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f0f6c108500 con 0x7f0f741037f0 2024-09-21T01:13:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.407+0000 7f0f737fe640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0f5c0b65a0 0x7f0f5c0b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0f64005fd0 tx=0x7f0f64005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.411+0000 7f0f70ff9640 1 -- 172.21.15.148:0/4070318715 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f6c0cec40 con 0x7f0f741037f0 2024-09-21T01:13:35.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.594+0000 7f0f79c05640 1 -- 172.21.15.148:0/4070318715 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f0f74063800 con 0x7f0f5c0b65a0 2024-09-21T01:13:35.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.596+0000 7f0f70ff9640 1 -- 172.21.15.148:0/4070318715 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f0f74063800 con 0x7f0f5c0b65a0 2024-09-21T01:13:35.596 INFO:teuthology.orchestra.run.smithi148.stdout:HOST ADDR LABELS STATUS 2024-09-21T01:13:35.597 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148 172.21.15.148 2024-09-21T01:13:35.597 INFO:teuthology.orchestra.run.smithi148.stdout:smithi157 172.21.15.157 2024-09-21T01:13:35.597 INFO:teuthology.orchestra.run.smithi148.stdout:smithi181 172.21.15.181 2024-09-21T01:13:35.597 INFO:teuthology.orchestra.run.smithi148.stdout:3 hosts in cluster 2024-09-21T01:13:35.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 -- 172.21.15.148:0/4070318715 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0f5c0b65a0 msgr2=0x7f0f5c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:35.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0f5c0b65a0 0x7f0f5c0b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0f64005fd0 tx=0x7f0f64005e20 comp rx=0 tx=0).stop 2024-09-21T01:13:35.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 -- 172.21.15.148:0/4070318715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f741037f0 msgr2=0x7f0f7419a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:35.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f741037f0 0x7f0f7419a040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c006010 tx=0x7f0f6c02fc00 comp rx=0 tx=0).stop 2024-09-21T01:13:35.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 -- 172.21.15.148:0/4070318715 shutdown_connections 2024-09-21T01:13:35.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0f5c0b65a0 0x7f0f5c0b8ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f741037f0 0x7f0f7419a040 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f74102e50 0x7f0f741994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 --2- 172.21.15.148:0/4070318715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0f74101dc0 0x7f0f74198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 -- 172.21.15.148:0/4070318715 >> 172.21.15.148:0/4070318715 conn(0x7f0f740fd770 msgr2=0x7f0f74106b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:35.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 -- 172.21.15.148:0/4070318715 shutdown_connections 2024-09-21T01:13:35.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:35.598+0000 7f0f79c05640 1 -- 172.21.15.148:0/4070318715 wait complete. 2024-09-21T01:13:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:35 smithi181 ceph-mon[34811]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:35.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:35 smithi157 ceph-mon[34140]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:36.198 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T01:13:36.364 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:36 smithi148 ceph-mon[31000]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T01:13:36.457 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:36.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:36 smithi181 ceph-mon[34811]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T01:13:36.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:36 smithi157 ceph-mon[34140]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T01:13:36.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.939+0000 7f31fafb4640 1 -- 172.21.15.148:0/2010258465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31f41047e0 msgr2=0x7f31f4104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:36.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.939+0000 7f31fafb4640 1 --2- 172.21.15.148:0/2010258465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31f41047e0 0x7f31f4104bf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009900 tx=0x7f31e402a480 comp rx=0 tx=0).stop 2024-09-21T01:13:36.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.939+0000 7f31fafb4640 1 -- 172.21.15.148:0/2010258465 shutdown_connections 2024-09-21T01:13:36.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.939+0000 7f31fafb4640 1 --2- 172.21.15.148:0/2010258465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31f41047e0 0x7f31f4104bf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:36.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.939+0000 7f31fafb4640 1 --2- 172.21.15.148:0/2010258465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31f4105180 0x7f31f410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:36.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.939+0000 7f31fafb4640 1 --2- 172.21.15.148:0/2010258465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31f4103750 0x7f31f4103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:36.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.939+0000 7f31fafb4640 1 -- 172.21.15.148:0/2010258465 >> 172.21.15.148:0/2010258465 conn(0x7f31f40ff0c0 msgr2=0x7f31f4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.939+0000 7f31fafb4640 1 -- 172.21.15.148:0/2010258465 shutdown_connections 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.939+0000 7f31fafb4640 1 -- 172.21.15.148:0/2010258465 wait complete. 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31fafb4640 1 Processor -- start 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31fafb4640 1 -- start start 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31fafb4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31f4103750 0x7f31f4199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31fafb4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31f41047e0 0x7f31f419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31fafb4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31f4105180 0x7f31f419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31fafb4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f31f410f380 con 0x7f31f4103750 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31fafb4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f31f410f200 con 0x7f31f41047e0 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31fafb4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f31f410f500 con 0x7f31f4105180 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31f8d50640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31f4103750 0x7f31f4199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:36.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31f8d50640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31f4103750 0x7f31f4199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59964/0 (socket says 172.21.15.148:59964) 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31f8d50640 1 -- 172.21.15.148:0/3501272979 learned_addr learned my addr 172.21.15.148:0/3501272979 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31ebfff640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31f41047e0 0x7f31f419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31f9551640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31f4105180 0x7f31f419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31f8d50640 1 -- 172.21.15.148:0/3501272979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31f4105180 msgr2=0x7f31f419b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31f8d50640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31f4105180 0x7f31f419b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31f8d50640 1 -- 172.21.15.148:0/3501272979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31f41047e0 msgr2=0x7f31f419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31f8d50640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31f41047e0 0x7f31f419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31f8d50640 1 -- 172.21.15.148:0/3501272979 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f419ba00 con 0x7f31f4103750 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.940+0000 7f31f9551640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31f4105180 0x7f31f419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.941+0000 7f31f8d50640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31f4103750 0x7f31f4199fd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f31f000d950 tx=0x7f31f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.941+0000 7f31e9ffb640 1 -- 172.21.15.148:0/3501272979 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0017070 con 0x7f31f4103750 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.941+0000 7f31fafb4640 1 -- 172.21.15.148:0/3501272979 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f419bcf0 con 0x7f31f4103750 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.941+0000 7f31e9ffb640 1 -- 172.21.15.148:0/3501272979 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31f0009c30 con 0x7f31f4103750 2024-09-21T01:13:36.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.941+0000 7f31e9ffb640 1 -- 172.21.15.148:0/3501272979 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f000f620 con 0x7f31f4103750 2024-09-21T01:13:36.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.941+0000 7f31fafb4640 1 -- 172.21.15.148:0/3501272979 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f41a23f0 con 0x7f31f4103750 2024-09-21T01:13:36.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.942+0000 7f31fafb4640 1 -- 172.21.15.148:0/3501272979 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f410a910 con 0x7f31f4103750 2024-09-21T01:13:36.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.944+0000 7f31e9ffb640 1 -- 172.21.15.148:0/3501272979 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f31f0010460 con 0x7f31f4103750 2024-09-21T01:13:36.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.944+0000 7f31e9ffb640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f31dc0b65a0 0x7f31dc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:36.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.945+0000 7f31ebfff640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f31dc0b65a0 0x7f31dc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:36.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.945+0000 7f31e9ffb640 1 -- 172.21.15.148:0/3501272979 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f31f00e70f0 con 0x7f31f4103750 2024-09-21T01:13:36.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.945+0000 7f31ebfff640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f31dc0b65a0 0x7f31dc0b8ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f31e4000c00 tx=0x7f31e4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:36.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:36.948+0000 7f31e9ffb640 1 -- 172.21.15.148:0/3501272979 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31f00ad830 con 0x7f31f4103750 2024-09-21T01:13:37.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.136+0000 7f31fafb4640 1 -- 172.21.15.148:0/3501272979 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f31f4063800 con 0x7f31dc0b65a0 2024-09-21T01:13:37.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.138+0000 7f31e9ffb640 1 -- 172.21.15.148:0/3501272979 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f31f4063800 con 0x7f31dc0b65a0 2024-09-21T01:13:37.139 INFO:teuthology.orchestra.run.smithi148.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T01:13:37.139 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005G400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T01:13:37.139 INFO:teuthology.orchestra.run.smithi148.stdout:smithi157 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002V480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-21T01:13:37.139 INFO:teuthology.orchestra.run.smithi148.stdout:smithi181 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6246000E400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T01:13:37.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 -- 172.21.15.148:0/3501272979 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f31dc0b65a0 msgr2=0x7f31dc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:37.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f31dc0b65a0 0x7f31dc0b8ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f31e4000c00 tx=0x7f31e4031400 comp rx=0 tx=0).stop 2024-09-21T01:13:37.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 -- 172.21.15.148:0/3501272979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31f4103750 msgr2=0x7f31f4199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:37.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31f4103750 0x7f31f4199fd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f31f000d950 tx=0x7f31f000de10 comp rx=0 tx=0).stop 2024-09-21T01:13:37.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 -- 172.21.15.148:0/3501272979 shutdown_connections 2024-09-21T01:13:37.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f31dc0b65a0 0x7f31dc0b8ab0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:37.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31f4105180 0x7f31f419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:37.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31f41047e0 0x7f31f419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:37.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 --2- 172.21.15.148:0/3501272979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31f4103750 0x7f31f4199fd0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:37.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 -- 172.21.15.148:0/3501272979 >> 172.21.15.148:0/3501272979 conn(0x7f31f40ff0c0 msgr2=0x7f31f4107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:37.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 -- 172.21.15.148:0/3501272979 shutdown_connections 2024-09-21T01:13:37.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:37.140+0000 7f31fafb4640 1 -- 172.21.15.148:0/3501272979 wait complete. 2024-09-21T01:13:37.485 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:37 smithi148 ceph-mon[31000]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:37 smithi181 ceph-mon[34811]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:37.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:37 smithi157 ceph-mon[34140]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:37.798 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T01:13:37.806 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T01:13:37.806 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T01:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:38.448 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:38 smithi148 ceph-mon[31000]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T01:13:38.448 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:38 smithi148 ceph-mon[31000]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:38.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 -- 172.21.15.148:0/3416496238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c102660 msgr2=0x7faa5c102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:38.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 --2- 172.21.15.148:0/3416496238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c102660 0x7faa5c102ad0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009900 tx=0x7faa4c02a480 comp rx=0 tx=0).stop 2024-09-21T01:13:38.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 -- 172.21.15.148:0/3416496238 shutdown_connections 2024-09-21T01:13:38.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 --2- 172.21.15.148:0/3416496238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa5c104090 0x7faa5c10aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 --2- 172.21.15.148:0/3416496238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa5c1036f0 0x7faa5c103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 --2- 172.21.15.148:0/3416496238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c102660 0x7faa5c102ad0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 -- 172.21.15.148:0/3416496238 >> 172.21.15.148:0/3416496238 conn(0x7faa5c0fdfd0 msgr2=0x7faa5c100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:38.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 -- 172.21.15.148:0/3416496238 shutdown_connections 2024-09-21T01:13:38.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 -- 172.21.15.148:0/3416496238 wait complete. 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 Processor -- start 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.537+0000 7faa623c8640 1 -- start start 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa623c8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c102660 0x7faa5c198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa623c8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa5c1036f0 0x7faa5c199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa623c8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa5c104090 0x7faa5c19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa623c8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10e2a0 con 0x7faa5c102660 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa623c8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10e120 con 0x7faa5c1036f0 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa623c8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10e420 con 0x7faa5c104090 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c102660 0x7faa5c198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c102660 0x7faa5c198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59988/0 (socket says 172.21.15.148:59988) 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5bfff640 1 -- 172.21.15.148:0/817010980 learned_addr learned my addr 172.21.15.148:0/817010980 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa60965640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa5c104090 0x7faa5c19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5b7fe640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa5c1036f0 0x7faa5c199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:38.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5bfff640 1 -- 172.21.15.148:0/817010980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa5c104090 msgr2=0x7faa5c19a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5bfff640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa5c104090 0x7faa5c19a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5bfff640 1 -- 172.21.15.148:0/817010980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa5c1036f0 msgr2=0x7faa5c199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5bfff640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa5c1036f0 0x7faa5c199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5bfff640 1 -- 172.21.15.148:0/817010980 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5c19a930 con 0x7faa5c102660 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5b7fe640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa5c1036f0 0x7faa5c199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa60965640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa5c104090 0x7faa5c19a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.538+0000 7faa5bfff640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c102660 0x7faa5c198f00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faa4c006010 tx=0x7faa4c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.539+0000 7faa597fa640 1 -- 172.21.15.148:0/817010980 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c03f030 con 0x7faa5c102660 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.539+0000 7faa623c8640 1 -- 172.21.15.148:0/817010980 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5c19abc0 con 0x7faa5c102660 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.539+0000 7faa597fa640 1 -- 172.21.15.148:0/817010980 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa4c003cb0 con 0x7faa5c102660 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.539+0000 7faa597fa640 1 -- 172.21.15.148:0/817010980 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c035070 con 0x7faa5c102660 2024-09-21T01:13:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.539+0000 7faa623c8640 1 -- 172.21.15.148:0/817010980 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa5c1a1150 con 0x7faa5c102660 2024-09-21T01:13:38.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.540+0000 7faa623c8640 1 -- 172.21.15.148:0/817010980 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa5c109840 con 0x7faa5c102660 2024-09-21T01:13:38.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.541+0000 7faa597fa640 1 -- 172.21.15.148:0/817010980 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7faa4c042030 con 0x7faa5c102660 2024-09-21T01:13:38.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.542+0000 7faa597fa640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faa440b65a0 0x7faa440b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:38.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.542+0000 7faa5b7fe640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faa440b65a0 0x7faa440b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:38.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.542+0000 7faa597fa640 1 -- 172.21.15.148:0/817010980 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7faa4c107e50 con 0x7faa5c102660 2024-09-21T01:13:38.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.543+0000 7faa5b7fe640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faa440b65a0 0x7faa440b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa50005d00 tx=0x7faa50005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:38.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.545+0000 7faa597fa640 1 -- 172.21.15.148:0/817010980 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa4c0ce590 con 0x7faa5c102660 2024-09-21T01:13:38.631 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:38 smithi181 ceph-mon[34811]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T01:13:38.631 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:38 smithi181 ceph-mon[34811]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:38.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:38 smithi157 ceph-mon[34140]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T01:13:38.641 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:38 smithi157 ceph-mon[34140]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:38.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.759+0000 7faa623c8640 1 -- 172.21.15.148:0/817010980 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7faa5c02e640 con 0x7faa5c102660 2024-09-21T01:13:38.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.760+0000 7faa597fa640 1 -- 172.21.15.148:0/817010980 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3096 (secure 0 0 0) 0x7faa4c0d2970 con 0x7faa5c102660 2024-09-21T01:13:38.761 INFO:teuthology.orchestra.run.smithi148.stdout:e23 2024-09-21T01:13:38.761 INFO:teuthology.orchestra.run.smithi148.stdout:btime 2024-09-21T01:12:23:525439+0000 2024-09-21T01:13:38.761 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:13:38.761 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:13:38.761 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-09-21T01:13:38.761 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:38.761 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 23 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-09-21T01:12:11.894283+0000 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-09-21T01:12:22.780555+0000 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 300 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-09-21T01:13:38.762 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 0 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 3 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:in 0,1,2 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=24665,1=24646,2=24631} 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data disabled 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-09-21T01:13:38.763 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 0 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:qdb_cluster leader: 24665 members: 24665,24646,24631 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b{0:24665} state up:active seq 4 addr [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.h{0:24626} state up:standby-replay seq 1 addr [v2:172.21.15.157:6836/3732138486,v1:172.21.15.157:6837/3732138486] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.i{1:24646} state up:active seq 8 addr [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.f{1:24619} state up:standby-replay seq 1 addr [v2:172.21.15.181:6834/685827281,v1:172.21.15.181:6835/685827281] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c{2:24631} state up:active seq 9 addr [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.e{2:24599} state up:standby-replay seq 1 addr [v2:172.21.15.157:6834/2996859376,v1:172.21.15.157:6835/2996859376] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.j{-1:14715} state up:standby seq 1 addr [v2:172.21.15.148:6834/4022731495,v1:172.21.15.148:6835/4022731495] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.764 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d{-1:14727} state up:standby seq 1 addr [v2:172.21.15.148:6836/540984210,v1:172.21.15.148:6837/540984210] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.765 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.g{-1:14778} state up:standby seq 1 addr [v2:172.21.15.148:6838/1439710769,v1:172.21.15.148:6839/1439710769] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.765 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a{-1:14784} state up:standby seq 1 addr [v2:172.21.15.148:6840/3203788018,v1:172.21.15.148:6841/3203788018] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.765 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.k{-1:24575} state up:standby seq 1 addr [v2:172.21.15.157:6832/1970203304,v1:172.21.15.157:6833/1970203304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.765 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.l{-1:24583} state up:standby seq 1 addr [v2:172.21.15.181:6832/791050985,v1:172.21.15.181:6833/791050985] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:13:38.765 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 23 2024-09-21T01:13:38.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 -- 172.21.15.148:0/817010980 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faa440b65a0 msgr2=0x7faa440b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:38.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faa440b65a0 0x7faa440b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa50005d00 tx=0x7faa50005ed0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 -- 172.21.15.148:0/817010980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c102660 msgr2=0x7faa5c198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:38.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c102660 0x7faa5c198f00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faa4c006010 tx=0x7faa4c004340 comp rx=0 tx=0).stop 2024-09-21T01:13:38.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 -- 172.21.15.148:0/817010980 shutdown_connections 2024-09-21T01:13:38.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7faa440b65a0 0x7faa440b8ab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa5c104090 0x7faa5c19a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa5c1036f0 0x7faa5c199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 --2- 172.21.15.148:0/817010980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa5c102660 0x7faa5c198f00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 -- 172.21.15.148:0/817010980 >> 172.21.15.148:0/817010980 conn(0x7faa5c0fdfd0 msgr2=0x7faa5c106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:38.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 -- 172.21.15.148:0/817010980 shutdown_connections 2024-09-21T01:13:38.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:38.763+0000 7faa623c8640 1 -- 172.21.15.148:0/817010980 wait complete. 2024-09-21T01:13:39.410 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:39 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/817010980' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:13:39.441 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T01:13:39.690 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:39.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:39 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/817010980' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:13:39.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:39 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/817010980' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:13:40.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.161+0000 7f1f221f3640 1 -- 172.21.15.148:0/2755044529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c104070 msgr2=0x7f1f1c10aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:40.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.161+0000 7f1f221f3640 1 --2- 172.21.15.148:0/2755044529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c104070 0x7f1f1c10aa10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009ca0 tx=0x7f1f1402a950 comp rx=0 tx=0).stop 2024-09-21T01:13:40.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.161+0000 7f1f221f3640 1 -- 172.21.15.148:0/2755044529 shutdown_connections 2024-09-21T01:13:40.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.161+0000 7f1f221f3640 1 --2- 172.21.15.148:0/2755044529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c104070 0x7f1f1c10aa10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.161+0000 7f1f221f3640 1 --2- 172.21.15.148:0/2755044529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f1c1036d0 0x7f1f1c103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.161+0000 7f1f221f3640 1 --2- 172.21.15.148:0/2755044529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f1c102640 0x7f1f1c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.161+0000 7f1f221f3640 1 -- 172.21.15.148:0/2755044529 >> 172.21.15.148:0/2755044529 conn(0x7f1f1c0fdfb0 msgr2=0x7f1f1c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.161+0000 7f1f221f3640 1 -- 172.21.15.148:0/2755044529 shutdown_connections 2024-09-21T01:13:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.161+0000 7f1f221f3640 1 -- 172.21.15.148:0/2755044529 wait complete. 2024-09-21T01:13:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.162+0000 7f1f221f3640 1 Processor -- start 2024-09-21T01:13:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.162+0000 7f1f221f3640 1 -- start start 2024-09-21T01:13:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.162+0000 7f1f221f3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f1c102640 0x7f1f1c06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.162+0000 7f1f221f3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f1c1036d0 0x7f1f1c19ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.162+0000 7f1f221f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c104070 0x7f1f1c1a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.162+0000 7f1f221f3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10e290 con 0x7f1f1c104070 2024-09-21T01:13:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.162+0000 7f1f221f3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10e110 con 0x7f1f1c1036d0 2024-09-21T01:13:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.162+0000 7f1f221f3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10e410 con 0x7f1f1c102640 2024-09-21T01:13:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.162+0000 7f1f1bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c104070 0x7f1f1c1a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.162+0000 7f1f1bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c104070 0x7f1f1c1a1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59996/0 (socket says 172.21.15.148:59996) 2024-09-21T01:13:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f1bfff640 1 -- 172.21.15.148:0/4095301592 learned_addr learned my addr 172.21.15.148:0/4095301592 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f1b7fe640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f1c102640 0x7f1f1c06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f1affd640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f1c1036d0 0x7f1f1c19ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f1bfff640 1 -- 172.21.15.148:0/4095301592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f1c102640 msgr2=0x7f1f1c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f1bfff640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f1c102640 0x7f1f1c06b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f1bfff640 1 -- 172.21.15.148:0/4095301592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f1c1036d0 msgr2=0x7f1f1c19ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f1bfff640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f1c1036d0 0x7f1f1c19ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f1bfff640 1 -- 172.21.15.148:0/4095301592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c1a1a60 con 0x7f1f1c104070 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f1bfff640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c104070 0x7f1f1c1a1260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1f14006010 tx=0x7f1f1402fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f18ff9640 1 -- 172.21.15.148:0/4095301592 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14034040 con 0x7f1f1c104070 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f18ff9640 1 -- 172.21.15.148:0/4095301592 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f140308f0 con 0x7f1f1c104070 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f221f3640 1 -- 172.21.15.148:0/4095301592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c1a1cf0 con 0x7f1f1c104070 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f18ff9640 1 -- 172.21.15.148:0/4095301592 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14039450 con 0x7f1f1c104070 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.163+0000 7f1f221f3640 1 -- 172.21.15.148:0/4095301592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c1a2180 con 0x7f1f1c104070 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.164+0000 7f1f221f3640 1 -- 172.21.15.148:0/4095301592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1c109820 con 0x7f1f1c104070 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.166+0000 7f1f18ff9640 1 -- 172.21.15.148:0/4095301592 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f1f14037020 con 0x7f1f1c104070 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.166+0000 7f1f18ff9640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1f040b65a0 0x7f1f040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.167+0000 7f1f1b7fe640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1f040b65a0 0x7f1f040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:40.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.167+0000 7f1f18ff9640 1 -- 172.21.15.148:0/4095301592 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f1f14108690 con 0x7f1f1c104070 2024-09-21T01:13:40.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.167+0000 7f1f1b7fe640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1f040b65a0 0x7f1f040b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005fd0 tx=0x7f1f0c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:40.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.170+0000 7f1f18ff9640 1 -- 172.21.15.148:0/4095301592 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f140cedd0 con 0x7f1f1c104070 2024-09-21T01:13:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.355+0000 7f1f221f3640 1 -- 172.21.15.148:0/4095301592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f1f1c02e640 con 0x7f1f1c104070 2024-09-21T01:13:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.356+0000 7f1f18ff9640 1 -- 172.21.15.148:0/4095301592 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v76) ==== 56+0+5326 (secure 0 0 0) 0x7f1f140d31b0 con 0x7f1f1c104070 2024-09-21T01:13:40.357 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 76 2024-09-21T01:13:40.357 INFO:teuthology.orchestra.run.smithi148.stdout:fsid 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:13:40.357 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-09-21T01:04:06.062226+0000 2024-09-21T01:13:40.357 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-09-21T01:12:55.664651+0000 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:crush_version 26 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:full_ratio 0.95 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:backfillfull_ratio 0.9 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:nearfull_ratio 0.85 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:require_min_compat_client luminous 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:min_compat_client luminous 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:require_osd_release squid 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:stretch_mode_enabled false 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:max_osd 12 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 up in weight 1 up_from 8 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6802/2331338222,v1:172.21.15.148:6803/2331338222] [v2:172.21.15.148:6804/2331338222,v1:172.21.15.148:6805/2331338222] exists,up 1e35550a-2857-479e-9465-d64c90a2f2f1 2024-09-21T01:13:40.358 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 up in weight 1 up_from 13 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6800/2914779788,v1:172.21.15.157:6801/2914779788] [v2:172.21.15.157:6802/2914779788,v1:172.21.15.157:6803/2914779788] exists,up a2d43be5-822d-4353-bb16-35d6d61e9488 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 up in weight 1 up_from 18 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6800/3636676499,v1:172.21.15.181:6801/3636676499] [v2:172.21.15.181:6802/3636676499,v1:172.21.15.181:6803/3636676499] exists,up c23db819-7af8-4b21-9a9b-8ff53251d19f 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 up in weight 1 up_from 26 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6810/2214807650,v1:172.21.15.148:6811/2214807650] [v2:172.21.15.148:6812/2214807650,v1:172.21.15.148:6813/2214807650] exists,up 09b1f0c6-d745-4a7f-af0b-e27ba52e188c 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 up in weight 1 up_from 31 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6808/3232117147,v1:172.21.15.157:6809/3232117147] [v2:172.21.15.157:6810/3232117147,v1:172.21.15.157:6811/3232117147] exists,up 65e3c06a-76f8-4b6d-8856-4e956f2117d2 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 up in weight 1 up_from 37 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6808/1383691858,v1:172.21.15.181:6809/1383691858] [v2:172.21.15.181:6810/1383691858,v1:172.21.15.181:6811/1383691858] exists,up 25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:osd.6 up in weight 1 up_from 42 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6818/2007504486,v1:172.21.15.148:6819/2007504486] [v2:172.21.15.148:6820/2007504486,v1:172.21.15.148:6821/2007504486] exists,up f1846682-e854-4fd3-9b8e-6a390dcdf5b5 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:osd.7 up in weight 1 up_from 46 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6816/1505346368,v1:172.21.15.157:6817/1505346368] [v2:172.21.15.157:6818/1505346368,v1:172.21.15.157:6819/1505346368] exists,up 0b053ed6-f9b4-4f89-ade9-4288c71f105f 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:osd.8 up in weight 1 up_from 52 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6816/1103366396,v1:172.21.15.181:6817/1103366396] [v2:172.21.15.181:6818/1103366396,v1:172.21.15.181:6819/1103366396] exists,up 98ad5627-aac2-47e2-a3c0-e09529875c0f 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:osd.9 up in weight 1 up_from 58 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6826/1373400085,v1:172.21.15.148:6827/1373400085] [v2:172.21.15.148:6828/1373400085,v1:172.21.15.148:6829/1373400085] exists,up 491086e1-cbc8-4904-bfeb-81cfa2b27b4e 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:osd.10 up in weight 1 up_from 63 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6824/3455888690,v1:172.21.15.157:6825/3455888690] [v2:172.21.15.157:6826/3455888690,v1:172.21.15.157:6827/3455888690] exists,up a9e9086f-2176-415b-ae99-ad3fbf5e3698 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:osd.11 up in weight 1 up_from 68 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6824/2872762977,v1:172.21.15.181:6825/2872762977] [v2:172.21.15.181:6826/2872762977,v1:172.21.15.181:6827/2872762977] exists,up 4bcfec34-f542-4554-8fb2-d05eb39e1948 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 2.4 [2,11] 2024-09-21T01:13:40.359 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 2.b [8,11] 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.0 [4,6] 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.17 [4,8] 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.1b [5,9,4,7] 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.21 [4,8] 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.22 [3,9] 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.37 [1,9] 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/745630392 expires 2024-09-22T01:04:54.215776+0000 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:6801/1196614580 expires 2024-09-22T01:04:54.215776+0000 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/1864845687 expires 2024-09-22T01:04:54.215776+0000 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:6801/1638470562 expires 2024-09-22T01:04:28.140797+0000 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/3851857915 expires 2024-09-22T01:04:28.140797+0000 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:6800/1638470562 expires 2024-09-22T01:04:28.140797+0000 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:6800/1196614580 expires 2024-09-22T01:04:54.215776+0000 2024-09-21T01:13:40.360 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/3953192821 expires 2024-09-22T01:04:54.215776+0000 2024-09-21T01:13:40.361 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/2712136637 expires 2024-09-22T01:04:28.140797+0000 2024-09-21T01:13:40.361 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/2946963019 expires 2024-09-22T01:04:28.140797+0000 2024-09-21T01:13:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 -- 172.21.15.148:0/4095301592 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1f040b65a0 msgr2=0x7f1f040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1f040b65a0 0x7f1f040b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005fd0 tx=0x7f1f0c00b390 comp rx=0 tx=0).stop 2024-09-21T01:13:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 -- 172.21.15.148:0/4095301592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c104070 msgr2=0x7f1f1c1a1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c104070 0x7f1f1c1a1260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1f14006010 tx=0x7f1f1402fc00 comp rx=0 tx=0).stop 2024-09-21T01:13:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 -- 172.21.15.148:0/4095301592 shutdown_connections 2024-09-21T01:13:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f1f040b65a0 0x7f1f040b8ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c104070 0x7f1f1c1a1260 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f1c1036d0 0x7f1f1c19ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 --2- 172.21.15.148:0/4095301592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f1c102640 0x7f1f1c06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 -- 172.21.15.148:0/4095301592 >> 172.21.15.148:0/4095301592 conn(0x7f1f1c0fdfb0 msgr2=0x7f1f1c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 -- 172.21.15.148:0/4095301592 shutdown_connections 2024-09-21T01:13:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:40.359+0000 7f1f221f3640 1 -- 172.21.15.148:0/4095301592 wait complete. 2024-09-21T01:13:40.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:40 smithi148 ceph-mon[31000]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T01:13:40.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:40 smithi181 ceph-mon[34811]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T01:13:40.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:40 smithi157 ceph-mon[34140]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T01:13:40.930 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T01:13:40.941 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:41.190 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:41.579 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:41 smithi148 ceph-mon[31000]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-21T01:13:41.579 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:41 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4095301592' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T01:13:41.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.668+0000 7f4892e43640 1 -- 172.21.15.148:0/1594349212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c109e40 msgr2=0x7f488c110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:41.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.668+0000 7f4892e43640 1 --2- 172.21.15.148:0/1594349212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c109e40 0x7f488c110670 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4884009ca0 tx=0x7f488402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.668+0000 7f4892e43640 1 -- 172.21.15.148:0/1594349212 shutdown_connections 2024-09-21T01:13:41.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.668+0000 7f4892e43640 1 --2- 172.21.15.148:0/1594349212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c109e40 0x7f488c110670 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.668+0000 7f4892e43640 1 --2- 172.21.15.148:0/1594349212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f488c1094f0 0x7f488c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.668+0000 7f4892e43640 1 --2- 172.21.15.148:0/1594349212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f488c103bb0 0x7f488c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.668+0000 7f4892e43640 1 -- 172.21.15.148:0/1594349212 >> 172.21.15.148:0/1594349212 conn(0x7f488c0ff600 msgr2=0x7f488c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:41.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.668+0000 7f4892e43640 1 -- 172.21.15.148:0/1594349212 shutdown_connections 2024-09-21T01:13:41.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.668+0000 7f4892e43640 1 -- 172.21.15.148:0/1594349212 wait complete. 2024-09-21T01:13:41.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f4892e43640 1 Processor -- start 2024-09-21T01:13:41.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f4892e43640 1 -- start start 2024-09-21T01:13:41.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f4892e43640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f488c103bb0 0x7f488c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:41.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f4892e43640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c1094f0 0x7f488c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f4892e43640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f488c109e40 0x7f488c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f4892e43640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f488c113b00 con 0x7f488c1094f0 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f4892e43640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f488c113980 con 0x7f488c109e40 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f4892e43640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f488c113c80 con 0x7f488c103bb0 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f488bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c1094f0 0x7f488c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f488bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c1094f0 0x7f488c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60012/0 (socket says 172.21.15.148:60012) 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f488bfff640 1 -- 172.21.15.148:0/1627451958 learned_addr learned my addr 172.21.15.148:0/1627451958 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f4890bdf640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f488c103bb0 0x7f488c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f48913e0640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f488c109e40 0x7f488c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f488bfff640 1 -- 172.21.15.148:0/1627451958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f488c103bb0 msgr2=0x7f488c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f488bfff640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f488c103bb0 0x7f488c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f488bfff640 1 -- 172.21.15.148:0/1627451958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f488c109e40 msgr2=0x7f488c19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f488bfff640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f488c109e40 0x7f488c19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f488bfff640 1 -- 172.21.15.148:0/1627451958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c1a03e0 con 0x7f488c1094f0 2024-09-21T01:13:41.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.669+0000 7f48913e0640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f488c109e40 0x7f488c19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:41.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.670+0000 7f488bfff640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c1094f0 0x7f488c19aa10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f488000d750 tx=0x7f488000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:41.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.670+0000 7f4889ffb640 1 -- 172.21.15.148:0/1627451958 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4880017070 con 0x7f488c1094f0 2024-09-21T01:13:41.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.670+0000 7f4889ffb640 1 -- 172.21.15.148:0/1627451958 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48800054d0 con 0x7f488c1094f0 2024-09-21T01:13:41.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.670+0000 7f4892e43640 1 -- 172.21.15.148:0/1627451958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c1a06d0 con 0x7f488c1094f0 2024-09-21T01:13:41.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.670+0000 7f4889ffb640 1 -- 172.21.15.148:0/1627451958 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4880004c30 con 0x7f488c1094f0 2024-09-21T01:13:41.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.670+0000 7f4892e43640 1 -- 172.21.15.148:0/1627451958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c1a6e30 con 0x7f488c1094f0 2024-09-21T01:13:41.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.671+0000 7f4892e43640 1 -- 172.21.15.148:0/1627451958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488c103fc0 con 0x7f488c1094f0 2024-09-21T01:13:41.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.672+0000 7f4889ffb640 1 -- 172.21.15.148:0/1627451958 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f4880004dd0 con 0x7f488c1094f0 2024-09-21T01:13:41.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.673+0000 7f4889ffb640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48740b6620 0x7f48740b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:41.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.673+0000 7f4890bdf640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48740b6620 0x7f48740b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:41.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.673+0000 7f4889ffb640 1 -- 172.21.15.148:0/1627451958 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f48800e6e30 con 0x7f488c1094f0 2024-09-21T01:13:41.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.674+0000 7f4890bdf640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48740b6620 0x7f48740b8b30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f487c0058c0 tx=0x7f487c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:41.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.677+0000 7f4889ffb640 1 -- 172.21.15.148:0/1627451958 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f48800ad570 con 0x7f488c1094f0 2024-09-21T01:13:41.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:41 smithi181 ceph-mon[34811]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-21T01:13:41.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:41 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/4095301592' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T01:13:41.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:41 smithi157 ceph-mon[34140]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-21T01:13:41.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:41 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/4095301592' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T01:13:41.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.892+0000 7f4892e43640 1 -- 172.21.15.148:0/1627451958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f488c02e640 con 0x7f488c1094f0 2024-09-21T01:13:41.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.893+0000 7f4889ffb640 1 -- 172.21.15.148:0/1627451958 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11926 (secure 0 0 0) 0x7f48800b1950 con 0x7f488c1094f0 2024-09-21T01:13:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:41.894 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":23,"btime":"2024-09-21T01:12:23:525439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:12:22.780555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24646,24631]},"id":1}]} 2024-09-21T01:13:41.894 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 23 2024-09-21T01:13:41.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 -- 172.21.15.148:0/1627451958 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48740b6620 msgr2=0x7f48740b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:41.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48740b6620 0x7f48740b8b30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f487c0058c0 tx=0x7f487c00a2d0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 -- 172.21.15.148:0/1627451958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c1094f0 msgr2=0x7f488c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:41.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c1094f0 0x7f488c19aa10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f488000d750 tx=0x7f488000dc10 comp rx=0 tx=0).stop 2024-09-21T01:13:41.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 -- 172.21.15.148:0/1627451958 shutdown_connections 2024-09-21T01:13:41.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f48740b6620 0x7f48740b8b30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f488c1094f0 0x7f488c19aa10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f488c109e40 0x7f488c19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 --2- 172.21.15.148:0/1627451958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f488c103bb0 0x7f488c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:41.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 -- 172.21.15.148:0/1627451958 >> 172.21.15.148:0/1627451958 conn(0x7f488c0ff600 msgr2=0x7f488c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:41.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 -- 172.21.15.148:0/1627451958 shutdown_connections 2024-09-21T01:13:41.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:41.895+0000 7f4892e43640 1 -- 172.21.15.148:0/1627451958 wait complete. 2024-09-21T01:13:42.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:42 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1627451958' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:42.612 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:42.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:42 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1627451958' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:42.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:42 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1627451958' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:42.859 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:43.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.317+0000 7f00920da640 1 -- 172.21.15.148:0/2209162499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c1094a0 msgr2=0x7f008c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:43.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.317+0000 7f00920da640 1 --2- 172.21.15.148:0/2209162499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c1094a0 0x7f008c1098b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0080009900 tx=0x7f008002a410 comp rx=0 tx=0).stop 2024-09-21T01:13:43.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.317+0000 7f00920da640 1 -- 172.21.15.148:0/2209162499 shutdown_connections 2024-09-21T01:13:43.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.317+0000 7f00920da640 1 --2- 172.21.15.148:0/2209162499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c1094a0 0x7f008c1098b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:43.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.317+0000 7f00920da640 1 --2- 172.21.15.148:0/2209162499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f008c109df0 0x7f008c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:43.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.317+0000 7f00920da640 1 --2- 172.21.15.148:0/2209162499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f008c103b60 0x7f008c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:43.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.317+0000 7f00920da640 1 -- 172.21.15.148:0/2209162499 >> 172.21.15.148:0/2209162499 conn(0x7f008c07b850 msgr2=0x7f008c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:43.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.317+0000 7f00920da640 1 -- 172.21.15.148:0/2209162499 shutdown_connections 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.317+0000 7f00920da640 1 -- 172.21.15.148:0/2209162499 wait complete. 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.317+0000 7f00920da640 1 Processor -- start 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f00920da640 1 -- start start 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f00920da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c103b60 0x7f008c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f00920da640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f008c1094a0 0x7f008c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f00920da640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f008c109df0 0x7f008c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f00920da640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f008c113ad0 con 0x7f008c103b60 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f00920da640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f008c113950 con 0x7f008c109df0 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f00920da640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f008c113c50 con 0x7f008c1094a0 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f008b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c103b60 0x7f008c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f008b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c103b60 0x7f008c19a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60016/0 (socket says 172.21.15.148:60016) 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f008b7fe640 1 -- 172.21.15.148:0/3417887254 learned_addr learned my addr 172.21.15.148:0/3417887254 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f008affd640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f008c1094a0 0x7f008c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f008b7fe640 1 -- 172.21.15.148:0/3417887254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f008c1094a0 msgr2=0x7f008c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f008b7fe640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f008c1094a0 0x7f008c19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f008b7fe640 1 -- 172.21.15.148:0/3417887254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f008c109df0 msgr2=0x7f008c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f008b7fe640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f008c109df0 0x7f008c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f008b7fe640 1 -- 172.21.15.148:0/3417887254 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c1a03f0 con 0x7f008c103b60 2024-09-21T01:13:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.318+0000 7f008b7fe640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c103b60 0x7f008c19a540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f007c00b4a0 tx=0x7f007c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.319+0000 7f0088ff9640 1 -- 172.21.15.148:0/3417887254 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c014070 con 0x7f008c103b60 2024-09-21T01:13:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.319+0000 7f00920da640 1 -- 172.21.15.148:0/3417887254 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008c1a06e0 con 0x7f008c103b60 2024-09-21T01:13:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.319+0000 7f0088ff9640 1 -- 172.21.15.148:0/3417887254 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f007c010ac0 con 0x7f008c103b60 2024-09-21T01:13:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.319+0000 7f0088ff9640 1 -- 172.21.15.148:0/3417887254 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c017c30 con 0x7f008c103b60 2024-09-21T01:13:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.319+0000 7f00920da640 1 -- 172.21.15.148:0/3417887254 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008c1a6f00 con 0x7f008c103b60 2024-09-21T01:13:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.320+0000 7f00920da640 1 -- 172.21.15.148:0/3417887254 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f008c103f70 con 0x7f008c103b60 2024-09-21T01:13:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.321+0000 7f0088ff9640 1 -- 172.21.15.148:0/3417887254 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f007c017070 con 0x7f008c103b60 2024-09-21T01:13:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.322+0000 7f0088ff9640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f00740b65d0 0x7f00740b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.322+0000 7f008affd640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f00740b65d0 0x7f00740b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.322+0000 7f0088ff9640 1 -- 172.21.15.148:0/3417887254 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f007c0e6ab0 con 0x7f008c103b60 2024-09-21T01:13:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.323+0000 7f008affd640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f00740b65d0 0x7f00740b8ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0080006010 tx=0x7f0080000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:43.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.325+0000 7f0088ff9640 1 -- 172.21.15.148:0/3417887254 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f007c0ad1f0 con 0x7f008c103b60 2024-09-21T01:13:43.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.542+0000 7f00920da640 1 -- 172.21.15.148:0/3417887254 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f008c19b670 con 0x7f008c103b60 2024-09-21T01:13:43.543 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:43 smithi148 ceph-mon[31000]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T01:13:43.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.543+0000 7f0088ff9640 1 -- 172.21.15.148:0/3417887254 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11926 (secure 0 0 0) 0x7f007c0b15d0 con 0x7f008c103b60 2024-09-21T01:13:43.544 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:43.544 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":23,"btime":"2024-09-21T01:12:23:525439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:12:22.780555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24646,24631]},"id":1}]} 2024-09-21T01:13:43.544 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 23 2024-09-21T01:13:43.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.546+0000 7f00920da640 1 -- 172.21.15.148:0/3417887254 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f00740b65d0 msgr2=0x7f00740b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:43.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.546+0000 7f00920da640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f00740b65d0 0x7f00740b8ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0080006010 tx=0x7f0080000bc0 comp rx=0 tx=0).stop 2024-09-21T01:13:43.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.546+0000 7f00920da640 1 -- 172.21.15.148:0/3417887254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c103b60 msgr2=0x7f008c19a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:43.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.546+0000 7f00920da640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c103b60 0x7f008c19a540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f007c00b4a0 tx=0x7f007c00b960 comp rx=0 tx=0).stop 2024-09-21T01:13:43.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.546+0000 7f00920da640 1 -- 172.21.15.148:0/3417887254 shutdown_connections 2024-09-21T01:13:43.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.546+0000 7f00920da640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f00740b65d0 0x7f00740b8ae0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:43.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.546+0000 7f00920da640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f008c109df0 0x7f008c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:43.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.546+0000 7f00920da640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f008c1094a0 0x7f008c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:43.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.546+0000 7f00920da640 1 --2- 172.21.15.148:0/3417887254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f008c103b60 0x7f008c19a540 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:43.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.546+0000 7f00920da640 1 -- 172.21.15.148:0/3417887254 >> 172.21.15.148:0/3417887254 conn(0x7f008c07b850 msgr2=0x7f008c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:43.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.547+0000 7f00920da640 1 -- 172.21.15.148:0/3417887254 shutdown_connections 2024-09-21T01:13:43.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:43.547+0000 7f00920da640 1 -- 172.21.15.148:0/3417887254 wait complete. 2024-09-21T01:13:43.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:43 smithi181 ceph-mon[34811]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T01:13:43.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:43 smithi157 ceph-mon[34140]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T01:13:44.261 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:13:44.512 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:44.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:44 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3417887254' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:44.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:44 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3417887254' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:44.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:44 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3417887254' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:44.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.948+0000 7fb543072640 1 -- 172.21.15.148:0/4091996881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb53c10de90 msgr2=0x7fb53c110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:44.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.948+0000 7fb543072640 1 --2- 172.21.15.148:0/4091996881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb53c10de90 0x7fb53c110380 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb534009ca0 tx=0x7fb53402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.948+0000 7fb543072640 1 -- 172.21.15.148:0/4091996881 shutdown_connections 2024-09-21T01:13:44.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.948+0000 7fb543072640 1 --2- 172.21.15.148:0/4091996881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb53c10de90 0x7fb53c110380 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.948+0000 7fb543072640 1 --2- 172.21.15.148:0/4091996881 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c105380 0x7fb53c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.948+0000 7fb543072640 1 --2- 172.21.15.148:0/4091996881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb53c104a30 0x7fb53c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.948+0000 7fb543072640 1 -- 172.21.15.148:0/4091996881 >> 172.21.15.148:0/4091996881 conn(0x7fb53c079770 msgr2=0x7fb53c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:44.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.948+0000 7fb543072640 1 -- 172.21.15.148:0/4091996881 shutdown_connections 2024-09-21T01:13:44.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.948+0000 7fb543072640 1 -- 172.21.15.148:0/4091996881 wait complete. 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.949+0000 7fb543072640 1 Processor -- start 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.949+0000 7fb543072640 1 -- start start 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.949+0000 7fb543072640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb53c104a30 0x7fb53c1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.949+0000 7fb543072640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c105380 0x7fb53c1a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.949+0000 7fb543072640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb53c10de90 0x7fb53c1ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb543072640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c113b70 con 0x7fb53c10de90 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb543072640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c1139f0 con 0x7fb53c104a30 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb543072640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c113cf0 con 0x7fb53c105380 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb54160f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb53c10de90 0x7fb53c1ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb54160f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb53c10de90 0x7fb53c1ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60034/0 (socket says 172.21.15.148:60034) 2024-09-21T01:13:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb54160f640 1 -- 172.21.15.148:0/810497909 learned_addr learned my addr 172.21.15.148:0/810497909 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb53bfff640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c105380 0x7fb53c1a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb540e0e640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb53c104a30 0x7fb53c1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb54160f640 1 -- 172.21.15.148:0/810497909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c105380 msgr2=0x7fb53c1a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb54160f640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c105380 0x7fb53c1a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb54160f640 1 -- 172.21.15.148:0/810497909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb53c104a30 msgr2=0x7fb53c1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb54160f640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb53c104a30 0x7fb53c1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb54160f640 1 -- 172.21.15.148:0/810497909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53c1a2680 con 0x7fb53c10de90 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb540e0e640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb53c104a30 0x7fb53c1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb54160f640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb53c10de90 0x7fb53c1ac8d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb534005cc0 tx=0x7fb53402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb539ffb640 1 -- 172.21.15.148:0/810497909 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534003bf0 con 0x7fb53c10de90 2024-09-21T01:13:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb539ffb640 1 -- 172.21.15.148:0/810497909 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb534003d90 con 0x7fb53c10de90 2024-09-21T01:13:44.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb543072640 1 -- 172.21.15.148:0/810497909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53c1aced0 con 0x7fb53c10de90 2024-09-21T01:13:44.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.950+0000 7fb539ffb640 1 -- 172.21.15.148:0/810497909 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53402fbc0 con 0x7fb53c10de90 2024-09-21T01:13:44.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.951+0000 7fb543072640 1 -- 172.21.15.148:0/810497909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb53c1ad380 con 0x7fb53c10de90 2024-09-21T01:13:44.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.952+0000 7fb543072640 1 -- 172.21.15.148:0/810497909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53c06c260 con 0x7fb53c10de90 2024-09-21T01:13:44.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.953+0000 7fb539ffb640 1 -- 172.21.15.148:0/810497909 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fb53402fd60 con 0x7fb53c10de90 2024-09-21T01:13:44.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.954+0000 7fb539ffb640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb52c0b65a0 0x7fb52c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:44.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.954+0000 7fb540e0e640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb52c0b65a0 0x7fb52c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:44.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.954+0000 7fb539ffb640 1 -- 172.21.15.148:0/810497909 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fb534108b20 con 0x7fb53c10de90 2024-09-21T01:13:44.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.955+0000 7fb540e0e640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb52c0b65a0 0x7fb52c0b8ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb53c10d9f0 tx=0x7fb530008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:44.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:44.957+0000 7fb539ffb640 1 -- 172.21.15.148:0/810497909 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb53c1a2680 con 0x7fb53c10de90 2024-09-21T01:13:45.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.136+0000 7fb543072640 1 -- 172.21.15.148:0/810497909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb53c10d2a0 con 0x7fb53c10de90 2024-09-21T01:13:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.138+0000 7fb539ffb640 1 -- 172.21.15.148:0/810497909 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22837 (secure 0 0 0) 0x7fb5340cf260 con 0x7fb53c10de90 2024-09-21T01:13:45.139 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:45.139 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":76,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:55.664651+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:13:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 -- 172.21.15.148:0/810497909 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb52c0b65a0 msgr2=0x7fb52c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb52c0b65a0 0x7fb52c0b8ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb53c10d9f0 tx=0x7fb530008040 comp rx=0 tx=0).stop 2024-09-21T01:13:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 -- 172.21.15.148:0/810497909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb53c10de90 msgr2=0x7fb53c1ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb53c10de90 0x7fb53c1ac8d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb534005cc0 tx=0x7fb53402f380 comp rx=0 tx=0).stop 2024-09-21T01:13:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 -- 172.21.15.148:0/810497909 shutdown_connections 2024-09-21T01:13:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb52c0b65a0 0x7fb52c0b8ab0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb53c10de90 0x7fb53c1ac8d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c105380 0x7fb53c1a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 --2- 172.21.15.148:0/810497909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb53c104a30 0x7fb53c1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 -- 172.21.15.148:0/810497909 >> 172.21.15.148:0/810497909 conn(0x7fb53c079770 msgr2=0x7fb53c1079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 -- 172.21.15.148:0/810497909 shutdown_connections 2024-09-21T01:13:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:45.140+0000 7fb543072640 1 -- 172.21.15.148:0/810497909 wait complete. 2024-09-21T01:13:45.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:45 smithi148 ceph-mon[31000]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:45.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:45 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/810497909' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:45.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:45 smithi181 ceph-mon[34811]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:45.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:45 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/810497909' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:45.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:45 smithi157 ceph-mon[34140]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:45.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:45 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/810497909' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:45.786 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T01:12:11.894283+0000', 'modified': '2024-09-21T01:12:22.780555+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24665, 'mds_1': 24646, 'mds_2': 24631}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24599': {'gid': 24599, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.157:6835/2996859376', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 2996859376}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 2996859376}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24619': {'gid': 24619, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/685827281', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 685827281}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 685827281}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.157:6837/3732138486', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6836', 'nonce': 3732138486}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 3732138486}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.181:6837/3446561094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3446561094}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3446561094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24646': {'gid': 24646, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.181:6839/2036386246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 2036386246}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 2036386246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24665': {'gid': 24665, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.157:6839/762884269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 762884269}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 762884269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24665, 'qdb_cluster': [24665, 24646, 24631]} 2024-09-21T01:13:45.786 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T01:13:45.786 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T01:13:46.031 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:46.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.516+0000 7f306e5a3640 1 -- 172.21.15.148:0/1161053461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3068109df0 msgr2=0x7f3068110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.516+0000 7f306e5a3640 1 --2- 172.21.15.148:0/1161053461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3068109df0 0x7f3068110620 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3060009ca0 tx=0x7f306002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.516+0000 7f306e5a3640 1 -- 172.21.15.148:0/1161053461 shutdown_connections 2024-09-21T01:13:46.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.516+0000 7f306e5a3640 1 --2- 172.21.15.148:0/1161053461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3068109df0 0x7f3068110620 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.516+0000 7f306e5a3640 1 --2- 172.21.15.148:0/1161053461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30681094a0 0x7f30681098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.516+0000 7f306e5a3640 1 --2- 172.21.15.148:0/1161053461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3068103b60 0x7f3068103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.516+0000 7f306e5a3640 1 -- 172.21.15.148:0/1161053461 >> 172.21.15.148:0/1161053461 conn(0x7f306807b850 msgr2=0x7f306807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:46.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.516+0000 7f306e5a3640 1 -- 172.21.15.148:0/1161053461 shutdown_connections 2024-09-21T01:13:46.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.516+0000 7f306e5a3640 1 -- 172.21.15.148:0/1161053461 wait complete. 2024-09-21T01:13:46.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.517+0000 7f306e5a3640 1 Processor -- start 2024-09-21T01:13:46.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.517+0000 7f306e5a3640 1 -- start start 2024-09-21T01:13:46.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f306e5a3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3068103b60 0x7f306819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f306e5a3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30681094a0 0x7f306819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f306e5a3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3068109df0 0x7f306819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f306e5a3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3068113b10 con 0x7f30681094a0 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f306e5a3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3068113990 con 0x7f3068103b60 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f306e5a3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3068113c90 con 0x7f3068109df0 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f30677fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30681094a0 0x7f306819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f30677fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30681094a0 0x7f306819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60160/0 (socket says 172.21.15.148:60160) 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f30677fe640 1 -- 172.21.15.148:0/4093294833 learned_addr learned my addr 172.21.15.148:0/4093294833 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f3067fff640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3068103b60 0x7f306819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f306cb40640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3068109df0 0x7f306819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f30677fe640 1 -- 172.21.15.148:0/4093294833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3068109df0 msgr2=0x7f306819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f30677fe640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3068109df0 0x7f306819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f30677fe640 1 -- 172.21.15.148:0/4093294833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3068103b60 msgr2=0x7f306819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f30677fe640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3068103b60 0x7f306819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f30677fe640 1 -- 172.21.15.148:0/4093294833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30681a03f0 con 0x7f30681094a0 2024-09-21T01:13:46.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f306cb40640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3068109df0 0x7f306819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:46.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f30677fe640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30681094a0 0x7f306819aa20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f305c00d740 tx=0x7f305c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:46.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.518+0000 7f30657fa640 1 -- 172.21.15.148:0/4093294833 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c017070 con 0x7f30681094a0 2024-09-21T01:13:46.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.519+0000 7f306e5a3640 1 -- 172.21.15.148:0/4093294833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30681a06e0 con 0x7f30681094a0 2024-09-21T01:13:46.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.519+0000 7f30657fa640 1 -- 172.21.15.148:0/4093294833 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f305c010460 con 0x7f30681094a0 2024-09-21T01:13:46.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.519+0000 7f30657fa640 1 -- 172.21.15.148:0/4093294833 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c00f600 con 0x7f30681094a0 2024-09-21T01:13:46.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.519+0000 7f306e5a3640 1 -- 172.21.15.148:0/4093294833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30681a6ec0 con 0x7f30681094a0 2024-09-21T01:13:46.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.521+0000 7f3074b17740 1 Processor -- start 2024-09-21T01:13:46.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.521+0000 7f3074b17740 1 -- start start 2024-09-21T01:13:46.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.521+0000 7f30657fa640 1 -- 172.21.15.148:0/4093294833 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f305c01a070 con 0x7f30681094a0 2024-09-21T01:13:46.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3074b17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4aa6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3074b17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4aa7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3074b17740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4aa7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3074b17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5568d4a1ec10 con 0x5568d46d80a0 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3074b17740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5568d4a0e040 con 0x5568d46e0280 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3074b17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5568d4a11e50 con 0x5568d4700f60 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3067fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4aa7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3067fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4aa7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60176/0 (socket says 172.21.15.148:60176) 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3067fff640 1 -- 172.21.15.148:0/2470859636 learned_addr learned my addr 172.21.15.148:0/2470859636 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f306cb40640 1 --2- 172.21.15.148:0/2470859636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4aa6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f30677fe640 1 --2- 172.21.15.148:0/2470859636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4aa7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3067fff640 1 -- 172.21.15.148:0/2470859636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 msgr2=0x5568d4aa6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3067fff640 1 --2- 172.21.15.148:0/2470859636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4aa6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3067fff640 1 -- 172.21.15.148:0/2470859636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 msgr2=0x5568d4aa7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3067fff640 1 --2- 172.21.15.148:0/2470859636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4aa7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3067fff640 1 -- 172.21.15.148:0/2470859636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d476c540 con 0x5568d46d80a0 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f3067fff640 1 --2- 172.21.15.148:0/2470859636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4aa7440 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3058009a70 tx=0x7f3058009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c34f369bff1769 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.522+0000 7f30657fa640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f30500b6620 0x7f30500b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.523+0000 7f304e7fc640 1 -- 172.21.15.148:0/2470859636 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058017070 con 0x5568d46d80a0 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.523+0000 7f306cb40640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f30500b6620 0x7f30500b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.523+0000 7f304e7fc640 1 -- 172.21.15.148:0/2470859636 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3058013470 con 0x5568d46d80a0 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.523+0000 7f304e7fc640 1 -- 172.21.15.148:0/2470859636 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058012610 con 0x5568d46d80a0 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.523+0000 7f30657fa640 1 -- 172.21.15.148:0/4093294833 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f305c0e6e00 con 0x7f30681094a0 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 -- 172.21.15.148:0/2470859636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 msgr2=0x5568d4aa7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f306cb40640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f30500b6620 0x7f30500b8b30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3060005cc0 tx=0x7f3060005c30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 --2- 172.21.15.148:0/2470859636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4aa7440 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3058009a70 tx=0x7f3058009f30 comp rx=0 tx=0).stop 2024-09-21T01:13:46.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 -- 172.21.15.148:0/2470859636 shutdown_connections 2024-09-21T01:13:46.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 --2- 172.21.15.148:0/2470859636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4aa7440 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 --2- 172.21.15.148:0/2470859636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4aa7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 --2- 172.21.15.148:0/2470859636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4aa6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 -- 172.21.15.148:0/2470859636 >> 172.21.15.148:0/2470859636 conn(0x5568d46f5350 msgr2=0x5568d4aa4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:46.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 -- 172.21.15.148:0/2470859636 shutdown_connections 2024-09-21T01:13:46.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 -- 172.21.15.148:0/2470859636 wait complete. 2024-09-21T01:13:46.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 -- start start 2024-09-21T01:13:46.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.524+0000 7f3074b17740 1 Processor -- start 2024-09-21T01:13:46.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f3074b17740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46d80a0 0x5568d4ab2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f3074b17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46e0280 0x5568d4ab2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f3074b17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4abea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f3074b17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5568d486f5f0 con 0x5568d46e0280 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f3074b17740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5568d49a9010 con 0x5568d46d80a0 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f3074b17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5568d4ab56e0 con 0x5568d4700f60 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f3074b17740 10 client.0 _ll_register_callbacks cb 0x5568d4a08340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f30677fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46e0280 0x5568d4ab2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f30677fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46e0280 0x5568d4ab2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60192/0 (socket says 172.21.15.148:60192) 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f30677fe640 1 -- 172.21.15.148:0/52404375 learned_addr learned my addr 172.21.15.148:0/52404375 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f3067fff640 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46d80a0 0x5568d4ab2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f306cb40640 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4abea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f30677fe640 1 -- 172.21.15.148:0/52404375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 msgr2=0x5568d4abea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:46.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f30677fe640 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4abea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f30677fe640 1 -- 172.21.15.148:0/52404375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46d80a0 msgr2=0x5568d4ab2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f30677fe640 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46d80a0 0x5568d4ab2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f30677fe640 1 -- 172.21.15.148:0/52404375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568d49d6a00 con 0x5568d46e0280 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f30677fe640 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46e0280 0x5568d4ab2cf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f305c0a9410 tx=0x7f305c010b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64208bc498efa340 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.525+0000 7f30477fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f30477fe640 1 -- 172.21.15.148:0/52404375 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c021030 con 0x5568d46e0280 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f30477fe640 1 -- 172.21.15.148:0/52404375 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f305c094070 con 0x5568d46e0280 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f3074b17740 1 -- 172.21.15.148:0/52404375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3058013470 con 0x5568d46e0280 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f30477fe640 1 -- 172.21.15.148:0/52404375 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f305c0ac5b0 con 0x5568d46e0280 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f3074b17740 10 client.15264 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f3074b17740 1 -- 172.21.15.148:0/52404375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5568d4ac1570 con 0x5568d46e0280 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f30477fe640 1 -- 172.21.15.148:0/52404375 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3058013470 con 0x5568d46e0280 2024-09-21T01:13:46.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f30477fe640 1 -- 172.21.15.148:0/52404375 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f305c0abb10 con 0x5568d46e0280 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f3074b17740 10 client.15264 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f3074b17740 10 client.15264 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f3074b17740 20 client.15264 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f3074b17740 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5568d46bf8e0 0x5568d4ac5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f3074b17740 4 client.15264 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f3074b17740 1 -- 172.21.15.148:0/52404375 --> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568d4a20b60 con 0x5568d46bf8e0 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.526+0000 7f3067fff640 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5568d46bf8e0 0x5568d4ac5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.527+0000 7f30477fe640 10 client.15264 ms_handle_connect on v2:172.21.15.181:6836/3446561094 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.527+0000 7f3067fff640 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5568d46bf8e0 0x5568d4ac5070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5d7824a47f7c2b86 server_cookie=eb6e04d9da4cb8a5 in_seq=0 out_seq=0 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f30477fe640 1 -- 172.21.15.148:0/52404375 <== mds.2 v2:172.21.15.181:6836/3446561094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568d4a20b60 con 0x5568d46bf8e0 2024-09-21T01:13:46.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f30477fe640 10 client.15264 handle_command_reply: tid=0 2024-09-21T01:13:46.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 client.15264 shutdown 2024-09-21T01:13:46.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 -- 172.21.15.148:0/52404375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46e0280 msgr2=0x5568d4ab2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46e0280 0x5568d4ab2cf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f305c0a9410 tx=0x7f305c010b40 comp rx=0 tx=0).stop 2024-09-21T01:13:46.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 -- 172.21.15.148:0/52404375 shutdown_connections 2024-09-21T01:13:46.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5568d46bf8e0 0x5568d4ac5070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46e0280 0x5568d4ab2cf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4abea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f30477fe640 0 client.15264 ms_handle_reset on v2:172.21.15.181:6836/3446561094 2024-09-21T01:13:46.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 --2- 172.21.15.148:0/52404375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46d80a0 0x5568d4ab2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 -- 172.21.15.148:0/52404375 >> 172.21.15.148:0/52404375 conn(0x5568d46f5350 msgr2=0x5568d4aaa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:46.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 -- 172.21.15.148:0/52404375 shutdown_connections 2024-09-21T01:13:46.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 1 -- 172.21.15.148:0/52404375 wait complete. 2024-09-21T01:13:46.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.528+0000 7f3074b17740 20 client.15264 trim_cache size 0 max 16384 2024-09-21T01:13:46.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3074b17740 1 Processor -- start 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3074b17740 1 -- start start 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3074b17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4abe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3074b17740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4abeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3074b17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4aa4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3074b17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5568d4ac33b0 con 0x5568d46d80a0 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3074b17740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5568d4ac3a80 con 0x5568d46e0280 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3074b17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5568d4ac4150 con 0x5568d4700f60 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3067fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4abe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3067fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4abe970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60200/0 (socket says 172.21.15.148:60200) 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3067fff640 1 -- 172.21.15.148:0/2459070010 learned_addr learned my addr 172.21.15.148:0/2459070010 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3067fff640 1 -- 172.21.15.148:0/2459070010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 msgr2=0x5568d4aa4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f306cb40640 1 --2- 172.21.15.148:0/2459070010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4aa4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f30677fe640 1 --2- 172.21.15.148:0/2459070010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4abeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.546+0000 7f3067fff640 1 --2- 172.21.15.148:0/2459070010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4aa4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.547+0000 7f3067fff640 1 -- 172.21.15.148:0/2459070010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 msgr2=0x5568d4abeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:46.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.547+0000 7f3067fff640 1 --2- 172.21.15.148:0/2459070010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4abeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.547+0000 7f3067fff640 1 -- 172.21.15.148:0/2459070010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d4aa9790 con 0x5568d46d80a0 2024-09-21T01:13:46.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.547+0000 7f3067fff640 1 --2- 172.21.15.148:0/2459070010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4abe970 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x5568d4aa5b80 tx=0x7f3058008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b70b47b5af01e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:46.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.547+0000 7f304dffb640 1 -- 172.21.15.148:0/2459070010 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058017040 con 0x5568d46d80a0 2024-09-21T01:13:46.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.547+0000 7f304dffb640 1 -- 172.21.15.148:0/2459070010 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f305800ee50 con 0x5568d46d80a0 2024-09-21T01:13:46.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.547+0000 7f304dffb640 1 -- 172.21.15.148:0/2459070010 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305801c9f0 con 0x5568d46d80a0 2024-09-21T01:13:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 -- 172.21.15.148:0/2459070010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 msgr2=0x5568d4abe970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 --2- 172.21.15.148:0/2459070010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4abe970 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x5568d4aa5b80 tx=0x7f3058008040 comp rx=0 tx=0).stop 2024-09-21T01:13:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 -- 172.21.15.148:0/2459070010 shutdown_connections 2024-09-21T01:13:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 --2- 172.21.15.148:0/2459070010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d4700f60 0x5568d4aa4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 --2- 172.21.15.148:0/2459070010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4abeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 --2- 172.21.15.148:0/2459070010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d46d80a0 0x5568d4abe970 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 -- 172.21.15.148:0/2459070010 >> 172.21.15.148:0/2459070010 conn(0x5568d46f5350 msgr2=0x5568d4ab26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 -- 172.21.15.148:0/2459070010 shutdown_connections 2024-09-21T01:13:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 -- 172.21.15.148:0/2459070010 wait complete. 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 -- start start 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.548+0000 7f3074b17740 1 Processor -- start 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f3074b17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d46d80a0 0x5568d4ab03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f3074b17740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4ac8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f3074b17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d4700f60 0x5568d4ac8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f3074b17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5568d4ac4ef0 con 0x5568d4700f60 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f3074b17740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5568d4ac4820 con 0x5568d46e0280 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f3074b17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5568d4ac55c0 con 0x5568d46d80a0 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f3074b17740 10 client.0 _ll_register_callbacks cb 0x7f305c010be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f306cb40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d4700f60 0x5568d4ac8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f306cb40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d4700f60 0x5568d4ac8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60212/0 (socket says 172.21.15.148:60212) 2024-09-21T01:13:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f306cb40640 1 -- 172.21.15.148:0/1802397591 learned_addr learned my addr 172.21.15.148:0/1802397591 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f3067fff640 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d46d80a0 0x5568d4ab03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f30677fe640 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4ac8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f306cb40640 1 -- 172.21.15.148:0/1802397591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d46d80a0 msgr2=0x5568d4ab03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f306cb40640 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d46d80a0 0x5568d4ab03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f306cb40640 1 -- 172.21.15.148:0/1802397591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 msgr2=0x5568d4ac8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f306cb40640 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4ac8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f306cb40640 1 -- 172.21.15.148:0/1802397591 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568d4acd170 con 0x5568d4700f60 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f306cb40640 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d4700f60 0x5568d4ac8870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3060035000 tx=0x7f306002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72fed8a7a6c17a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f30477fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f30477fe640 1 -- 172.21.15.148:0/1802397591 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060004040 con 0x5568d4700f60 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.549+0000 7f30477fe640 1 -- 172.21.15.148:0/1802397591 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f3060042030 con 0x5568d4700f60 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f3074b17740 1 -- 172.21.15.148:0/1802397591 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f305800ee50 con 0x5568d4700f60 2024-09-21T01:13:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f30477fe640 1 -- 172.21.15.148:0/1802397591 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f30600041e0 con 0x5568d4700f60 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f3074b17740 10 client.15270 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f3074b17740 1 -- 172.21.15.148:0/1802397591 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5568d4b306f0 con 0x5568d4700f60 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f30477fe640 1 -- 172.21.15.148:0/1802397591 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f305800ee50 con 0x5568d4700f60 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f30477fe640 1 -- 172.21.15.148:0/1802397591 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f306002fb30 con 0x5568d4700f60 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f3074b17740 10 client.15270 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f3074b17740 10 client.15270 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f3074b17740 20 client.15270 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f3074b17740 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5568d4694c90 0x5568d4b34050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f3074b17740 4 client.15270 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f3074b17740 1 -- 172.21.15.148:0/1802397591 --> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] -- command(tid 0: {"prefix": "status"}) -- 0x5568d4a1c610 con 0x5568d4694c90 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.550+0000 7f3067fff640 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5568d4694c90 0x5568d4b34050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.551+0000 7f30477fe640 10 client.15270 ms_handle_connect on v2:172.21.15.181:6836/3446561094 2024-09-21T01:13:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.551+0000 7f3067fff640 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5568d4694c90 0x5568d4b34050 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9ee4098c9ed05849 server_cookie=3d8fa2394b891391 in_seq=0 out_seq=0 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.551+0000 7f30477fe640 1 -- 172.21.15.148:0/1802397591 <== mds.2 v2:172.21.15.181:6836/3446561094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5568d4a1c610 con 0x5568d4694c90 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.551+0000 7f30477fe640 10 client.15270 handle_command_reply: tid=0 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.551+0000 7f3074b17740 1 client.15270 shutdown 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.551+0000 7f3074b17740 1 -- 172.21.15.148:0/1802397591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d4700f60 msgr2=0x5568d4ac8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.551+0000 7f3074b17740 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d4700f60 0x5568d4ac8870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3060035000 tx=0x7f306002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f3074b17740 1 -- 172.21.15.148:0/1802397591 shutdown_connections 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f3074b17740 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5568d4694c90 0x5568d4b34050 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f3074b17740 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568d4700f60 0x5568d4ac8870 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f3074b17740 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568d46e0280 0x5568d4ac8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f3074b17740 1 --2- 172.21.15.148:0/1802397591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568d46d80a0 0x5568d4ab03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f3074b17740 1 -- 172.21.15.148:0/1802397591 >> 172.21.15.148:0/1802397591 conn(0x5568d46f5350 msgr2=0x5568d4aa4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f30477fe640 0 client.15270 ms_handle_reset on v2:172.21.15.181:6836/3446561094 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f3074b17740 1 -- 172.21.15.148:0/1802397591 shutdown_connections 2024-09-21T01:13:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f3074b17740 1 -- 172.21.15.148:0/1802397591 wait complete. 2024-09-21T01:13:46.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f3074b17740 20 client.15270 trim_cache size 0 max 16384 2024-09-21T01:13:46.558 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:13:46.558 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "3872f802-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:13:46.558 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 2, 2024-09-21T01:13:46.558 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24631, 2024-09-21T01:13:46.558 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-21T01:13:46.558 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-21T01:13:46.558 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-21T01:13:46.558 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 86.027898930999996, 2024-09-21T01:13:46.558 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 23, 2024-09-21T01:13:46.559 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 76, 2024-09-21T01:13:46.559 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:13:46.559 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 117.90183339399999 2024-09-21T01:13:46.559 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:13:46.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 -- 172.21.15.148:0/4093294833 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f30500b6620 msgr2=0x7f30500b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f30500b6620 0x7f30500b8b30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3060005cc0 tx=0x7f3060005c30 comp rx=0 tx=0).stop 2024-09-21T01:13:46.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 -- 172.21.15.148:0/4093294833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30681094a0 msgr2=0x7f306819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30681094a0 0x7f306819aa20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f305c00d740 tx=0x7f305c00db40 comp rx=0 tx=0).stop 2024-09-21T01:13:46.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 -- 172.21.15.148:0/4093294833 shutdown_connections 2024-09-21T01:13:46.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f30500b6620 0x7f30500b8b30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30681094a0 0x7f306819aa20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3068109df0 0x7f306819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 --2- 172.21.15.148:0/4093294833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3068103b60 0x7f306819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 -- 172.21.15.148:0/4093294833 >> 172.21.15.148:0/4093294833 conn(0x7f306807b850 msgr2=0x7f3068107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:46.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.552+0000 7f306e5a3640 1 -- 172.21.15.148:0/4093294833 shutdown_connections 2024-09-21T01:13:46.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:46.553+0000 7f306e5a3640 1 -- 172.21.15.148:0/4093294833 wait complete. 2024-09-21T01:13:47.259 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T01:13:47.513 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:47.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:47 smithi148 ceph-mon[31000]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:47.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:47 smithi181 ceph-mon[34811]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:47.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:47 smithi157 ceph-mon[34140]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:48.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.043+0000 7f571f51f640 1 -- 172.21.15.148:0/3884329183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571810de10 msgr2=0x7f5718110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.043+0000 7f571f51f640 1 --2- 172.21.15.148:0/3884329183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571810de10 0x7f5718110320 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5710009900 tx=0x7f571002a410 comp rx=0 tx=0).stop 2024-09-21T01:13:48.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.043+0000 7f571f51f640 1 -- 172.21.15.148:0/3884329183 shutdown_connections 2024-09-21T01:13:48.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.043+0000 7f571f51f640 1 --2- 172.21.15.148:0/3884329183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571810de10 0x7f5718110320 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.043+0000 7f571f51f640 1 --2- 172.21.15.148:0/3884329183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5718105290 0x7f571810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.043+0000 7f571f51f640 1 --2- 172.21.15.148:0/3884329183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5718104860 0x7f5718104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.043+0000 7f571f51f640 1 -- 172.21.15.148:0/3884329183 >> 172.21.15.148:0/3884329183 conn(0x7f5718079740 msgr2=0x7f5718079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.043+0000 7f571f51f640 1 -- 172.21.15.148:0/3884329183 shutdown_connections 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.043+0000 7f571f51f640 1 -- 172.21.15.148:0/3884329183 wait complete. 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571f51f640 1 Processor -- start 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571f51f640 1 -- start start 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571f51f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5718104860 0x7f571819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571f51f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5718105290 0x7f571819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571f51f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571810de10 0x7f571819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571f51f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5718113b30 con 0x7f571810de10 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571f51f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f57181139b0 con 0x7f5718105290 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571f51f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5718113cb0 con 0x7f5718104860 2024-09-21T01:13:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571dabc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571810de10 0x7f571819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571dabc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571810de10 0x7f571819fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60222/0 (socket says 172.21.15.148:60222) 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571dabc640 1 -- 172.21.15.148:0/1691020130 learned_addr learned my addr 172.21.15.148:0/1691020130 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571d2bb640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5718104860 0x7f571819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571caba640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5718105290 0x7f571819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571dabc640 1 -- 172.21.15.148:0/1691020130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5718104860 msgr2=0x7f571819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571dabc640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5718104860 0x7f571819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571dabc640 1 -- 172.21.15.148:0/1691020130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5718105290 msgr2=0x7f571819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571dabc640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5718105290 0x7f571819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571dabc640 1 -- 172.21.15.148:0/1691020130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57181a0430 con 0x7f571810de10 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571d2bb640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5718104860 0x7f571819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.044+0000 7f571caba640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5718105290 0x7f571819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.045+0000 7f571dabc640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571810de10 0x7f571819fd00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5710009a20 tx=0x7f5710004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.045+0000 7f57167fc640 1 -- 172.21.15.148:0/1691020130 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571003f030 con 0x7f571810de10 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.045+0000 7f571f51f640 1 -- 172.21.15.148:0/1691020130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57181a06c0 con 0x7f571810de10 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.045+0000 7f57167fc640 1 -- 172.21.15.148:0/1691020130 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5710003aa0 con 0x7f571810de10 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.045+0000 7f57167fc640 1 -- 172.21.15.148:0/1691020130 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710035070 con 0x7f571810de10 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.045+0000 7f571f51f640 1 -- 172.21.15.148:0/1691020130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57181a6e80 con 0x7f571810de10 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.047+0000 7f57167fc640 1 -- 172.21.15.148:0/1691020130 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f5710042030 con 0x7f571810de10 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f5725a93740 1 Processor -- start 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f5725a93740 1 -- start start 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f5725a93740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4daf9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f5725a93740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d72b0a0 0x55fd4dafa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f5725a93740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d733280 0x55fd4dafa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f5725a93740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fd4da71c10 con 0x55fd4d753f60 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f5725a93740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55fd4da61040 con 0x55fd4d72b0a0 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f5725a93740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fd4da64e50 con 0x55fd4d733280 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f571caba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4daf9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f571caba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4daf9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60232/0 (socket says 172.21.15.148:60232) 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f571caba640 1 -- 172.21.15.148:0/3426938958 learned_addr learned my addr 172.21.15.148:0/3426938958 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f57167fc640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57000b65a0 0x7f57000b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f571d2bb640 1 --2- 172.21.15.148:0/3426938958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d72b0a0 0x55fd4dafa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f571dabc640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57000b65a0 0x7f57000b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f571caba640 1 --2- 172.21.15.148:0/3426938958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d733280 0x55fd4dafa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.048+0000 7f571caba640 1 -- 172.21.15.148:0/3426938958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d733280 msgr2=0x55fd4dafa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.049+0000 7f571caba640 1 --2- 172.21.15.148:0/3426938958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d733280 0x55fd4dafa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.049+0000 7f571caba640 1 -- 172.21.15.148:0/3426938958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d72b0a0 msgr2=0x55fd4dafa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.049+0000 7f571caba640 1 --2- 172.21.15.148:0/3426938958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d72b0a0 0x55fd4dafa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.049+0000 7f571caba640 1 -- 172.21.15.148:0/3426938958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4d7bf540 con 0x55fd4d753f60 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.049+0000 7f57167fc640 1 -- 172.21.15.148:0/1691020130 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f5710107db0 con 0x7f571810de10 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.049+0000 7f571caba640 1 --2- 172.21.15.148:0/3426938958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4daf9f00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f570c00f390 tx=0x7f570c00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b06fbb8c2ff8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.049+0000 7f56ff7fe640 1 -- 172.21.15.148:0/3426938958 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c012860 con 0x55fd4d753f60 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.049+0000 7f571dabc640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57000b65a0 0x7f57000b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5710031440 tx=0x7f57100fe890 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.049+0000 7f56ff7fe640 1 -- 172.21.15.148:0/3426938958 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f570c011440 con 0x55fd4d753f60 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.049+0000 7f56ff7fe640 1 -- 172.21.15.148:0/3426938958 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c010630 con 0x55fd4d753f60 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 -- 172.21.15.148:0/3426938958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 msgr2=0x55fd4daf9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 --2- 172.21.15.148:0/3426938958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4daf9f00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f570c00f390 tx=0x7f570c00b4e0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 -- 172.21.15.148:0/3426938958 shutdown_connections 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 --2- 172.21.15.148:0/3426938958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d733280 0x55fd4dafa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 --2- 172.21.15.148:0/3426938958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d72b0a0 0x55fd4dafa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 --2- 172.21.15.148:0/3426938958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4daf9f00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 -- 172.21.15.148:0/3426938958 >> 172.21.15.148:0/3426938958 conn(0x55fd4d748350 msgr2=0x55fd4daf7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 -- 172.21.15.148:0/3426938958 shutdown_connections 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 -- 172.21.15.148:0/3426938958 wait complete. 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 -- start start 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.050+0000 7f5725a93740 1 Processor -- start 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f5725a93740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db09df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f5725a93740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d733280 0x55fd4db0a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f5725a93740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d753f60 0x55fd4db15d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f5725a93740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fd4d8c25f0 con 0x55fd4d72b0a0 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f5725a93740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55fd4d9fc010 con 0x55fd4d753f60 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f5725a93740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fd4db0ca10 con 0x55fd4d733280 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f5725a93740 10 client.0 _ll_register_callbacks cb 0x55fd4da5b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f571caba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db09df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f571caba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db09df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60238/0 (socket says 172.21.15.148:60238) 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f571caba640 1 -- 172.21.15.148:0/87168425 learned_addr learned my addr 172.21.15.148:0/87168425 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f571d2bb640 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d733280 0x55fd4db0a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f571caba640 1 -- 172.21.15.148:0/87168425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d733280 msgr2=0x55fd4db0a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f571caba640 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d733280 0x55fd4db0a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f571caba640 1 -- 172.21.15.148:0/87168425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d753f60 msgr2=0x55fd4db15d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f571caba640 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d753f60 0x55fd4db15d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f571caba640 1 -- 172.21.15.148:0/87168425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd4da29a00 con 0x55fd4d72b0a0 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f571caba640 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db09df0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f570c00b630 tx=0x7f570c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ce7f6306e3e24a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.051+0000 7f56fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f56fcff9640 1 -- 172.21.15.148:0/87168425 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c012a70 con 0x55fd4d72b0a0 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f56fcff9640 1 -- 172.21.15.148:0/87168425 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f570c012c10 con 0x55fd4d72b0a0 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f5725a93740 1 -- 172.21.15.148:0/87168425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f570c011440 con 0x55fd4d72b0a0 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f56fcff9640 1 -- 172.21.15.148:0/87168425 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f570c029420 con 0x55fd4d72b0a0 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f5725a93740 10 client.15282 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f5725a93740 1 -- 172.21.15.148:0/87168425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55fd4db189c0 con 0x55fd4d72b0a0 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f56fcff9640 1 -- 172.21.15.148:0/87168425 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f570c011440 con 0x55fd4d72b0a0 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f56fcff9640 1 -- 172.21.15.148:0/87168425 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f570c01dc40 con 0x55fd4d72b0a0 2024-09-21T01:13:48.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f5725a93740 10 client.15282 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f5725a93740 10 client.15282 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f5725a93740 20 client.15282 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f5725a93740 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55fd4d7128e0 0x55fd4db1c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f5725a93740 4 client.15282 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.052+0000 7f5725a93740 1 -- 172.21.15.148:0/87168425 --> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd4da73b60 con 0x55fd4d7128e0 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.053+0000 7f571d2bb640 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55fd4d7128e0 0x55fd4db1c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.053+0000 7f56fcff9640 10 client.15282 ms_handle_connect on v2:172.21.15.181:6838/2036386246 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.053+0000 7f571d2bb640 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55fd4d7128e0 0x55fd4db1c0b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2896e851f481caa3 server_cookie=27e82eca590f909f in_seq=0 out_seq=0 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f56fcff9640 1 -- 172.21.15.148:0/87168425 <== mds.1 v2:172.21.15.181:6838/2036386246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd4da73b60 con 0x55fd4d7128e0 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f56fcff9640 10 client.15282 handle_command_reply: tid=0 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 client.15282 shutdown 2024-09-21T01:13:48.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 -- 172.21.15.148:0/87168425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 msgr2=0x55fd4db09df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db09df0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f570c00b630 tx=0x7f570c011a50 comp rx=0 tx=0).stop 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 -- 172.21.15.148:0/87168425 shutdown_connections 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55fd4d7128e0 0x55fd4db1c0b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d753f60 0x55fd4db15d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d733280 0x55fd4db0a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f56fcff9640 0 client.15282 ms_handle_reset on v2:172.21.15.181:6838/2036386246 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 --2- 172.21.15.148:0/87168425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db09df0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 -- 172.21.15.148:0/87168425 >> 172.21.15.148:0/87168425 conn(0x55fd4d748350 msgr2=0x55fd4dafd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 -- 172.21.15.148:0/87168425 shutdown_connections 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 1 -- 172.21.15.148:0/87168425 wait complete. 2024-09-21T01:13:48.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.054+0000 7f5725a93740 20 client.15282 trim_cache size 0 max 16384 2024-09-21T01:13:48.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.072+0000 7f5725a93740 1 Processor -- start 2024-09-21T01:13:48.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.072+0000 7f5725a93740 1 -- start start 2024-09-21T01:13:48.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.072+0000 7f5725a93740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d72b0a0 0x55fd4db15ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f5725a93740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 0x55fd4db16220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f5725a93740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4db08470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f5725a93740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fd4db1a3f0 con 0x55fd4d753f60 2024-09-21T01:13:48.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f5725a93740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55fd4db1aac0 con 0x55fd4d733280 2024-09-21T01:13:48.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f5725a93740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fd4db1b190 con 0x55fd4d72b0a0 2024-09-21T01:13:48.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571caba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4db08470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571caba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4db08470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60244/0 (socket says 172.21.15.148:60244) 2024-09-21T01:13:48.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571caba640 1 -- 172.21.15.148:0/3499754222 learned_addr learned my addr 172.21.15.148:0/3499754222 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571caba640 1 --2- 172.21.15.148:0/3499754222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d72b0a0 0x55fd4db15ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571d2bb640 1 --2- 172.21.15.148:0/3499754222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 0x55fd4db16220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571caba640 1 -- 172.21.15.148:0/3499754222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d72b0a0 msgr2=0x55fd4db15ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571caba640 1 --2- 172.21.15.148:0/3499754222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d72b0a0 0x55fd4db15ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571caba640 1 -- 172.21.15.148:0/3499754222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 msgr2=0x55fd4db16220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571caba640 1 --2- 172.21.15.148:0/3499754222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 0x55fd4db16220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571caba640 1 -- 172.21.15.148:0/3499754222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4db04870 con 0x55fd4d753f60 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f571caba640 1 --2- 172.21.15.148:0/3499754222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4db08470 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f570c0058a0 tx=0x7f570c01f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d41d1b043545e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f56feffd640 1 -- 172.21.15.148:0/3499754222 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c011440 con 0x55fd4d753f60 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f56feffd640 1 -- 172.21.15.148:0/3499754222 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f570c021040 con 0x55fd4d753f60 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.073+0000 7f56feffd640 1 -- 172.21.15.148:0/3499754222 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c02b0d0 con 0x55fd4d753f60 2024-09-21T01:13:48.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.074+0000 7f5725a93740 1 -- 172.21.15.148:0/3499754222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 msgr2=0x55fd4db08470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.074+0000 7f5725a93740 1 --2- 172.21.15.148:0/3499754222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4db08470 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f570c0058a0 tx=0x7f570c01f040 comp rx=0 tx=0).stop 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.074+0000 7f5725a93740 1 -- 172.21.15.148:0/3499754222 shutdown_connections 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.074+0000 7f5725a93740 1 --2- 172.21.15.148:0/3499754222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d753f60 0x55fd4db08470 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.074+0000 7f5725a93740 1 --2- 172.21.15.148:0/3499754222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 0x55fd4db16220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.074+0000 7f5725a93740 1 --2- 172.21.15.148:0/3499754222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d72b0a0 0x55fd4db15ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.074+0000 7f5725a93740 1 -- 172.21.15.148:0/3499754222 >> 172.21.15.148:0/3499754222 conn(0x55fd4d748350 msgr2=0x55fd4db04da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.074+0000 7f5725a93740 1 -- 172.21.15.148:0/3499754222 shutdown_connections 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.074+0000 7f5725a93740 1 -- 172.21.15.148:0/3499754222 wait complete. 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f5725a93740 1 -- start start 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f5725a93740 1 Processor -- start 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f5725a93740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db1e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f5725a93740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 0x55fd4db1e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f5725a93740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d753f60 0x55fd4db1ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f5725a93740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fd4db1bf30 con 0x55fd4d72b0a0 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f5725a93740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55fd4db1b860 con 0x55fd4d733280 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f5725a93740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fd4db1c600 con 0x55fd4d753f60 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f5725a93740 10 client.0 _ll_register_callbacks cb 0x7f5708009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f571caba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db1e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f571caba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db1e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60254/0 (socket says 172.21.15.148:60254) 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f571caba640 1 -- 172.21.15.148:0/2686334291 learned_addr learned my addr 172.21.15.148:0/2686334291 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f571caba640 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d753f60 0x55fd4db1ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.075+0000 7f571d2bb640 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 0x55fd4db1e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f571caba640 1 -- 172.21.15.148:0/2686334291 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d753f60 msgr2=0x55fd4db1ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:48.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f571caba640 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d753f60 0x55fd4db1ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f571caba640 1 -- 172.21.15.148:0/2686334291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 msgr2=0x55fd4db1e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f571caba640 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 0x55fd4db1e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f571caba640 1 -- 172.21.15.148:0/2686334291 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd4db23b00 con 0x55fd4d72b0a0 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f571d2bb640 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 0x55fd4db1e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f571caba640 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db1e390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f570c00be90 tx=0x7f570c00ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380b5e9604b0d625 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f56fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f56fcff9640 1 -- 172.21.15.148:0/2686334291 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c011440 con 0x55fd4d72b0a0 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f56fcff9640 1 -- 172.21.15.148:0/2686334291 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f570c00bbb0 con 0x55fd4d72b0a0 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f5725a93740 1 -- 172.21.15.148:0/2686334291 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f570c021040 con 0x55fd4d72b0a0 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f56fcff9640 1 -- 172.21.15.148:0/2686334291 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f570c02b790 con 0x55fd4d72b0a0 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f5725a93740 10 client.15288 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:48.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f5725a93740 1 -- 172.21.15.148:0/2686334291 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55fd4db87800 con 0x55fd4d72b0a0 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f56fcff9640 1 -- 172.21.15.148:0/2686334291 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f570c021040 con 0x55fd4d72b0a0 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f56fcff9640 1 -- 172.21.15.148:0/2686334291 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f570c03e070 con 0x55fd4d72b0a0 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f5725a93740 10 client.15288 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.076+0000 7f5725a93740 10 client.15288 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f5725a93740 20 client.15288 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f5725a93740 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55fd4d6e7c90 0x55fd4db8ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f5725a93740 4 client.15288 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f5725a93740 1 -- 172.21.15.148:0/2686334291 --> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] -- command(tid 0: {"prefix": "status"}) -- 0x55fd4da6f610 con 0x55fd4d6e7c90 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f571d2bb640 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55fd4d6e7c90 0x55fd4db8ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f56fcff9640 10 client.15288 ms_handle_connect on v2:172.21.15.181:6838/2036386246 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f571d2bb640 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55fd4d6e7c90 0x55fd4db8ad00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e031f2645d91ba9 server_cookie=7378b9072795cfb6 in_seq=0 out_seq=0 2024-09-21T01:13:48.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f56fcff9640 1 -- 172.21.15.148:0/2686334291 <== mds.1 v2:172.21.15.181:6838/2036386246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fd4da6f610 con 0x55fd4d6e7c90 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f56fcff9640 10 client.15288 handle_command_reply: tid=0 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f5725a93740 1 client.15288 shutdown 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.077+0000 7f5725a93740 1 -- 172.21.15.148:0/2686334291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 msgr2=0x55fd4db1e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f5725a93740 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db1e390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f570c00be90 tx=0x7f570c00ffd0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f5725a93740 1 -- 172.21.15.148:0/2686334291 shutdown_connections 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f5725a93740 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55fd4d6e7c90 0x55fd4db8ad00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f5725a93740 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd4d753f60 0x55fd4db1ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f5725a93740 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fd4d733280 0x55fd4db1e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f5725a93740 1 --2- 172.21.15.148:0/2686334291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4d72b0a0 0x55fd4db1e390 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f56fcff9640 0 client.15288 ms_handle_reset on v2:172.21.15.181:6838/2036386246 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f5725a93740 1 -- 172.21.15.148:0/2686334291 >> 172.21.15.148:0/2686334291 conn(0x55fd4d748350 msgr2=0x55fd4daf7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:48.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f5725a93740 1 -- 172.21.15.148:0/2686334291 shutdown_connections 2024-09-21T01:13:48.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f5725a93740 1 -- 172.21.15.148:0/2686334291 wait complete. 2024-09-21T01:13:48.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f5725a93740 20 client.15288 trim_cache size 0 max 16384 2024-09-21T01:13:48.091 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:13:48.091 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "3872f802-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:13:48.091 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 1, 2024-09-21T01:13:48.091 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24646, 2024-09-21T01:13:48.091 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-21T01:13:48.091 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-21T01:13:48.091 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-21T01:13:48.092 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 88.564022406999996, 2024-09-21T01:13:48.092 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 23, 2024-09-21T01:13:48.092 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 76, 2024-09-21T01:13:48.092 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:13:48.092 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 114.44334457799999 2024-09-21T01:13:48.092 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:13:48.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 -- 172.21.15.148:0/1691020130 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57000b65a0 msgr2=0x7f57000b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57000b65a0 0x7f57000b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5710031440 tx=0x7f57100fe890 comp rx=0 tx=0).stop 2024-09-21T01:13:48.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 -- 172.21.15.148:0/1691020130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571810de10 msgr2=0x7f571819fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571810de10 0x7f571819fd00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5710009a20 tx=0x7f5710004270 comp rx=0 tx=0).stop 2024-09-21T01:13:48.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 -- 172.21.15.148:0/1691020130 shutdown_connections 2024-09-21T01:13:48.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57000b65a0 0x7f57000b8ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571810de10 0x7f571819fd00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5718105290 0x7f571819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 --2- 172.21.15.148:0/1691020130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5718104860 0x7f571819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 -- 172.21.15.148:0/1691020130 >> 172.21.15.148:0/1691020130 conn(0x7f5718079740 msgr2=0x7f5718100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:48.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 -- 172.21.15.148:0/1691020130 shutdown_connections 2024-09-21T01:13:48.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:48.078+0000 7f571f51f640 1 -- 172.21.15.148:0/1691020130 wait complete. 2024-09-21T01:13:48.799 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T01:13:49.046 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:49.460 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:49 smithi148 ceph-mon[31000]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:49.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.548+0000 7f69fd9eb640 1 -- 172.21.15.148:0/656005589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f8103b80 msgr2=0x7f69f8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.548+0000 7f69fd9eb640 1 --2- 172.21.15.148:0/656005589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f8103b80 0x7f69f8103f90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009900 tx=0x7f69e802a410 comp rx=0 tx=0).stop 2024-09-21T01:13:49.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.548+0000 7f69fd9eb640 1 -- 172.21.15.148:0/656005589 shutdown_connections 2024-09-21T01:13:49.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.548+0000 7f69fd9eb640 1 --2- 172.21.15.148:0/656005589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f8109e10 0x7f69f8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.548+0000 7f69fd9eb640 1 --2- 172.21.15.148:0/656005589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69f81094c0 0x7f69f81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.548+0000 7f69fd9eb640 1 --2- 172.21.15.148:0/656005589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f8103b80 0x7f69f8103f90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.548+0000 7f69fd9eb640 1 -- 172.21.15.148:0/656005589 >> 172.21.15.148:0/656005589 conn(0x7f69f80ff590 msgr2=0x7f69f81019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:49.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.549+0000 7f69fd9eb640 1 -- 172.21.15.148:0/656005589 shutdown_connections 2024-09-21T01:13:49.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.549+0000 7f69fd9eb640 1 -- 172.21.15.148:0/656005589 wait complete. 2024-09-21T01:13:49.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.549+0000 7f69fd9eb640 1 Processor -- start 2024-09-21T01:13:49.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.549+0000 7f69fd9eb640 1 -- start start 2024-09-21T01:13:49.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69fd9eb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69f8103b80 0x7f69f819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69fd9eb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f81094c0 0x7f69f819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69fd9eb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f8109e10 0x7f69f819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69fd9eb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8113b30 con 0x7f69f8109e10 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69fd9eb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f69f81139b0 con 0x7f69f8103b80 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69fd9eb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8113cb0 con 0x7f69f81094c0 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69ee7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f81094c0 0x7f69f819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69f77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f8109e10 0x7f69f819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69ee7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f81094c0 0x7f69f819aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:37182/0 (socket says 172.21.15.148:37182) 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69ee7fc640 1 -- 172.21.15.148:0/1894154287 learned_addr learned my addr 172.21.15.148:0/1894154287 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69f8103b80 0x7f69f819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69f77fe640 1 -- 172.21.15.148:0/1894154287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f81094c0 msgr2=0x7f69f819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69f77fe640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f81094c0 0x7f69f819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69f77fe640 1 -- 172.21.15.148:0/1894154287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69f8103b80 msgr2=0x7f69f819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69f77fe640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69f8103b80 0x7f69f819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69f77fe640 1 -- 172.21.15.148:0/1894154287 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f81a0470 con 0x7f69f8109e10 2024-09-21T01:13:49.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f81094c0 0x7f69f819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:13:49.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.550+0000 7f69f77fe640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f8109e10 0x7f69f819fd40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f69f000ca30 tx=0x7f69f000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:49.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.551+0000 7f69fc9e9640 1 -- 172.21.15.148:0/1894154287 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0007d90 con 0x7f69f8109e10 2024-09-21T01:13:49.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.551+0000 7f69fc9e9640 1 -- 172.21.15.148:0/1894154287 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69f0005020 con 0x7f69f8109e10 2024-09-21T01:13:49.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.551+0000 7f69fc9e9640 1 -- 172.21.15.148:0/1894154287 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f000f690 con 0x7f69f8109e10 2024-09-21T01:13:49.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.551+0000 7f69fd9eb640 1 -- 172.21.15.148:0/1894154287 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f81a0760 con 0x7f69f8109e10 2024-09-21T01:13:49.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.551+0000 7f69fd9eb640 1 -- 172.21.15.148:0/1894154287 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f81a6ec0 con 0x7f69f8109e10 2024-09-21T01:13:49.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f6a03f5f740 1 Processor -- start 2024-09-21T01:13:49.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f69fc9e9640 1 -- 172.21.15.148:0/1894154287 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f69f000f830 con 0x7f69f8109e10 2024-09-21T01:13:49.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f6a03f5f740 1 -- start start 2024-09-21T01:13:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65222f60 0x557c655c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655c9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557c65540c10 con 0x557c651fa0a0 2024-09-21T01:13:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x557c65530040 con 0x557c65202280 2024-09-21T01:13:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557c65533e50 con 0x557c65222f60 2024-09-21T01:13:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f69f6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f69f6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60284/0 (socket says 172.21.15.148:60284) 2024-09-21T01:13:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.554+0000 7f69f6ffd640 1 -- 172.21.15.148:0/2157704316 learned_addr learned my addr 172.21.15.148:0/2157704316 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:49.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/2157704316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69fc9e9640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f69e40b65a0 0x7f69e40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/2157704316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65222f60 0x557c655c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69f6ffd640 1 -- 172.21.15.148:0/2157704316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65222f60 msgr2=0x557c655c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/2157704316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65222f60 0x557c655c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69f6ffd640 1 -- 172.21.15.148:0/2157704316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 msgr2=0x557c655c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/2157704316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69f6ffd640 1 -- 172.21.15.148:0/2157704316 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6528e540 con 0x557c651fa0a0 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/2157704316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65222f60 0x557c655c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69f77fe640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f69e40b65a0 0x7f69e40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/2157704316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655c9440 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009900 tx=0x7f69e8031e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15da2c50f5be9a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69fc9e9640 1 -- 172.21.15.148:0/1894154287 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f69f00e7670 con 0x7f69f8109e10 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69edffb640 1 -- 172.21.15.148:0/2157704316 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8040070 con 0x557c651fa0a0 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69edffb640 1 -- 172.21.15.148:0/2157704316 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e80316a0 con 0x557c651fa0a0 2024-09-21T01:13:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.555+0000 7f69edffb640 1 -- 172.21.15.148:0/2157704316 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8035040 con 0x557c651fa0a0 2024-09-21T01:13:49.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.556+0000 7f6a03f5f740 1 -- 172.21.15.148:0/2157704316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 msgr2=0x557c655c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.556+0000 7f69f77fe640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f69e40b65a0 0x7f69e40b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f69f00a9d30 tx=0x7f69f00de150 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:49.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.556+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/2157704316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655c9440 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009900 tx=0x7f69e8031e50 comp rx=0 tx=0).stop 2024-09-21T01:13:49.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.556+0000 7f6a03f5f740 1 -- 172.21.15.148:0/2157704316 shutdown_connections 2024-09-21T01:13:49.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.556+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/2157704316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655c9440 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.556+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/2157704316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.556+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/2157704316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65222f60 0x557c655c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.556+0000 7f6a03f5f740 1 -- 172.21.15.148:0/2157704316 >> 172.21.15.148:0/2157704316 conn(0x557c65217350 msgr2=0x557c655c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.556+0000 7f6a03f5f740 1 -- 172.21.15.148:0/2157704316 shutdown_connections 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.556+0000 7f6a03f5f740 1 -- 172.21.15.148:0/2157704316 wait complete. 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f6a03f5f740 1 -- start start 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f6a03f5f740 1 Processor -- start 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65202280 0x557c655d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65222f60 0x557c655e09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557c653915f0 con 0x557c651fa0a0 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x557c654cb010 con 0x557c65222f60 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557c655d7680 con 0x557c65202280 2024-09-21T01:13:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f6a03f5f740 10 client.0 _ll_register_callbacks cb 0x557c6552a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f69ee7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f69ee7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60296/0 (socket says 172.21.15.148:60296) 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.557+0000 7f69ee7fc640 1 -- 172.21.15.148:0/1344277148 learned_addr learned my addr 172.21.15.148:0/1344277148 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69ee7fc640 1 -- 172.21.15.148:0/1344277148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65202280 msgr2=0x557c655d4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65202280 0x557c655d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69ee7fc640 1 -- 172.21.15.148:0/1344277148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65222f60 msgr2=0x557c655e09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65222f60 0x557c655e09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69ee7fc640 1 -- 172.21.15.148:0/1344277148 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c654f8a00 con 0x557c651fa0a0 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655d47b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f69e0014a50 tx=0x7f69e0014f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6499b5093c139f09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69d6ffd640 1 -- 172.21.15.148:0/1344277148 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e001a070 con 0x557c651fa0a0 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69d6ffd640 1 -- 172.21.15.148:0/1344277148 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f69e0010c00 con 0x557c651fa0a0 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f6a03f5f740 1 -- 172.21.15.148:0/1344277148 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69e80316a0 con 0x557c651fa0a0 2024-09-21T01:13:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69d6ffd640 1 -- 172.21.15.148:0/1344277148 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f69e0026050 con 0x557c651fa0a0 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f6a03f5f740 10 client.15300 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f6a03f5f740 1 -- 172.21.15.148:0/1344277148 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x557c655e3520 con 0x557c651fa0a0 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.558+0000 7f69d6ffd640 1 -- 172.21.15.148:0/1344277148 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e80316a0 con 0x557c651fa0a0 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.559+0000 7f69d6ffd640 1 -- 172.21.15.148:0/1344277148 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f69e0015040 con 0x557c651fa0a0 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.559+0000 7f6a03f5f740 10 client.15300 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.559+0000 7f6a03f5f740 10 client.15300 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.559+0000 7f6a03f5f740 20 client.15300 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.559+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x557c651e18e0 0x557c655e7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.559+0000 7f6a03f5f740 4 client.15300 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.559+0000 7f6a03f5f740 1 -- 172.21.15.148:0/1344277148 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c65542b60 con 0x557c651e18e0 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.559+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x557c651e18e0 0x557c655e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.559+0000 7f69d6ffd640 10 client.15300 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:13:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.559+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x557c651e18e0 0x557c655e7000 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea7bcfb923197922 server_cookie=7cdb4e8f5099ec4c in_seq=0 out_seq=0 2024-09-21T01:13:49.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f69d6ffd640 1 -- 172.21.15.148:0/1344277148 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c65542b60 con 0x557c651e18e0 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f69d6ffd640 10 client.15300 handle_command_reply: tid=0 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f6a03f5f740 1 client.15300 shutdown 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f6a03f5f740 1 -- 172.21.15.148:0/1344277148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 msgr2=0x557c655d47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655d47b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f69e0014a50 tx=0x7f69e0014f10 comp rx=0 tx=0).stop 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f6a03f5f740 1 -- 172.21.15.148:0/1344277148 shutdown_connections 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x557c651e18e0 0x557c655e7000 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65222f60 0x557c655e09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65202280 0x557c655d4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f69d6ffd640 0 client.15300 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/1344277148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655d47b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f6a03f5f740 1 -- 172.21.15.148:0/1344277148 >> 172.21.15.148:0/1344277148 conn(0x557c65217350 msgr2=0x557c655cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.560+0000 7f6a03f5f740 1 -- 172.21.15.148:0/1344277148 shutdown_connections 2024-09-21T01:13:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.561+0000 7f6a03f5f740 1 -- 172.21.15.148:0/1344277148 wait complete. 2024-09-21T01:13:49.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.561+0000 7f6a03f5f740 20 client.15300 trim_cache size 0 max 16384 2024-09-21T01:13:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.578+0000 7f6a03f5f740 1 Processor -- start 2024-09-21T01:13:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.578+0000 7f6a03f5f740 1 -- start start 2024-09-21T01:13:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.578+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c651fa0a0 0x557c655cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.578+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.578+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c65222f60 0x557c655e0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.578+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557c655e5340 con 0x557c65222f60 2024-09-21T01:13:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.578+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x557c655e5a10 con 0x557c65202280 2024-09-21T01:13:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.578+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557c655e60e0 con 0x557c651fa0a0 2024-09-21T01:13:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ee7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c65222f60 0x557c655e0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ee7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c65222f60 0x557c655e0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60304/0 (socket says 172.21.15.148:60304) 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ee7fc640 1 -- 172.21.15.148:0/3674540338 learned_addr learned my addr 172.21.15.148:0/3674540338 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/3674540338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/3674540338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c651fa0a0 0x557c655cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ee7fc640 1 -- 172.21.15.148:0/3674540338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c651fa0a0 msgr2=0x557c655cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/3674540338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c651fa0a0 0x557c655cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ee7fc640 1 -- 172.21.15.148:0/3674540338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 msgr2=0x557c655c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/3674540338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655c1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ee7fc640 1 -- 172.21.15.148:0/3674540338 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c655cb790 con 0x557c65222f60 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/3674540338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655c1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/3674540338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c65222f60 0x557c655e0910 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69e001e400 tx=0x7f69e0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928d3eb9a3ef6ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ed7fa640 1 -- 172.21.15.148:0/3674540338 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0031070 con 0x557c65222f60 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ed7fa640 1 -- 172.21.15.148:0/3674540338 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e0010e00 con 0x557c65222f60 2024-09-21T01:13:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.579+0000 7f69ed7fa640 1 -- 172.21.15.148:0/3674540338 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e001a070 con 0x557c65222f60 2024-09-21T01:13:49.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.580+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3674540338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c65222f60 msgr2=0x557c655e0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.580+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/3674540338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c65222f60 0x557c655e0910 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69e001e400 tx=0x7f69e0009ae0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.580+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3674540338 shutdown_connections 2024-09-21T01:13:49.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.580+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/3674540338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c65222f60 0x557c655e0910 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.580+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/3674540338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655c1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.580+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/3674540338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c651fa0a0 0x557c655cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.580+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3674540338 >> 172.21.15.148:0/3674540338 conn(0x557c65217350 msgr2=0x557c655cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.580+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3674540338 shutdown_connections 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.580+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3674540338 wait complete. 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f6a03f5f740 1 -- start start 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f6a03f5f740 1 Processor -- start 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f6a03f5f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65222f60 0x557c655ef050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557c655e6e80 con 0x557c651fa0a0 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x557c655e67b0 con 0x557c65202280 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f6a03f5f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557c655e7550 con 0x557c65222f60 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f69ee7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f69ee7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655e9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60314/0 (socket says 172.21.15.148:60314) 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f69ee7fc640 1 -- 172.21.15.148:0/3605746304 learned_addr learned my addr 172.21.15.148:0/3605746304 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f6a03f5f740 10 client.0 _ll_register_callbacks cb 0x7f69e0009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f69ee7fc640 1 -- 172.21.15.148:0/3605746304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65222f60 msgr2=0x557c655ef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.581+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65222f60 0x557c655ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f69ee7fc640 1 -- 172.21.15.148:0/3605746304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 msgr2=0x557c655ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f69ee7fc640 1 -- 172.21.15.148:0/3605746304 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c655ef6c0 con 0x557c651fa0a0 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f69ee7fc640 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655e9b10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f69e0021040 tx=0x7f69e00107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4ab477b3f4b108 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f69d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f69d6ffd640 1 -- 172.21.15.148:0/3605746304 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0031070 con 0x557c651fa0a0 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f69d6ffd640 1 -- 172.21.15.148:0/3605746304 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f69e0016570 con 0x557c651fa0a0 2024-09-21T01:13:49.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3605746304 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69e0010e00 con 0x557c651fa0a0 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f69d6ffd640 1 -- 172.21.15.148:0/3605746304 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f69e001a040 con 0x557c651fa0a0 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f6a03f5f740 10 client.15306 fetch_fsmap learned FSMap version 23 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3605746304 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x557c65652d90 con 0x557c651fa0a0 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f69d6ffd640 1 -- 172.21.15.148:0/3605746304 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e0010e00 con 0x557c651fa0a0 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f69d6ffd640 1 -- 172.21.15.148:0/3605746304 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f69e001f7f0 con 0x557c651fa0a0 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.582+0000 7f6a03f5f740 10 client.15306 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f6a03f5f740 10 client.15306 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f6a03f5f740 20 client.15306 populate_metadata read hostname 'smithi148' 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x557c651b6c90 0x557c65656220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f6a03f5f740 4 client.15306 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3605746304 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "status"}) -- 0x557c6553e610 con 0x557c651b6c90 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x557c651b6c90 0x557c65656220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f69d6ffd640 10 client.15306 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:13:49.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f69f6ffd640 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x557c651b6c90 0x557c65656220 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16736ffb8fac69e1 server_cookie=776556d15eba0fc6 in_seq=0 out_seq=0 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f69d6ffd640 1 -- 172.21.15.148:0/3605746304 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557c6553e610 con 0x557c651b6c90 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f69d6ffd640 10 client.15306 handle_command_reply: tid=0 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.583+0000 7f6a03f5f740 1 client.15306 shutdown 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3605746304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 msgr2=0x557c655e9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655e9b10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f69e0021040 tx=0x7f69e00107b0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3605746304 shutdown_connections 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x557c651b6c90 0x557c65656220 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c65222f60 0x557c655ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557c65202280 0x557c655ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f69d6ffd640 0 client.15306 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 1 --2- 172.21.15.148:0/3605746304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c651fa0a0 0x557c655e9b10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3605746304 >> 172.21.15.148:0/3605746304 conn(0x557c65217350 msgr2=0x557c655c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3605746304 shutdown_connections 2024-09-21T01:13:49.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 1 -- 172.21.15.148:0/3605746304 wait complete. 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f6a03f5f740 20 client.15306 trim_cache size 0 max 16384 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "3872f802-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24665, 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 97.267046190000002, 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 23, 2024-09-21T01:13:49.590 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 76, 2024-09-21T01:13:49.591 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:13:49.591 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 107.804323489 2024-09-21T01:13:49.591 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:13:49.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f69fd9eb640 1 -- 172.21.15.148:0/1894154287 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f69e40b65a0 msgr2=0x7f69e40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f69fd9eb640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f69e40b65a0 0x7f69e40b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f69f00a9d30 tx=0x7f69f00de150 comp rx=0 tx=0).stop 2024-09-21T01:13:49.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f69fd9eb640 1 -- 172.21.15.148:0/1894154287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f8109e10 msgr2=0x7f69f819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.584+0000 7f69fd9eb640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f8109e10 0x7f69f819fd40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f69f000ca30 tx=0x7f69f000cef0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.585+0000 7f69fd9eb640 1 -- 172.21.15.148:0/1894154287 shutdown_connections 2024-09-21T01:13:49.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.585+0000 7f69fd9eb640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f69e40b65a0 0x7f69e40b8ab0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.585+0000 7f69fd9eb640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f8109e10 0x7f69f819fd40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.585+0000 7f69fd9eb640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f81094c0 0x7f69f819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.585+0000 7f69fd9eb640 1 --2- 172.21.15.148:0/1894154287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69f8103b80 0x7f69f819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.585+0000 7f69fd9eb640 1 -- 172.21.15.148:0/1894154287 >> 172.21.15.148:0/1894154287 conn(0x7f69f80ff590 msgr2=0x7f69f81029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:49.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.585+0000 7f69fd9eb640 1 -- 172.21.15.148:0/1894154287 shutdown_connections 2024-09-21T01:13:49.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:49.585+0000 7f69fd9eb640 1 -- 172.21.15.148:0/1894154287 wait complete. 2024-09-21T01:13:49.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:49 smithi181 ceph-mon[34811]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:49.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:49 smithi157 ceph-mon[34140]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:50.292 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T01:13:50.322 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T01:13:50.323 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T01:13:50.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:13:50.323 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-09-21T01:13:50.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:13:50.340 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2024-09-21T01:13:50.409 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2024-09-21T01:13:50.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:13:50.411 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-21T01:13:50.411 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T01:13:50.411 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T01:13:50.411 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T01:13:50.697 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:51.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.124+0000 7efd48f01640 1 -- 172.21.15.148:0/561880902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44102a60 msgr2=0x7efd44102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:51.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.124+0000 7efd48f01640 1 --2- 172.21.15.148:0/561880902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44102a60 0x7efd44102e70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efd34009900 tx=0x7efd3402a410 comp rx=0 tx=0).stop 2024-09-21T01:13:51.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.124+0000 7efd48f01640 1 -- 172.21.15.148:0/561880902 shutdown_connections 2024-09-21T01:13:51.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.124+0000 7efd48f01640 1 --2- 172.21.15.148:0/561880902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd44108cf0 0x7efd4410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.124+0000 7efd48f01640 1 --2- 172.21.15.148:0/561880902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd441083a0 0x7efd441087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.124+0000 7efd48f01640 1 --2- 172.21.15.148:0/561880902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44102a60 0x7efd44102e70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.124+0000 7efd48f01640 1 -- 172.21.15.148:0/561880902 >> 172.21.15.148:0/561880902 conn(0x7efd44079730 msgr2=0x7efd44079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.124+0000 7efd48f01640 1 -- 172.21.15.148:0/561880902 shutdown_connections 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.124+0000 7efd48f01640 1 -- 172.21.15.148:0/561880902 wait complete. 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd48f01640 1 Processor -- start 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd48f01640 1 -- start start 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd48f01640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd44102a60 0x7efd441993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd48f01640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd441083a0 0x7efd44199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd48f01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44108cf0 0x7efd4419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd48f01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efd441129c0 con 0x7efd44108cf0 2024-09-21T01:13:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd48f01640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efd44112840 con 0x7efd441083a0 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd48f01640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efd44112b40 con 0x7efd44102a60 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd42d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44108cf0 0x7efd4419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd42d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44108cf0 0x7efd4419ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60330/0 (socket says 172.21.15.148:60330) 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd42d9d640 1 -- 172.21.15.148:0/3177707245 learned_addr learned my addr 172.21.15.148:0/3177707245 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd3bfff640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd441083a0 0x7efd44199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd4259c640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd44102a60 0x7efd441993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd42d9d640 1 -- 172.21.15.148:0/3177707245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd44102a60 msgr2=0x7efd441993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd42d9d640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd44102a60 0x7efd441993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.125+0000 7efd42d9d640 1 -- 172.21.15.148:0/3177707245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd441083a0 msgr2=0x7efd44199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.126+0000 7efd42d9d640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd441083a0 0x7efd44199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.126+0000 7efd42d9d640 1 -- 172.21.15.148:0/3177707245 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4419f260 con 0x7efd44108cf0 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.126+0000 7efd42d9d640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44108cf0 0x7efd4419ebf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00b970 tx=0x7efd3c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.126+0000 7efd3b7fe640 1 -- 172.21.15.148:0/3177707245 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c019070 con 0x7efd44108cf0 2024-09-21T01:13:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.126+0000 7efd3b7fe640 1 -- 172.21.15.148:0/3177707245 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd3c014440 con 0x7efd44108cf0 2024-09-21T01:13:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.126+0000 7efd48f01640 1 -- 172.21.15.148:0/3177707245 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4419f550 con 0x7efd44108cf0 2024-09-21T01:13:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.126+0000 7efd3b7fe640 1 -- 172.21.15.148:0/3177707245 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0075d0 con 0x7efd44108cf0 2024-09-21T01:13:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.126+0000 7efd48f01640 1 -- 172.21.15.148:0/3177707245 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd441a5d70 con 0x7efd44108cf0 2024-09-21T01:13:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.127+0000 7efd48f01640 1 -- 172.21.15.148:0/3177707245 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd44102e70 con 0x7efd44108cf0 2024-09-21T01:13:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.129+0000 7efd3b7fe640 1 -- 172.21.15.148:0/3177707245 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7efd3c01c070 con 0x7efd44108cf0 2024-09-21T01:13:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.129+0000 7efd3b7fe640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efd300b6650 0x7efd300b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.129+0000 7efd4259c640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efd300b6650 0x7efd300b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.129+0000 7efd3b7fe640 1 -- 172.21.15.148:0/3177707245 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7efd3c0e6d00 con 0x7efd44108cf0 2024-09-21T01:13:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.130+0000 7efd4259c640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efd300b6650 0x7efd300b8b60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efd34031440 tx=0x7efd34005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.133+0000 7efd3b7fe640 1 -- 172.21.15.148:0/3177707245 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd3c0ad440 con 0x7efd44108cf0 2024-09-21T01:13:51.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.350+0000 7efd48f01640 1 -- 172.21.15.148:0/3177707245 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efd4419a4e0 con 0x7efd44108cf0 2024-09-21T01:13:51.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.351+0000 7efd3b7fe640 1 -- 172.21.15.148:0/3177707245 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7efd4419a4e0 con 0x7efd44108cf0 2024-09-21T01:13:51.352 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T01:13:51.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 -- 172.21.15.148:0/3177707245 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efd300b6650 msgr2=0x7efd300b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:51.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efd300b6650 0x7efd300b8b60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efd34031440 tx=0x7efd34005d50 comp rx=0 tx=0).stop 2024-09-21T01:13:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 -- 172.21.15.148:0/3177707245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44108cf0 msgr2=0x7efd4419ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44108cf0 0x7efd4419ebf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00b970 tx=0x7efd3c00bd70 comp rx=0 tx=0).stop 2024-09-21T01:13:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 -- 172.21.15.148:0/3177707245 shutdown_connections 2024-09-21T01:13:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efd300b6650 0x7efd300b8b60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd44108cf0 0x7efd4419ebf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd441083a0 0x7efd44199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 --2- 172.21.15.148:0/3177707245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd44102a60 0x7efd441993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 -- 172.21.15.148:0/3177707245 >> 172.21.15.148:0/3177707245 conn(0x7efd44079730 msgr2=0x7efd44101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.353+0000 7efd48f01640 1 -- 172.21.15.148:0/3177707245 shutdown_connections 2024-09-21T01:13:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:51.354+0000 7efd48f01640 1 -- 172.21.15.148:0/3177707245 wait complete. 2024-09-21T01:13:52.041 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T01:13:52.041 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T01:13:52.041 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2024-09-21T01:13:52.041 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T01:13:52.042 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T01:13:52.042 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T01:13:52.042 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T01:13:52.042 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T01:13:52.042 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:13:52.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:13:52.042 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:13:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2024-09-21T01:13:52.060 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:13:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:13:52.060 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T01:13:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:13:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T01:13:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42139sec preferred_lft 42139sec 2024-09-21T01:13:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link noprefixroute 2024-09-21T01:13:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:13:52.061 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T01:13:52.061 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:13:52.061 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-21T01:13:52.061 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2024-09-21T01:13:52.061 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2024-09-21T01:13:52.061 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2024-09-21T01:13:52.061 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T01:13:52.062 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-21T01:13:52.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:13:52.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:13:52.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:13:52.262 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T01:13:52.287 INFO:teuthology.orchestra.run.smithi148.stdout:1 2024-09-21T01:13:52.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:13:52.289 DEBUG:teuthology.orchestra.run.smithi148:> route 2024-09-21T01:13:52.363 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2024-09-21T01:13:52.363 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T01:13:52.363 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T01:13:52.363 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T01:13:52.363 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T01:13:52.364 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:13:52.364 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-21T01:13:52.364 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T01:13:52.364 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T01:13:52.364 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T01:13:52.364 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-21T01:13:52.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:13:52.555 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:52 smithi148 ceph-mon[31000]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T01:13:52.555 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:52 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3177707245' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:13:52.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:13:52.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:13:52.667 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-09-21T01:13:52.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:13:52.683 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2024-09-21T01:13:52.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:52 smithi181 ceph-mon[34811]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T01:13:52.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:52 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3177707245' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:13:52.739 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:13:52.739 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-21T01:13:52.739 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:13:52.739 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T01:13:52.739 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-21T01:13:52.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:52 smithi157 ceph-mon[34140]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T01:13:52.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:52 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3177707245' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:13:52.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:13:52.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:13:52.859 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T01:13:52.859 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:13:52.859 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-21T01:13:52.859 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T01:13:52.859 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T01:13:52.859 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T01:13:52.859 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T01:13:52.859 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T01:13:52.859 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-21T01:13:52.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:13:52.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:13:52.996 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:13:52.996 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-21T01:13:52.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2024-09-21T01:13:52.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T01:13:52.996 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-21T01:13:53.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:13:53.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:13:53.073 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T01:13:53.088 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:13:53.088 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:13:53.088 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:13:53.143 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T01:13:53.143 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T01:13:53.143 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/cbb79553-cc4e-4e67-8ff1-e4ab53484f44 2024-09-21T01:13:53.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:13:53.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/cbb79553-cc4e-4e67-8ff1-e4ab53484f44 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T01:13:53.260 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T01:13:53.260 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-21T01:13:53.260 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2024-09-21T01:13:53.392 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T01:13:53.392 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-21T01:13:53.392 INFO:teuthology.orchestra.run.smithi148.stdout:invalid new device string format 2024-09-21T01:13:53.392 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.148:3300,172.21.15.157:3300,172.21.15.181:3300" 2024-09-21T01:13:53.392 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.148:3300,172.21.15.157:3300,172.21.15.181:3300:/volumes/qa/sv_1/cbb79553-cc4e-4e67-8ff1-e4ab53484f44 2024-09-21T01:13:53.393 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=3872f802-77b5-11ef-baf5-efdc52797490" will pass to kernel 2024-09-21T01:13:53.393 INFO:teuthology.orchestra.run.smithi148.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T01:13:53.393 INFO:teuthology.orchestra.run.smithi148.stdout: You just mounted a file system that supports labels which does not 2024-09-21T01:13:53.393 INFO:teuthology.orchestra.run.smithi148.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T01:13:53.393 INFO:teuthology.orchestra.run.smithi148.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T01:13:53.393 INFO:teuthology.orchestra.run.smithi148.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T01:13:53.395 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T01:13:53.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:13:53.395 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:13:53.430 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:13:53.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:13:53.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:13:53.538 INFO:teuthology.orchestra.run.smithi148.stdout:client15315 2024-09-21T01:13:53.539 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:13:53.539 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:13:53.556 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:13:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:13:53.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:13:53.665 INFO:teuthology.orchestra.run.smithi148.stdout:client15315 2024-09-21T01:13:53.665 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:13:53.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:13:53.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:13:53.730 INFO:teuthology.orchestra.run.smithi148.stdout:client15315 2024-09-21T01:13:53.730 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3872f802-77b5-11ef-baf5-efdc52797490.client15315/status') 2024-09-21T01:13:53.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:13:53.794 INFO:teuthology.orchestra.run.smithi148.stdout:instance: client.15315 (3)192.168.0.1:0/337121140 2024-09-21T01:13:53.794 INFO:teuthology.orchestra.run.smithi148.stdout:blocklisted: false 2024-09-21T01:13:53.795 INFO:teuthology.orchestra.run.smithi148.stderr:0+1 records in 2024-09-21T01:13:53.795 INFO:teuthology.orchestra.run.smithi148.stderr:0+1 records out 2024-09-21T01:13:53.795 INFO:teuthology.orchestra.run.smithi148.stderr:69 bytes copied, 2.6314e-05 s, 2.6 MB/s 2024-09-21T01:13:53.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:13:53.801 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T01:13:53.812 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T01:13:53.812 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T01:13:53.813 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-21T01:13:53.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.926+0000 7fa071c3f640 1 -- 172.21.15.148:0/3267421302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa06c1025d0 msgr2=0x7fa06c102a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:53.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.926+0000 7fa071c3f640 1 --2- 172.21.15.148:0/3267421302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa06c1025d0 0x7fa06c102a40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa064009ca0 tx=0x7fa06402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.926+0000 7fa071c3f640 1 -- 172.21.15.148:0/3267421302 shutdown_connections 2024-09-21T01:13:53.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.926+0000 7fa071c3f640 1 --2- 172.21.15.148:0/3267421302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06c103ff0 0x7fa06c10a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.926+0000 7fa071c3f640 1 --2- 172.21.15.148:0/3267421302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa06c103650 0x7fa06c103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.926+0000 7fa071c3f640 1 --2- 172.21.15.148:0/3267421302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa06c1025d0 0x7fa06c102a40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.926+0000 7fa071c3f640 1 -- 172.21.15.148:0/3267421302 >> 172.21.15.148:0/3267421302 conn(0x7fa06c0fdf30 msgr2=0x7fa06c1003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:53.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.926+0000 7fa071c3f640 1 -- 172.21.15.148:0/3267421302 shutdown_connections 2024-09-21T01:13:53.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.926+0000 7fa071c3f640 1 -- 172.21.15.148:0/3267421302 wait complete. 2024-09-21T01:13:53.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa071c3f640 1 Processor -- start 2024-09-21T01:13:53.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa071c3f640 1 -- start start 2024-09-21T01:13:53.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa071c3f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06c1025d0 0x7fa06c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:53.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa071c3f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa06c103650 0x7fa06c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa071c3f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa06c103ff0 0x7fa06c1a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa071c3f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c10e210 con 0x7fa06c103650 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa071c3f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c10e090 con 0x7fa06c1025d0 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa071c3f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c10e390 con 0x7fa06c103ff0 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa06affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa06c103650 0x7fa06c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa06affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa06c103650 0x7fa06c19ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60352/0 (socket says 172.21.15.148:60352) 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa06affd640 1 -- 172.21.15.148:0/2385839370 learned_addr learned my addr 172.21.15.148:0/2385839370 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa06bfff640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa06c103ff0 0x7fa06c1a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.927+0000 7fa06b7fe640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06c1025d0 0x7fa06c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa06affd640 1 -- 172.21.15.148:0/2385839370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa06c103ff0 msgr2=0x7fa06c1a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:53.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa06affd640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa06c103ff0 0x7fa06c1a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa06affd640 1 -- 172.21.15.148:0/2385839370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06c1025d0 msgr2=0x7fa06c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:53.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa06affd640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06c1025d0 0x7fa06c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa06affd640 1 -- 172.21.15.148:0/2385839370 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c1a1a80 con 0x7fa06c103650 2024-09-21T01:13:53.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa06affd640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa06c103650 0x7fa06c19ed30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa05400d770 tx=0x7fa05400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:53.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa068ff9640 1 -- 172.21.15.148:0/2385839370 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054017070 con 0x7fa06c103650 2024-09-21T01:13:53.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa068ff9640 1 -- 172.21.15.148:0/2385839370 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0540054d0 con 0x7fa06c103650 2024-09-21T01:13:53.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa071c3f640 1 -- 172.21.15.148:0/2385839370 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06c1a1d70 con 0x7fa06c103650 2024-09-21T01:13:53.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa068ff9640 1 -- 172.21.15.148:0/2385839370 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054004c30 con 0x7fa06c103650 2024-09-21T01:13:53.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.928+0000 7fa071c3f640 1 -- 172.21.15.148:0/2385839370 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06c1a2200 con 0x7fa06c103650 2024-09-21T01:13:53.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.929+0000 7fa071c3f640 1 -- 172.21.15.148:0/2385839370 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa06c1097a0 con 0x7fa06c103650 2024-09-21T01:13:53.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.932+0000 7fa068ff9640 1 -- 172.21.15.148:0/2385839370 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fa054004dd0 con 0x7fa06c103650 2024-09-21T01:13:53.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.933+0000 7fa068ff9640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa0580b6620 0x7fa0580b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:53.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.933+0000 7fa068ff9640 1 -- 172.21.15.148:0/2385839370 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fa0540e7220 con 0x7fa06c103650 2024-09-21T01:13:53.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.933+0000 7fa06b7fe640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa0580b6620 0x7fa0580b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:53.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.933+0000 7fa06b7fe640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa0580b6620 0x7fa0580b8b30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa0640094e0 tx=0x7fa064004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:53.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:53.935+0000 7fa068ff9640 1 -- 172.21.15.148:0/2385839370 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0540b1dc0 con 0x7fa06c103650 2024-09-21T01:13:54.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.158+0000 7fa071c3f640 1 -- 172.21.15.148:0/2385839370 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fa06c02e640 con 0x7fa06c103650 2024-09-21T01:13:54.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.310+0000 7fa068ff9640 1 -- 172.21.15.148:0/2385839370 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7fa0540b6d00 con 0x7fa06c103650 2024-09-21T01:13:54.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 -- 172.21.15.148:0/2385839370 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa0580b6620 msgr2=0x7fa0580b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa0580b6620 0x7fa0580b8b30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa0640094e0 tx=0x7fa064004a40 comp rx=0 tx=0).stop 2024-09-21T01:13:54.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 -- 172.21.15.148:0/2385839370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa06c103650 msgr2=0x7fa06c19ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa06c103650 0x7fa06c19ed30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa05400d770 tx=0x7fa05400dc30 comp rx=0 tx=0).stop 2024-09-21T01:13:54.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 -- 172.21.15.148:0/2385839370 shutdown_connections 2024-09-21T01:13:54.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa0580b6620 0x7fa0580b8b30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa06c103650 0x7fa06c19ed30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa06c103ff0 0x7fa06c1a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 --2- 172.21.15.148:0/2385839370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa06c1025d0 0x7fa06c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 -- 172.21.15.148:0/2385839370 >> 172.21.15.148:0/2385839370 conn(0x7fa06c0fdf30 msgr2=0x7fa06c106970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:54.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 -- 172.21.15.148:0/2385839370 shutdown_connections 2024-09-21T01:13:54.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.313+0000 7fa071c3f640 1 -- 172.21.15.148:0/2385839370 wait complete. 2024-09-21T01:13:54.327 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-21T01:13:54.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 -- 172.21.15.148:0/4180817533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f787c1036b0 msgr2=0x7f787c103b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 --2- 172.21.15.148:0/4180817533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f787c1036b0 0x7f787c103b20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7878009900 tx=0x7f787802a410 comp rx=0 tx=0).stop 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 -- 172.21.15.148:0/4180817533 shutdown_connections 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 --2- 172.21.15.148:0/4180817533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f787c1050d0 0x7f787c10ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 --2- 172.21.15.148:0/4180817533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f787c104730 0x7f787c104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 --2- 172.21.15.148:0/4180817533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f787c1036b0 0x7f787c103b20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 -- 172.21.15.148:0/4180817533 >> 172.21.15.148:0/4180817533 conn(0x7f787c0feff0 msgr2=0x7f787c1014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 -- 172.21.15.148:0/4180817533 shutdown_connections 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 -- 172.21.15.148:0/4180817533 wait complete. 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 Processor -- start 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.442+0000 7f7882bc6640 1 -- start start 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7882bc6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f787c1036b0 0x7f787c199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7882bc6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f787c104730 0x7f787c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7882bc6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f787c1050d0 0x7f787c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7882bc6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f787c10f2d0 con 0x7f787c104730 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7882bc6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f787c10f150 con 0x7f787c1036b0 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7882bc6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f787c10f450 con 0x7f787c1050d0 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7873fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f787c104730 0x7f787c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7873fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f787c104730 0x7f787c19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60364/0 (socket says 172.21.15.148:60364) 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7873fff640 1 -- 172.21.15.148:0/2134266092 learned_addr learned my addr 172.21.15.148:0/2134266092 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7880962640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f787c1036b0 0x7f787c199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7873fff640 1 -- 172.21.15.148:0/2134266092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f787c1050d0 msgr2=0x7f787c19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7881163640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f787c1050d0 0x7f787c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7873fff640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f787c1050d0 0x7f787c19b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7873fff640 1 -- 172.21.15.148:0/2134266092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f787c1036b0 msgr2=0x7f787c199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7873fff640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f787c1036b0 0x7f787c199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7873fff640 1 -- 172.21.15.148:0/2134266092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c19b9c0 con 0x7f787c104730 2024-09-21T01:13:54.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7873fff640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f787c104730 0x7f787c19a5f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f786c00d950 tx=0x7f786c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:54.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7871ffb640 1 -- 172.21.15.148:0/2134266092 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c017070 con 0x7f787c104730 2024-09-21T01:13:54.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7871ffb640 1 -- 172.21.15.148:0/2134266092 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f786c009c30 con 0x7f787c104730 2024-09-21T01:13:54.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7871ffb640 1 -- 172.21.15.148:0/2134266092 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c00f620 con 0x7f787c104730 2024-09-21T01:13:54.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.443+0000 7f7882bc6640 1 -- 172.21.15.148:0/2134266092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c19bcb0 con 0x7f787c104730 2024-09-21T01:13:54.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.444+0000 7f7882bc6640 1 -- 172.21.15.148:0/2134266092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c1a23a0 con 0x7f787c104730 2024-09-21T01:13:54.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.444+0000 7f7882bc6640 1 -- 172.21.15.148:0/2134266092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c10a880 con 0x7f787c104730 2024-09-21T01:13:54.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.447+0000 7f7871ffb640 1 -- 172.21.15.148:0/2134266092 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f786c010460 con 0x7f787c104730 2024-09-21T01:13:54.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.447+0000 7f7871ffb640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78640b6620 0x7f78640b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.448+0000 7f7880962640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78640b6620 0x7f78640b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.448+0000 7f7871ffb640 1 -- 172.21.15.148:0/2134266092 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f786c0e6fd0 con 0x7f787c104730 2024-09-21T01:13:54.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.448+0000 7f7880962640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78640b6620 0x7f78640b8b30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7878000c00 tx=0x7f7878031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:54.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.451+0000 7f7871ffb640 1 -- 172.21.15.148:0/2134266092 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f786c0ad830 con 0x7f787c104730 2024-09-21T01:13:54.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:54 smithi148 ceph-mon[31000]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:54.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:54 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2385839370' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T01:13:54.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.689+0000 7f7882bc6640 1 -- 172.21.15.148:0/2134266092 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f787c063960 con 0x7f78640b6620 2024-09-21T01:13:54.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.706+0000 7f7871ffb640 1 -- 172.21.15.148:0/2134266092 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f787c063960 con 0x7f78640b6620 2024-09-21T01:13:54.707 INFO:teuthology.orchestra.run.smithi148.stdout:{} 2024-09-21T01:13:54.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 -- 172.21.15.148:0/2134266092 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78640b6620 msgr2=0x7f78640b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78640b6620 0x7f78640b8b30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7878000c00 tx=0x7f7878031400 comp rx=0 tx=0).stop 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 -- 172.21.15.148:0/2134266092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f787c104730 msgr2=0x7f787c19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f787c104730 0x7f787c19a5f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f786c00d950 tx=0x7f786c00de10 comp rx=0 tx=0).stop 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 -- 172.21.15.148:0/2134266092 shutdown_connections 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f78640b6620 0x7f78640b8b30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f787c104730 0x7f787c19a5f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f787c1050d0 0x7f787c19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 --2- 172.21.15.148:0/2134266092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f787c1036b0 0x7f787c199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 -- 172.21.15.148:0/2134266092 >> 172.21.15.148:0/2134266092 conn(0x7f787c0feff0 msgr2=0x7f787c107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 -- 172.21.15.148:0/2134266092 shutdown_connections 2024-09-21T01:13:54.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.709+0000 7f7882bc6640 1 -- 172.21.15.148:0/2134266092 wait complete. 2024-09-21T01:13:54.721 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T01:13:54.731 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T01:13:54.766 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:13:54.767 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:54 smithi157 ceph-mon[34140]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:54.767 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:54 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2385839370' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T01:13:54.767 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:54 smithi181 ceph-mon[34811]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T01:13:54.767 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:54 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2385839370' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T01:13:54.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.875+0000 7f8403ba1640 1 -- 172.21.15.148:0/3214978511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83fc1040a0 msgr2=0x7f83fc10ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.875+0000 7f8403ba1640 1 --2- 172.21.15.148:0/3214978511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83fc1040a0 0x7f83fc10ab30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009ca0 tx=0x7f83f402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.875+0000 7f8403ba1640 1 -- 172.21.15.148:0/3214978511 shutdown_connections 2024-09-21T01:13:54.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.875+0000 7f8403ba1640 1 --2- 172.21.15.148:0/3214978511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83fc1040a0 0x7f83fc10ab30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.875+0000 7f8403ba1640 1 --2- 172.21.15.148:0/3214978511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83fc103490 0x7f83fc103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.875+0000 7f8403ba1640 1 --2- 172.21.15.148:0/3214978511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83fc102ab0 0x7f83fc102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.875+0000 7f8403ba1640 1 -- 172.21.15.148:0/3214978511 >> 172.21.15.148:0/3214978511 conn(0x7f83fc0fd660 msgr2=0x7f83fc0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:54.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.875+0000 7f8403ba1640 1 -- 172.21.15.148:0/3214978511 shutdown_connections 2024-09-21T01:13:54.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.875+0000 7f8403ba1640 1 -- 172.21.15.148:0/3214978511 wait complete. 2024-09-21T01:13:54.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f8403ba1640 1 Processor -- start 2024-09-21T01:13:54.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f8403ba1640 1 -- start start 2024-09-21T01:13:54.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f8403ba1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83fc102ab0 0x7f83fc198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f8403ba1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83fc103490 0x7f83fc1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f8403ba1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83fc1040a0 0x7f83fc199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f8403ba1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc10e1d0 con 0x7f83fc1040a0 2024-09-21T01:13:54.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f8403ba1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc10e050 con 0x7f83fc103490 2024-09-21T01:13:54.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f8403ba1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc10e350 con 0x7f83fc102ab0 2024-09-21T01:13:54.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f840213e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83fc1040a0 0x7f83fc199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f840213e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83fc1040a0 0x7f83fc199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60410/0 (socket says 172.21.15.148:60410) 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.876+0000 7f840213e640 1 -- 172.21.15.148:0/1260571422 learned_addr learned my addr 172.21.15.148:0/1260571422 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f840113c640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83fc103490 0x7f83fc1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f840193d640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83fc102ab0 0x7f83fc198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f840213e640 1 -- 172.21.15.148:0/1260571422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83fc102ab0 msgr2=0x7f83fc198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f840213e640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83fc102ab0 0x7f83fc198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f840213e640 1 -- 172.21.15.148:0/1260571422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83fc103490 msgr2=0x7f83fc1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f840213e640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83fc103490 0x7f83fc1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f840213e640 1 -- 172.21.15.148:0/1260571422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc19a7a0 con 0x7f83fc1040a0 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f840213e640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83fc1040a0 0x7f83fc199f80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f83f4004af0 tx=0x7f83f4031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f83f2ffd640 1 -- 172.21.15.148:0/1260571422 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f4003b70 con 0x7f83fc1040a0 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f8403ba1640 1 -- 172.21.15.148:0/1260571422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83fc19aa30 con 0x7f83fc1040a0 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f83f2ffd640 1 -- 172.21.15.148:0/1260571422 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83f4003d10 con 0x7f83fc1040a0 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f83f2ffd640 1 -- 172.21.15.148:0/1260571422 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f402fb20 con 0x7f83fc1040a0 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.877+0000 7f8403ba1640 1 -- 172.21.15.148:0/1260571422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83fc1a1180 con 0x7f83fc1040a0 2024-09-21T01:13:54.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.878+0000 7f8403ba1640 1 -- 172.21.15.148:0/1260571422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83fc102ec0 con 0x7f83fc1040a0 2024-09-21T01:13:54.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.881+0000 7f83f2ffd640 1 -- 172.21.15.148:0/1260571422 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f83f4004580 con 0x7f83fc1040a0 2024-09-21T01:13:54.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.881+0000 7f83f2ffd640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f83e80b65a0 0x7f83e80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.882+0000 7f840193d640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f83e80b65a0 0x7f83e80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.882+0000 7f83f2ffd640 1 -- 172.21.15.148:0/1260571422 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f83f4108a60 con 0x7f83fc1040a0 2024-09-21T01:13:54.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.882+0000 7f840193d640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f83e80b65a0 0x7f83e80b8ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009aa0 tx=0x7f83f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:54.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:54.885+0000 7f83f2ffd640 1 -- 172.21.15.148:0/1260571422 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83f40cf1a0 con 0x7f83fc1040a0 2024-09-21T01:13:55.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.062+0000 7f8403ba1640 1 -- 172.21.15.148:0/1260571422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83fc063fc0 con 0x7f83fc1040a0 2024-09-21T01:13:55.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.063+0000 7f83f2ffd640 1 -- 172.21.15.148:0/1260571422 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22837 (secure 0 0 0) 0x7f83f40d3580 con 0x7f83fc1040a0 2024-09-21T01:13:55.064 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:55.064 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":76,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:55.664651+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:13:55.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.065+0000 7f8403ba1640 1 -- 172.21.15.148:0/1260571422 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f83e80b65a0 msgr2=0x7f83e80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.065+0000 7f8403ba1640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f83e80b65a0 0x7f83e80b8ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009aa0 tx=0x7f83f8005f90 comp rx=0 tx=0).stop 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.065+0000 7f8403ba1640 1 -- 172.21.15.148:0/1260571422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83fc1040a0 msgr2=0x7f83fc199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.065+0000 7f8403ba1640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83fc1040a0 0x7f83fc199f80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f83f4004af0 tx=0x7f83f4031700 comp rx=0 tx=0).stop 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.065+0000 7f8403ba1640 1 -- 172.21.15.148:0/1260571422 shutdown_connections 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.065+0000 7f8403ba1640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f83e80b65a0 0x7f83e80b8ab0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.065+0000 7f8403ba1640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83fc1040a0 0x7f83fc199f80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.065+0000 7f8403ba1640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83fc103490 0x7f83fc1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.065+0000 7f8403ba1640 1 --2- 172.21.15.148:0/1260571422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83fc102ab0 0x7f83fc198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.065+0000 7f8403ba1640 1 -- 172.21.15.148:0/1260571422 >> 172.21.15.148:0/1260571422 conn(0x7f83fc0fd660 msgr2=0x7f83fc106b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.066+0000 7f8403ba1640 1 -- 172.21.15.148:0/1260571422 shutdown_connections 2024-09-21T01:13:55.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.066+0000 7f8403ba1640 1 -- 172.21.15.148:0/1260571422 wait complete. 2024-09-21T01:13:55.077 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:13:54 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:13:54.694+0000 7fb856915640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:13:55.077 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:13:54 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:13:54.694+0000 7fb856915640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:13:55.077 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:13:54 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:13:54.694+0000 7fb856915640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:13:55.077 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:13:54 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:13:54.694+0000 7fb856915640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:13:55.077 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:13:54 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x[31228]: 2024-09-21T01:13:54.694+0000 7fb856915640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:13:55.078 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T01:07:42.541158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T01:12:07.562738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T01:12:09.877690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T01:13:55.079 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T01:13:55.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.191+0000 7ff761b8a640 1 -- 172.21.15.148:0/3828297855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff75c1082d0 msgr2=0x7ff75c10a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.191+0000 7ff761b8a640 1 --2- 172.21.15.148:0/3828297855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff75c1082d0 0x7ff75c10a7e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff754009ca0 tx=0x7ff75402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.192+0000 7ff761b8a640 1 -- 172.21.15.148:0/3828297855 shutdown_connections 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.192+0000 7ff761b8a640 1 --2- 172.21.15.148:0/3828297855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff75c1082d0 0x7ff75c10a7e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.192+0000 7ff761b8a640 1 --2- 172.21.15.148:0/3828297855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff75c1056b0 0x7ff75c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.192+0000 7ff761b8a640 1 --2- 172.21.15.148:0/3828297855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff75c102c50 0x7ff75c105070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.192+0000 7ff761b8a640 1 -- 172.21.15.148:0/3828297855 >> 172.21.15.148:0/3828297855 conn(0x7ff75c0fd660 msgr2=0x7ff75c0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.192+0000 7ff761b8a640 1 -- 172.21.15.148:0/3828297855 shutdown_connections 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.192+0000 7ff761b8a640 1 -- 172.21.15.148:0/3828297855 wait complete. 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.192+0000 7ff761b8a640 1 Processor -- start 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.192+0000 7ff761b8a640 1 -- start start 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff761b8a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff75c102c50 0x7ff75c102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff761b8a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff75c1056b0 0x7ff75c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff761b8a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff75c1082d0 0x7ff75c1a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff761b8a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c10e1f0 con 0x7ff75c1082d0 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff761b8a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c10e070 con 0x7ff75c102c50 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff761b8a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c10e370 con 0x7ff75c1056b0 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff75c1082d0 0x7ff75c1a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff75c1082d0 0x7ff75c1a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60434/0 (socket says 172.21.15.148:60434) 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75bfff640 1 -- 172.21.15.148:0/4024751688 learned_addr learned my addr 172.21.15.148:0/4024751688 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75affd640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff75c1056b0 0x7ff75c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75b7fe640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff75c102c50 0x7ff75c102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75bfff640 1 -- 172.21.15.148:0/4024751688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff75c1056b0 msgr2=0x7ff75c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75bfff640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff75c1056b0 0x7ff75c19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75bfff640 1 -- 172.21.15.148:0/4024751688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff75c102c50 msgr2=0x7ff75c102150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75bfff640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff75c102c50 0x7ff75c102150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75bfff640 1 -- 172.21.15.148:0/4024751688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75c1a1970 con 0x7ff75c1082d0 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75b7fe640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff75c102c50 0x7ff75c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff75bfff640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff75c1082d0 0x7ff75c1a1150 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff7540097b0 tx=0x7ff754031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:55.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.193+0000 7ff758ff9640 1 -- 172.21.15.148:0/4024751688 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754003bf0 con 0x7ff75c1082d0 2024-09-21T01:13:55.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.194+0000 7ff758ff9640 1 -- 172.21.15.148:0/4024751688 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff754003d90 con 0x7ff75c1082d0 2024-09-21T01:13:55.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.194+0000 7ff761b8a640 1 -- 172.21.15.148:0/4024751688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75c1a1c00 con 0x7ff75c1082d0 2024-09-21T01:13:55.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.194+0000 7ff758ff9640 1 -- 172.21.15.148:0/4024751688 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75402fc30 con 0x7ff75c1082d0 2024-09-21T01:13:55.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.194+0000 7ff761b8a640 1 -- 172.21.15.148:0/4024751688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff75c1a2150 con 0x7ff75c1082d0 2024-09-21T01:13:55.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.195+0000 7ff761b8a640 1 -- 172.21.15.148:0/4024751688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff75c0ff180 con 0x7ff75c1082d0 2024-09-21T01:13:55.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.196+0000 7ff758ff9640 1 -- 172.21.15.148:0/4024751688 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7ff754004040 con 0x7ff75c1082d0 2024-09-21T01:13:55.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.197+0000 7ff758ff9640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7440b65a0 0x7ff7440b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.197+0000 7ff75b7fe640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7440b65a0 0x7ff7440b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.197+0000 7ff758ff9640 1 -- 172.21.15.148:0/4024751688 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7ff754108ac0 con 0x7ff75c1082d0 2024-09-21T01:13:55.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.198+0000 7ff75b7fe640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7440b65a0 0x7ff7440b8ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0058c0 tx=0x7ff74c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:55.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.200+0000 7ff758ff9640 1 -- 172.21.15.148:0/4024751688 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7540cf200 con 0x7ff75c1082d0 2024-09-21T01:13:55.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:55 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2385839370' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T01:13:55.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:55 smithi148 ceph-mon[31000]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:13:55.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:55 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1260571422' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:55.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.386+0000 7ff761b8a640 1 -- 172.21.15.148:0/4024751688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff75c02e7d0 con 0x7ff75c1082d0 2024-09-21T01:13:55.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.387+0000 7ff758ff9640 1 -- 172.21.15.148:0/4024751688 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7ff7540d35e0 con 0x7ff75c1082d0 2024-09-21T01:13:55.387 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-09-21T01:13:55.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 -- 172.21.15.148:0/4024751688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7440b65a0 msgr2=0x7ff7440b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7440b65a0 0x7ff7440b8ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0058c0 tx=0x7ff74c005850 comp rx=0 tx=0).stop 2024-09-21T01:13:55.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 -- 172.21.15.148:0/4024751688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff75c1082d0 msgr2=0x7ff75c1a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff75c1082d0 0x7ff75c1a1150 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff7540097b0 tx=0x7ff754031840 comp rx=0 tx=0).stop 2024-09-21T01:13:55.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 -- 172.21.15.148:0/4024751688 shutdown_connections 2024-09-21T01:13:55.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7440b65a0 0x7ff7440b8ab0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff75c1082d0 0x7ff75c1a1150 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff75c1056b0 0x7ff75c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 --2- 172.21.15.148:0/4024751688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff75c102c50 0x7ff75c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 -- 172.21.15.148:0/4024751688 >> 172.21.15.148:0/4024751688 conn(0x7ff75c0fd660 msgr2=0x7ff75c103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:55.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 -- 172.21.15.148:0/4024751688 shutdown_connections 2024-09-21T01:13:55.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.389+0000 7ff761b8a640 1 -- 172.21.15.148:0/4024751688 wait complete. 2024-09-21T01:13:55.401 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T01:13:55.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.513+0000 7f24b10fa640 1 -- 172.21.15.148:0/3269864842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ac103fa0 msgr2=0x7f24ac10a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.513+0000 7f24b10fa640 1 --2- 172.21.15.148:0/3269864842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ac103fa0 0x7f24ac10a940 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009ca0 tx=0x7f24a402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.513+0000 7f24b10fa640 1 -- 172.21.15.148:0/3269864842 shutdown_connections 2024-09-21T01:13:55.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.513+0000 7f24b10fa640 1 --2- 172.21.15.148:0/3269864842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ac103fa0 0x7f24ac10a940 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.513+0000 7f24b10fa640 1 --2- 172.21.15.148:0/3269864842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24ac103600 0x7f24ac103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.513+0000 7f24b10fa640 1 --2- 172.21.15.148:0/3269864842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24ac102580 0x7f24ac1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.513+0000 7f24b10fa640 1 -- 172.21.15.148:0/3269864842 >> 172.21.15.148:0/3269864842 conn(0x7f24ac0fdee0 msgr2=0x7f24ac100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:55.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.513+0000 7f24b10fa640 1 -- 172.21.15.148:0/3269864842 shutdown_connections 2024-09-21T01:13:55.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.513+0000 7f24b10fa640 1 -- 172.21.15.148:0/3269864842 wait complete. 2024-09-21T01:13:55.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24b10fa640 1 Processor -- start 2024-09-21T01:13:55.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24b10fa640 1 -- start start 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24b10fa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24ac102580 0x7f24ac06af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24b10fa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ac103600 0x7f24ac19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24b10fa640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24ac103fa0 0x7f24ac1a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24b10fa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac10e1e0 con 0x7f24ac103600 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24b10fa640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac10e060 con 0x7f24ac103fa0 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24b10fa640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac10e360 con 0x7f24ac102580 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24aa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ac103600 0x7f24ac19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24aa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ac103600 0x7f24ac19ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60442/0 (socket says 172.21.15.148:60442) 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24aa59c640 1 -- 172.21.15.148:0/4214245046 learned_addr learned my addr 172.21.15.148:0/4214245046 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24aad9d640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24ac102580 0x7f24ac06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.514+0000 7f24ab59e640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24ac103fa0 0x7f24ac1a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24aa59c640 1 -- 172.21.15.148:0/4214245046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24ac102580 msgr2=0x7f24ac06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24aa59c640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24ac102580 0x7f24ac06af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24aa59c640 1 -- 172.21.15.148:0/4214245046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24ac103fa0 msgr2=0x7f24ac1a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24aa59c640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24ac103fa0 0x7f24ac1a1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24aa59c640 1 -- 172.21.15.148:0/4214245046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac1a1990 con 0x7f24ac103600 2024-09-21T01:13:55.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24aa59c640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ac103600 0x7f24ac19ec20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f249c00d770 tx=0x7f249c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:55.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24a3fff640 1 -- 172.21.15.148:0/4214245046 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c017070 con 0x7f24ac103600 2024-09-21T01:13:55.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24b10fa640 1 -- 172.21.15.148:0/4214245046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ac1a1c80 con 0x7f24ac103600 2024-09-21T01:13:55.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24a3fff640 1 -- 172.21.15.148:0/4214245046 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f249c0054d0 con 0x7f24ac103600 2024-09-21T01:13:55.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24a3fff640 1 -- 172.21.15.148:0/4214245046 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c004c30 con 0x7f24ac103600 2024-09-21T01:13:55.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.515+0000 7f24b10fa640 1 -- 172.21.15.148:0/4214245046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ac1a2180 con 0x7f24ac103600 2024-09-21T01:13:55.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.516+0000 7f24b10fa640 1 -- 172.21.15.148:0/4214245046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ac109730 con 0x7f24ac103600 2024-09-21T01:13:55.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.518+0000 7f24a3fff640 1 -- 172.21.15.148:0/4214245046 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7f249c004dd0 con 0x7f24ac103600 2024-09-21T01:13:55.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.519+0000 7f24a3fff640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24980b65a0 0x7f24980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.519+0000 7f24aad9d640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24980b65a0 0x7f24980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.519+0000 7f24a3fff640 1 -- 172.21.15.148:0/4214245046 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f249c0e72c0 con 0x7f24ac103600 2024-09-21T01:13:55.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.519+0000 7f24aad9d640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24980b65a0 0x7f24980b8ab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2494005d00 tx=0x7f249400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:55.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.522+0000 7f24a3fff640 1 -- 172.21.15.148:0/4214245046 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f249c0ada00 con 0x7f24ac103600 2024-09-21T01:13:55.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.699+0000 7f24b10fa640 1 -- 172.21.15.148:0/4214245046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f24ac02e890 con 0x7f24ac103600 2024-09-21T01:13:55.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.700+0000 7f24a3fff640 1 -- 172.21.15.148:0/4214245046 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) ==== 104+0+11 (secure 0 0 0) 0x7f249c0b1de0 con 0x7f24ac103600 2024-09-21T01:13:55.701 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-09-21T01:13:55.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 -- 172.21.15.148:0/4214245046 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24980b65a0 msgr2=0x7f24980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24980b65a0 0x7f24980b8ab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2494005d00 tx=0x7f249400b410 comp rx=0 tx=0).stop 2024-09-21T01:13:55.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 -- 172.21.15.148:0/4214245046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ac103600 msgr2=0x7f24ac19ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ac103600 0x7f24ac19ec20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f249c00d770 tx=0x7f249c00dc30 comp rx=0 tx=0).stop 2024-09-21T01:13:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 -- 172.21.15.148:0/4214245046 shutdown_connections 2024-09-21T01:13:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f24980b65a0 0x7f24980b8ab0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24ac103600 0x7f24ac19ec20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24ac103fa0 0x7f24ac1a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 --2- 172.21.15.148:0/4214245046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24ac102580 0x7f24ac06af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 -- 172.21.15.148:0/4214245046 >> 172.21.15.148:0/4214245046 conn(0x7f24ac0fdee0 msgr2=0x7f24ac106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 -- 172.21.15.148:0/4214245046 shutdown_connections 2024-09-21T01:13:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.702+0000 7f24b10fa640 1 -- 172.21.15.148:0/4214245046 wait complete. 2024-09-21T01:13:55.715 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T01:13:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:55 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2385839370' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T01:13:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:55 smithi181 ceph-mon[34811]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:13:55.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:55 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1260571422' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:55.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:55 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2385839370' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T01:13:55.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:55 smithi157 ceph-mon[34140]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:13:55.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:55 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1260571422' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:55.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.826+0000 7fe2df04d640 1 -- 172.21.15.148:0/1861435792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d81056b0 msgr2=0x7fe2d8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.826+0000 7fe2df04d640 1 --2- 172.21.15.148:0/1861435792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d81056b0 0x7fe2d8107b90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009900 tx=0x7fe2cc02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:55.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.826+0000 7fe2df04d640 1 -- 172.21.15.148:0/1861435792 shutdown_connections 2024-09-21T01:13:55.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.826+0000 7fe2df04d640 1 --2- 172.21.15.148:0/1861435792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d81056b0 0x7fe2d8107b90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.826+0000 7fe2df04d640 1 --2- 172.21.15.148:0/1861435792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2d81082d0 0x7fe2d810a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.826+0000 7fe2df04d640 1 --2- 172.21.15.148:0/1861435792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2d8102c70 0x7fe2d8105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.826+0000 7fe2df04d640 1 -- 172.21.15.148:0/1861435792 >> 172.21.15.148:0/1861435792 conn(0x7fe2d80fd660 msgr2=0x7fe2d80ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:55.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.826+0000 7fe2df04d640 1 -- 172.21.15.148:0/1861435792 shutdown_connections 2024-09-21T01:13:55.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.826+0000 7fe2df04d640 1 -- 172.21.15.148:0/1861435792 wait complete. 2024-09-21T01:13:55.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2df04d640 1 Processor -- start 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2df04d640 1 -- start start 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2df04d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2d8102c70 0x7fe2d8199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2df04d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d81056b0 0x7fe2d819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2df04d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2d81082d0 0x7fe2d819b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2df04d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d810e1f0 con 0x7fe2d81056b0 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2df04d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d810e070 con 0x7fe2d8102c70 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2df04d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d810e370 con 0x7fe2d81082d0 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d81056b0 0x7fe2d819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d81056b0 0x7fe2d819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60452/0 (socket says 172.21.15.148:60452) 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2d7fff640 1 -- 172.21.15.148:0/1987864491 learned_addr learned my addr 172.21.15.148:0/1987864491 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2dcde9640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2d8102c70 0x7fe2d8199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2dd5ea640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2d81082d0 0x7fe2d819b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2d7fff640 1 -- 172.21.15.148:0/1987864491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2d81082d0 msgr2=0x7fe2d819b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2d7fff640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2d81082d0 0x7fe2d819b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2d7fff640 1 -- 172.21.15.148:0/1987864491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2d8102c70 msgr2=0x7fe2d8199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2d7fff640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2d8102c70 0x7fe2d8199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2d7fff640 1 -- 172.21.15.148:0/1987864491 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d819b970 con 0x7fe2d81056b0 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.827+0000 7fe2dd5ea640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2d81082d0 0x7fe2d819b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.828+0000 7fe2d7fff640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d81056b0 0x7fe2d819a5a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc006010 tx=0x7fe2cc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.828+0000 7fe2d5ffb640 1 -- 172.21.15.148:0/1987864491 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc03f030 con 0x7fe2d81056b0 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.828+0000 7fe2df04d640 1 -- 172.21.15.148:0/1987864491 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d819bc00 con 0x7fe2d81056b0 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.828+0000 7fe2d5ffb640 1 -- 172.21.15.148:0/1987864491 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2cc003aa0 con 0x7fe2d81056b0 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.828+0000 7fe2d5ffb640 1 -- 172.21.15.148:0/1987864491 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc035070 con 0x7fe2d81056b0 2024-09-21T01:13:55.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.828+0000 7fe2df04d640 1 -- 172.21.15.148:0/1987864491 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d819bf10 con 0x7fe2d81056b0 2024-09-21T01:13:55.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.829+0000 7fe2df04d640 1 -- 172.21.15.148:0/1987864491 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d81a23e0 con 0x7fe2d81056b0 2024-09-21T01:13:55.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.831+0000 7fe2d5ffb640 1 -- 172.21.15.148:0/1987864491 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7fe2cc042030 con 0x7fe2d81056b0 2024-09-21T01:13:55.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.832+0000 7fe2d5ffb640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2c00b65a0 0x7fe2c00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:55.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.832+0000 7fe2d5ffb640 1 -- 172.21.15.148:0/1987864491 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fe2cc108250 con 0x7fe2d81056b0 2024-09-21T01:13:55.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.832+0000 7fe2dcde9640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2c00b65a0 0x7fe2c00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:55.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.833+0000 7fe2dcde9640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2c00b65a0 0x7fe2c00b8ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8005fd0 tx=0x7fe2c8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:55.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:55.835+0000 7fe2d5ffb640 1 -- 172.21.15.148:0/1987864491 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2cc0ce930 con 0x7fe2d81056b0 2024-09-21T01:13:56.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.012+0000 7fe2df04d640 1 -- 172.21.15.148:0/1987864491 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2d81a25b0 con 0x7fe2d81056b0 2024-09-21T01:13:56.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.013+0000 7fe2d5ffb640 1 -- 172.21.15.148:0/1987864491 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) ==== 100+0+11 (secure 0 0 0) 0x7fe2cc0d2d10 con 0x7fe2d81056b0 2024-09-21T01:13:56.014 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-09-21T01:13:56.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 -- 172.21.15.148:0/1987864491 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2c00b65a0 msgr2=0x7fe2c00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2c00b65a0 0x7fe2c00b8ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8005fd0 tx=0x7fe2c8005850 comp rx=0 tx=0).stop 2024-09-21T01:13:56.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 -- 172.21.15.148:0/1987864491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d81056b0 msgr2=0x7fe2d819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d81056b0 0x7fe2d819a5a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc006010 tx=0x7fe2cc031a50 comp rx=0 tx=0).stop 2024-09-21T01:13:56.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 -- 172.21.15.148:0/1987864491 shutdown_connections 2024-09-21T01:13:56.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe2c00b65a0 0x7fe2c00b8ab0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d81056b0 0x7fe2d819a5a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2d81082d0 0x7fe2d819b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 --2- 172.21.15.148:0/1987864491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2d8102c70 0x7fe2d8199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 -- 172.21.15.148:0/1987864491 >> 172.21.15.148:0/1987864491 conn(0x7fe2d80fd660 msgr2=0x7fe2d8107890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:56.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 -- 172.21.15.148:0/1987864491 shutdown_connections 2024-09-21T01:13:56.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.015+0000 7fe2df04d640 1 -- 172.21.15.148:0/1987864491 wait complete. 2024-09-21T01:13:56.027 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T01:13:56.028 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:56.277 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:56.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:56 smithi148 ceph-mon[31000]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:56 smithi148 ceph-mon[31000]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:56 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4024751688' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:13:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:56 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4214245046' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:13:56.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:56 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1987864491' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:13:56.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:56 smithi181 ceph-mon[34811]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:56.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:56 smithi181 ceph-mon[34811]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:56.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:56 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/4024751688' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:13:56.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:56 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/4214245046' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:13:56.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:56 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1987864491' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:13:56.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:56 smithi157 ceph-mon[34140]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T01:13:56.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:56 smithi157 ceph-mon[34140]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:56.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:56 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/4024751688' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:13:56.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:56 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/4214245046' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:13:56.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:56 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1987864491' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:13:56.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.744+0000 7ff7e09ef640 1 -- 172.21.15.148:0/973242142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7dc102a60 msgr2=0x7ff7dc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.744+0000 7ff7e09ef640 1 --2- 172.21.15.148:0/973242142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7dc102a60 0x7ff7dc102e70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009ca0 tx=0x7ff7d002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.744+0000 7ff7e09ef640 1 -- 172.21.15.148:0/973242142 shutdown_connections 2024-09-21T01:13:56.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.744+0000 7ff7e09ef640 1 --2- 172.21.15.148:0/973242142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7dc108cf0 0x7ff7dc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.744+0000 7ff7e09ef640 1 --2- 172.21.15.148:0/973242142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7dc1083a0 0x7ff7dc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.744+0000 7ff7e09ef640 1 --2- 172.21.15.148:0/973242142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7dc102a60 0x7ff7dc102e70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.744+0000 7ff7e09ef640 1 -- 172.21.15.148:0/973242142 >> 172.21.15.148:0/973242142 conn(0x7ff7dc079730 msgr2=0x7ff7dc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:56.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.744+0000 7ff7e09ef640 1 -- 172.21.15.148:0/973242142 shutdown_connections 2024-09-21T01:13:56.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.744+0000 7ff7e09ef640 1 -- 172.21.15.148:0/973242142 wait complete. 2024-09-21T01:13:56.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.745+0000 7ff7e09ef640 1 Processor -- start 2024-09-21T01:13:56.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.745+0000 7ff7e09ef640 1 -- start start 2024-09-21T01:13:56.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7e09ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7dc102a60 0x7ff7dc1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:56.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7e09ef640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7dc1083a0 0x7ff7dc199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:56.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7e09ef640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7dc108cf0 0x7ff7dc19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:56.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7e09ef640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc1129c0 con 0x7ff7dc102a60 2024-09-21T01:13:56.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7e09ef640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc112840 con 0x7ff7dc1083a0 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7e09ef640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc112b40 con 0x7ff7dc108cf0 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7da59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7dc102a60 0x7ff7dc1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7da59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7dc102a60 0x7ff7dc1993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51354/0 (socket says 172.21.15.148:51354) 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7da59c640 1 -- 172.21.15.148:0/4274473917 learned_addr learned my addr 172.21.15.148:0/4274473917 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7dad9d640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7dc108cf0 0x7ff7dc19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7d9d9b640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7dc1083a0 0x7ff7dc199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7da59c640 1 -- 172.21.15.148:0/4274473917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7dc108cf0 msgr2=0x7ff7dc19ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7da59c640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7dc108cf0 0x7ff7dc19ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7da59c640 1 -- 172.21.15.148:0/4274473917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7dc1083a0 msgr2=0x7ff7dc199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7da59c640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7dc1083a0 0x7ff7dc199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7da59c640 1 -- 172.21.15.148:0/4274473917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc19f340 con 0x7ff7dc102a60 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.746+0000 7ff7dad9d640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7dc108cf0 0x7ff7dc19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.747+0000 7ff7da59c640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7dc102a60 0x7ff7dc1993d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff7d002ade0 tx=0x7ff7d0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.747+0000 7ff7cb7fe640 1 -- 172.21.15.148:0/4274473917 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0003d60 con 0x7ff7dc102a60 2024-09-21T01:13:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.747+0000 7ff7cb7fe640 1 -- 172.21.15.148:0/4274473917 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7d00044f0 con 0x7ff7dc102a60 2024-09-21T01:13:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.747+0000 7ff7e09ef640 1 -- 172.21.15.148:0/4274473917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7dc19f5d0 con 0x7ff7dc102a60 2024-09-21T01:13:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.747+0000 7ff7cb7fe640 1 -- 172.21.15.148:0/4274473917 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d002fd10 con 0x7ff7dc102a60 2024-09-21T01:13:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.747+0000 7ff7e09ef640 1 -- 172.21.15.148:0/4274473917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7dc1a5d90 con 0x7ff7dc102a60 2024-09-21T01:13:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.748+0000 7ff7e09ef640 1 -- 172.21.15.148:0/4274473917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7dc102e70 con 0x7ff7dc102a60 2024-09-21T01:13:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.750+0000 7ff7cb7fe640 1 -- 172.21.15.148:0/4274473917 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 154564+0+0 (secure 0 0 0) 0x7ff7d00046a0 con 0x7ff7dc102a60 2024-09-21T01:13:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.750+0000 7ff7cb7fe640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7c40b65a0 0x7ff7c40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.750+0000 7ff7d9d9b640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7c40b65a0 0x7ff7c40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.750+0000 7ff7cb7fe640 1 -- 172.21.15.148:0/4274473917 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7ff7d0108c20 con 0x7ff7dc102a60 2024-09-21T01:13:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.751+0000 7ff7d9d9b640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7c40b65a0 0x7ff7c40b8ab0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc100d20 tx=0x7ff7cc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.754+0000 7ff7cb7fe640 1 -- 172.21.15.148:0/4274473917 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7d00cf3f0 con 0x7ff7dc102a60 2024-09-21T01:13:56.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.968+0000 7ff7e09ef640 1 -- 172.21.15.148:0/4274473917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7dc10aaf0 con 0x7ff7dc102a60 2024-09-21T01:13:56.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.969+0000 7ff7cb7fe640 1 -- 172.21.15.148:0/4274473917 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11926 (secure 0 0 0) 0x7ff7d00d37d0 con 0x7ff7dc102a60 2024-09-21T01:13:56.970 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:56.970 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"btime":"2024-09-21T01:13:54:310474+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:13:54.159441+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24631,24646,24665]},"id":1}]} 2024-09-21T01:13:56.970 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-09-21T01:13:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 -- 172.21.15.148:0/4274473917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7c40b65a0 msgr2=0x7ff7c40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7c40b65a0 0x7ff7c40b8ab0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc100d20 tx=0x7ff7cc008040 comp rx=0 tx=0).stop 2024-09-21T01:13:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 -- 172.21.15.148:0/4274473917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7dc102a60 msgr2=0x7ff7dc1993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7dc102a60 0x7ff7dc1993d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff7d002ade0 tx=0x7ff7d0003970 comp rx=0 tx=0).stop 2024-09-21T01:13:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 -- 172.21.15.148:0/4274473917 shutdown_connections 2024-09-21T01:13:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff7c40b65a0 0x7ff7c40b8ab0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7dc108cf0 0x7ff7dc19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7dc1083a0 0x7ff7dc199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 --2- 172.21.15.148:0/4274473917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7dc102a60 0x7ff7dc1993d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 -- 172.21.15.148:0/4274473917 >> 172.21.15.148:0/4274473917 conn(0x7ff7dc079730 msgr2=0x7ff7dc101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 -- 172.21.15.148:0/4274473917 shutdown_connections 2024-09-21T01:13:56.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:56.971+0000 7ff7e09ef640 1 -- 172.21.15.148:0/4274473917 wait complete. 2024-09-21T01:13:57.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:57 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4274473917' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:57.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:57 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/4274473917' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:57.736 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T01:13:57.736 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T01:13:57.736 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:13:57.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:57 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/4274473917' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:57.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.849+0000 7ff5e1463640 1 -- 172.21.15.148:0/146036513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc102580 msgr2=0x7ff5dc1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:57.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.849+0000 7ff5e1463640 1 --2- 172.21.15.148:0/146036513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc102580 0x7ff5dc1029f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009ca0 tx=0x7ff5cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:57.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.849+0000 7ff5e1463640 1 -- 172.21.15.148:0/146036513 shutdown_connections 2024-09-21T01:13:57.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.849+0000 7ff5e1463640 1 --2- 172.21.15.148:0/146036513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5dc103fa0 0x7ff5dc10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:57.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.849+0000 7ff5e1463640 1 --2- 172.21.15.148:0/146036513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5dc103600 0x7ff5dc103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:57.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.849+0000 7ff5e1463640 1 --2- 172.21.15.148:0/146036513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc102580 0x7ff5dc1029f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:57.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.849+0000 7ff5e1463640 1 -- 172.21.15.148:0/146036513 >> 172.21.15.148:0/146036513 conn(0x7ff5dc0fdee0 msgr2=0x7ff5dc100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:57.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.849+0000 7ff5e1463640 1 -- 172.21.15.148:0/146036513 shutdown_connections 2024-09-21T01:13:57.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.849+0000 7ff5e1463640 1 -- 172.21.15.148:0/146036513 wait complete. 2024-09-21T01:13:57.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.849+0000 7ff5e1463640 1 Processor -- start 2024-09-21T01:13:57.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5e1463640 1 -- start start 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5e1463640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc102580 0x7ff5dc06bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5e1463640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5dc103600 0x7ff5dc19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5e1463640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5dc103fa0 0x7ff5dc1a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5e1463640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc10e1d0 con 0x7ff5dc102580 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5e1463640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc10e050 con 0x7ff5dc103600 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5e1463640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc10e350 con 0x7ff5dc103fa0 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5daffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc102580 0x7ff5dc06bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5daffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc102580 0x7ff5dc06bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51364/0 (socket says 172.21.15.148:51364) 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5daffd640 1 -- 172.21.15.148:0/2997270665 learned_addr learned my addr 172.21.15.148:0/2997270665 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5da7fc640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5dc103600 0x7ff5dc19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:57.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5db7fe640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5dc103fa0 0x7ff5dc1a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5daffd640 1 -- 172.21.15.148:0/2997270665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5dc103fa0 msgr2=0x7ff5dc1a1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5daffd640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5dc103fa0 0x7ff5dc1a1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5daffd640 1 -- 172.21.15.148:0/2997270665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5dc103600 msgr2=0x7ff5dc19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5daffd640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5dc103600 0x7ff5dc19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5daffd640 1 -- 172.21.15.148:0/2997270665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc1a1990 con 0x7ff5dc102580 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.850+0000 7ff5da7fc640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5dc103600 0x7ff5dc19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.851+0000 7ff5daffd640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc102580 0x7ff5dc06bcd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc02ade0 tx=0x7ff5cc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.851+0000 7ff5c3fff640 1 -- 172.21.15.148:0/2997270665 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0317c0 con 0x7ff5dc102580 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.851+0000 7ff5c3fff640 1 -- 172.21.15.148:0/2997270665 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5cc0044f0 con 0x7ff5dc102580 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.851+0000 7ff5e1463640 1 -- 172.21.15.148:0/2997270665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5dc1a1c20 con 0x7ff5dc102580 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.851+0000 7ff5c3fff640 1 -- 172.21.15.148:0/2997270665 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc02fd40 con 0x7ff5dc102580 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.851+0000 7ff5e1463640 1 -- 172.21.15.148:0/2997270665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5dc1a2170 con 0x7ff5dc102580 2024-09-21T01:13:57.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.852+0000 7ff5e1463640 1 -- 172.21.15.148:0/2997270665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5dc109750 con 0x7ff5dc102580 2024-09-21T01:13:57.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.853+0000 7ff5c3fff640 1 -- 172.21.15.148:0/2997270665 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7ff5cc004040 con 0x7ff5dc102580 2024-09-21T01:13:57.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.854+0000 7ff5c3fff640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff5c40b65a0 0x7ff5c40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:57.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.854+0000 7ff5c3fff640 1 -- 172.21.15.148:0/2997270665 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7ff5cc108b30 con 0x7ff5dc102580 2024-09-21T01:13:57.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.854+0000 7ff5da7fc640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff5c40b65a0 0x7ff5c40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:57.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.854+0000 7ff5da7fc640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff5c40b65a0 0x7ff5c40b8ab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00058c0 tx=0x7ff5d0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:57.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:57.858+0000 7ff5c3fff640 1 -- 172.21.15.148:0/2997270665 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5cc0cf270 con 0x7ff5dc102580 2024-09-21T01:13:58.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.034+0000 7ff5e1463640 1 -- 172.21.15.148:0/2997270665 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5dc063800 con 0x7ff5c40b65a0 2024-09-21T01:13:58.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.039+0000 7ff5c3fff640 1 -- 172.21.15.148:0/2997270665 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258884 (secure 0 0 0) 0x7ff5dc063800 con 0x7ff5c40b65a0 2024-09-21T01:13:58.042 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:58.043 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.042+0000 7ff5e1463640 1 -- 172.21.15.148:0/2997270665 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff5c40b65a0 msgr2=0x7ff5c40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.042+0000 7ff5e1463640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff5c40b65a0 0x7ff5c40b8ab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00058c0 tx=0x7ff5d0005850 comp rx=0 tx=0).stop 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.042+0000 7ff5e1463640 1 -- 172.21.15.148:0/2997270665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc102580 msgr2=0x7ff5dc06bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.042+0000 7ff5e1463640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc102580 0x7ff5dc06bcd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc02ade0 tx=0x7ff5cc003ba0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.043+0000 7ff5e1463640 1 -- 172.21.15.148:0/2997270665 shutdown_connections 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.043+0000 7ff5e1463640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff5c40b65a0 0x7ff5c40b8ab0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.043+0000 7ff5e1463640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5dc103fa0 0x7ff5dc1a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.043+0000 7ff5e1463640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5dc103600 0x7ff5dc19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.043+0000 7ff5e1463640 1 --2- 172.21.15.148:0/2997270665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5dc102580 0x7ff5dc06bcd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.043+0000 7ff5e1463640 1 -- 172.21.15.148:0/2997270665 >> 172.21.15.148:0/2997270665 conn(0x7ff5dc0fdee0 msgr2=0x7ff5dc106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.043+0000 7ff5e1463640 1 -- 172.21.15.148:0/2997270665 shutdown_connections 2024-09-21T01:13:58.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.043+0000 7ff5e1463640 1 -- 172.21.15.148:0/2997270665 wait complete. 2024-09-21T01:13:58.055 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-21T01:13:56.345736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667188,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":668,"num_read_kb":432,"num_write":299,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":551,"ondisk_log_size":551,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390108,"kb_used_data":11704,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551716,"statfs":{"total":1151940427776,"available":1151540957184,"internally_reserved":0,"allocated":11984896,"data_stored":6735821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6137,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":43,"num_write":10,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002807"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671714+0000","last_change":"2024-09-21T01:12:11.314815+0000","last_active":"2024-09-21T01:12:55.671714+0000","last_peered":"2024-09-21T01:12:55.671714+0000","last_clean":"2024-09-21T01:12:55.671714+0000","last_became_active":"2024-09-21T01:12:11.314139+0000","last_became_peered":"2024-09-21T01:12:11.314139+0000","last_unstale":"2024-09-21T01:12:55.671714+0000","last_undegraded":"2024-09-21T01:12:55.671714+0000","last_fullsized":"2024-09-21T01:12:55.671714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.538846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.551406+0000","last_change":"2024-09-21T01:12:11.309915+0000","last_active":"2024-09-21T01:13:54.551406+0000","last_peered":"2024-09-21T01:13:54.551406+0000","last_clean":"2024-09-21T01:13:54.551406+0000","last_became_active":"2024-09-21T01:12:11.309551+0000","last_became_peered":"2024-09-21T01:12:11.309551+0000","last_unstale":"2024-09-21T01:13:54.551406+0000","last_undegraded":"2024-09-21T01:13:54.551406+0000","last_fullsized":"2024-09-21T01:13:54.551406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.568041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557496+0000","last_change":"2024-09-21T01:12:11.306393+0000","last_active":"2024-09-21T01:13:54.557496+0000","last_peered":"2024-09-21T01:13:54.557496+0000","last_clean":"2024-09-21T01:13:54.557496+0000","last_became_active":"2024-09-21T01:12:11.306035+0000","last_became_peered":"2024-09-21T01:12:11.306035+0000","last_unstale":"2024-09-21T01:13:54.557496+0000","last_undegraded":"2024-09-21T01:13:54.557496+0000","last_fullsized":"2024-09-21T01:13:54.557496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:20.528141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.554699+0000","last_change":"2024-09-21T01:12:11.302339+0000","last_active":"2024-09-21T01:13:54.554699+0000","last_peered":"2024-09-21T01:13:54.554699+0000","last_clean":"2024-09-21T01:13:54.554699+0000","last_became_active":"2024-09-21T01:12:11.301890+0000","last_became_peered":"2024-09-21T01:12:11.301890+0000","last_unstale":"2024-09-21T01:13:54.554699+0000","last_undegraded":"2024-09-21T01:13:54.554699+0000","last_fullsized":"2024-09-21T01:13:54.554699+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:34.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.545070+0000","last_change":"2024-09-21T01:12:11.299171+0000","last_active":"2024-09-21T01:13:54.545070+0000","last_peered":"2024-09-21T01:13:54.545070+0000","last_clean":"2024-09-21T01:13:54.545070+0000","last_became_active":"2024-09-21T01:12:11.298764+0000","last_became_peered":"2024-09-21T01:12:11.298764+0000","last_unstale":"2024-09-21T01:13:54.545070+0000","last_undegraded":"2024-09-21T01:13:54.545070+0000","last_fullsized":"2024-09-21T01:13:54.545070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:02.078587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553317+0000","last_change":"2024-09-21T01:12:11.307909+0000","last_active":"2024-09-21T01:13:54.553317+0000","last_peered":"2024-09-21T01:13:54.553317+0000","last_clean":"2024-09-21T01:13:54.553317+0000","last_became_active":"2024-09-21T01:12:11.307546+0000","last_became_peered":"2024-09-21T01:12:11.307546+0000","last_unstale":"2024-09-21T01:13:54.553317+0000","last_undegraded":"2024-09-21T01:13:54.553317+0000","last_fullsized":"2024-09-21T01:13:54.553317+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:48.683684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553588+0000","last_change":"2024-09-21T01:12:11.309402+0000","last_active":"2024-09-21T01:13:54.553588+0000","last_peered":"2024-09-21T01:13:54.553588+0000","last_clean":"2024-09-21T01:13:54.553588+0000","last_became_active":"2024-09-21T01:12:11.309019+0000","last_became_peered":"2024-09-21T01:12:11.309019+0000","last_unstale":"2024-09-21T01:13:54.553588+0000","last_undegraded":"2024-09-21T01:13:54.553588+0000","last_fullsized":"2024-09-21T01:13:54.553588+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:55.020239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.552164+0000","last_change":"2024-09-21T01:12:11.308589+0000","last_active":"2024-09-21T01:13:54.552164+0000","last_peered":"2024-09-21T01:13:54.552164+0000","last_clean":"2024-09-21T01:13:54.552164+0000","last_became_active":"2024-09-21T01:12:11.308133+0000","last_became_peered":"2024-09-21T01:12:11.308133+0000","last_unstale":"2024-09-21T01:13:54.552164+0000","last_undegraded":"2024-09-21T01:13:54.552164+0000","last_fullsized":"2024-09-21T01:13:54.552164+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:15.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556124+0000","last_change":"2024-09-21T01:12:55.681017+0000","last_active":"2024-09-21T01:13:54.556124+0000","last_peered":"2024-09-21T01:13:54.556124+0000","last_clean":"2024-09-21T01:13:54.556124+0000","last_became_active":"2024-09-21T01:12:55.680594+0000","last_became_peered":"2024-09-21T01:12:55.680594+0000","last_unstale":"2024-09-21T01:13:54.556124+0000","last_undegraded":"2024-09-21T01:13:54.556124+0000","last_fullsized":"2024-09-21T01:13:54.556124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.847129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553601+0000","last_change":"2024-09-21T01:12:11.311426+0000","last_active":"2024-09-21T01:13:54.553601+0000","last_peered":"2024-09-21T01:13:54.553601+0000","last_clean":"2024-09-21T01:13:54.553601+0000","last_became_active":"2024-09-21T01:12:11.309351+0000","last_became_peered":"2024-09-21T01:12:11.309351+0000","last_unstale":"2024-09-21T01:13:54.553601+0000","last_undegraded":"2024-09-21T01:13:54.553601+0000","last_fullsized":"2024-09-21T01:13:54.553601+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:31.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.562551+0000","last_change":"2024-09-21T01:12:11.312171+0000","last_active":"2024-09-21T01:13:54.562551+0000","last_peered":"2024-09-21T01:13:54.562551+0000","last_clean":"2024-09-21T01:13:54.562551+0000","last_became_active":"2024-09-21T01:12:11.311542+0000","last_became_peered":"2024-09-21T01:12:11.311542+0000","last_unstale":"2024-09-21T01:13:54.562551+0000","last_undegraded":"2024-09-21T01:13:54.562551+0000","last_fullsized":"2024-09-21T01:13:54.562551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:13.257463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.554226+0000","last_change":"2024-09-21T01:12:11.301344+0000","last_active":"2024-09-21T01:13:54.554226+0000","last_peered":"2024-09-21T01:13:54.554226+0000","last_clean":"2024-09-21T01:13:54.554226+0000","last_became_active":"2024-09-21T01:12:11.300593+0000","last_became_peered":"2024-09-21T01:12:11.300593+0000","last_unstale":"2024-09-21T01:13:54.554226+0000","last_undegraded":"2024-09-21T01:13:54.554226+0000","last_fullsized":"2024-09-21T01:13:54.554226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:12.659972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823191+0000","last_change":"2024-09-21T01:12:11.298690+0000","last_active":"2024-09-21T01:12:55.823191+0000","last_peered":"2024-09-21T01:12:55.823191+0000","last_clean":"2024-09-21T01:12:55.823191+0000","last_became_active":"2024-09-21T01:12:11.298418+0000","last_became_peered":"2024-09-21T01:12:11.298418+0000","last_unstale":"2024-09-21T01:12:55.823191+0000","last_undegraded":"2024-09-21T01:12:55.823191+0000","last_fullsized":"2024-09-21T01:12:55.823191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:08.311791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557890+0000","last_change":"2024-09-21T01:12:11.299382+0000","last_active":"2024-09-21T01:13:54.557890+0000","last_peered":"2024-09-21T01:13:54.557890+0000","last_clean":"2024-09-21T01:13:54.557890+0000","last_became_active":"2024-09-21T01:12:11.298428+0000","last_became_peered":"2024-09-21T01:12:11.298428+0000","last_unstale":"2024-09-21T01:13:54.557890+0000","last_undegraded":"2024-09-21T01:13:54.557890+0000","last_fullsized":"2024-09-21T01:13:54.557890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:02.472994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557508+0000","last_change":"2024-09-21T01:12:11.305018+0000","last_active":"2024-09-21T01:13:54.557508+0000","last_peered":"2024-09-21T01:13:54.557508+0000","last_clean":"2024-09-21T01:13:54.557508+0000","last_became_active":"2024-09-21T01:12:11.304607+0000","last_became_peered":"2024-09-21T01:12:11.304607+0000","last_unstale":"2024-09-21T01:13:54.557508+0000","last_undegraded":"2024-09-21T01:13:54.557508+0000","last_fullsized":"2024-09-21T01:13:54.557508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:39.552633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.327961+0000","last_change":"2024-09-21T01:12:11.308846+0000","last_active":"2024-09-21T01:12:56.327961+0000","last_peered":"2024-09-21T01:12:56.327961+0000","last_clean":"2024-09-21T01:12:56.327961+0000","last_became_active":"2024-09-21T01:12:11.308486+0000","last_became_peered":"2024-09-21T01:12:11.308486+0000","last_unstale":"2024-09-21T01:12:56.327961+0000","last_undegraded":"2024-09-21T01:12:56.327961+0000","last_fullsized":"2024-09-21T01:12:56.327961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:29.072947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671796+0000","last_change":"2024-09-21T01:12:11.316277+0000","last_active":"2024-09-21T01:12:55.671796+0000","last_peered":"2024-09-21T01:12:55.671796+0000","last_clean":"2024-09-21T01:12:55.671796+0000","last_became_active":"2024-09-21T01:12:11.315364+0000","last_became_peered":"2024-09-21T01:12:11.315364+0000","last_unstale":"2024-09-21T01:12:55.671796+0000","last_undegraded":"2024-09-21T01:12:55.671796+0000","last_fullsized":"2024-09-21T01:12:55.671796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:50.281556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.561432+0000","last_change":"2024-09-21T01:12:11.300761+0000","last_active":"2024-09-21T01:13:54.561432+0000","last_peered":"2024-09-21T01:13:54.561432+0000","last_clean":"2024-09-21T01:13:54.561432+0000","last_became_active":"2024-09-21T01:12:11.300343+0000","last_became_peered":"2024-09-21T01:12:11.300343+0000","last_unstale":"2024-09-21T01:13:54.561432+0000","last_undegraded":"2024-09-21T01:13:54.561432+0000","last_fullsized":"2024-09-21T01:13:54.561432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:29.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674595+0000","last_change":"2024-09-21T01:12:11.305370+0000","last_active":"2024-09-21T01:12:55.674595+0000","last_peered":"2024-09-21T01:12:55.674595+0000","last_clean":"2024-09-21T01:12:55.674595+0000","last_became_active":"2024-09-21T01:12:11.304991+0000","last_became_peered":"2024-09-21T01:12:11.304991+0000","last_unstale":"2024-09-21T01:12:55.674595+0000","last_undegraded":"2024-09-21T01:12:55.674595+0000","last_fullsized":"2024-09-21T01:12:55.674595+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:12.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671227+0000","last_change":"2024-09-21T01:12:11.303981+0000","last_active":"2024-09-21T01:12:55.671227+0000","last_peered":"2024-09-21T01:12:55.671227+0000","last_clean":"2024-09-21T01:12:55.671227+0000","last_became_active":"2024-09-21T01:12:11.303602+0000","last_became_peered":"2024-09-21T01:12:11.303602+0000","last_unstale":"2024-09-21T01:12:55.671227+0000","last_undegraded":"2024-09-21T01:12:55.671227+0000","last_fullsized":"2024-09-21T01:12:55.671227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:24.513365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823170+0000","last_change":"2024-09-21T01:12:11.302849+0000","last_active":"2024-09-21T01:12:55.823170+0000","last_peered":"2024-09-21T01:12:55.823170+0000","last_clean":"2024-09-21T01:12:55.823170+0000","last_became_active":"2024-09-21T01:12:11.302487+0000","last_became_peered":"2024-09-21T01:12:11.302487+0000","last_unstale":"2024-09-21T01:12:55.823170+0000","last_undegraded":"2024-09-21T01:12:55.823170+0000","last_fullsized":"2024-09-21T01:12:55.823170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:44.174213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328126+0000","last_change":"2024-09-21T01:12:11.315578+0000","last_active":"2024-09-21T01:12:56.328126+0000","last_peered":"2024-09-21T01:12:56.328126+0000","last_clean":"2024-09-21T01:12:56.328126+0000","last_became_active":"2024-09-21T01:12:11.315174+0000","last_became_peered":"2024-09-21T01:12:11.315174+0000","last_unstale":"2024-09-21T01:12:56.328126+0000","last_undegraded":"2024-09-21T01:12:56.328126+0000","last_fullsized":"2024-09-21T01:12:56.328126+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:46.172101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556898+0000","last_change":"2024-09-21T01:12:11.308086+0000","last_active":"2024-09-21T01:13:54.556898+0000","last_peered":"2024-09-21T01:13:54.556898+0000","last_clean":"2024-09-21T01:13:54.556898+0000","last_became_active":"2024-09-21T01:12:11.307248+0000","last_became_peered":"2024-09-21T01:12:11.307248+0000","last_unstale":"2024-09-21T01:13:54.556898+0000","last_undegraded":"2024-09-21T01:13:54.556898+0000","last_fullsized":"2024-09-21T01:13:54.556898+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:11.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553469+0000","last_change":"2024-09-21T01:12:11.301672+0000","last_active":"2024-09-21T01:13:54.553469+0000","last_peered":"2024-09-21T01:13:54.553469+0000","last_clean":"2024-09-21T01:13:54.553469+0000","last_became_active":"2024-09-21T01:12:11.298775+0000","last_became_peered":"2024-09-21T01:12:11.298775+0000","last_unstale":"2024-09-21T01:13:54.553469+0000","last_undegraded":"2024-09-21T01:13:54.553469+0000","last_fullsized":"2024-09-21T01:13:54.553469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:30.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.547049+0000","last_change":"2024-09-21T01:12:11.311947+0000","last_active":"2024-09-21T01:13:54.547049+0000","last_peered":"2024-09-21T01:13:54.547049+0000","last_clean":"2024-09-21T01:13:54.547049+0000","last_became_active":"2024-09-21T01:12:11.311616+0000","last_became_peered":"2024-09-21T01:12:11.311616+0000","last_unstale":"2024-09-21T01:13:54.547049+0000","last_undegraded":"2024-09-21T01:13:54.547049+0000","last_fullsized":"2024-09-21T01:13:54.547049+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:25.727807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675065+0000","last_change":"2024-09-21T01:12:11.312161+0000","last_active":"2024-09-21T01:12:55.675065+0000","last_peered":"2024-09-21T01:12:55.675065+0000","last_clean":"2024-09-21T01:12:55.675065+0000","last_became_active":"2024-09-21T01:12:11.311781+0000","last_became_peered":"2024-09-21T01:12:11.311781+0000","last_unstale":"2024-09-21T01:12:55.675065+0000","last_undegraded":"2024-09-21T01:12:55.675065+0000","last_fullsized":"2024-09-21T01:12:55.675065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:01.923801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671385+0000","last_change":"2024-09-21T01:12:11.310698+0000","last_active":"2024-09-21T01:12:55.671385+0000","last_peered":"2024-09-21T01:12:55.671385+0000","last_clean":"2024-09-21T01:12:55.671385+0000","last_became_active":"2024-09-21T01:12:11.310226+0000","last_became_peered":"2024-09-21T01:12:11.310226+0000","last_unstale":"2024-09-21T01:12:55.671385+0000","last_undegraded":"2024-09-21T01:12:55.671385+0000","last_fullsized":"2024-09-21T01:12:55.671385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:27.428457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823133+0000","last_change":"2024-09-21T01:12:11.294598+0000","last_active":"2024-09-21T01:12:55.823133+0000","last_peered":"2024-09-21T01:12:55.823133+0000","last_clean":"2024-09-21T01:12:55.823133+0000","last_became_active":"2024-09-21T01:12:11.293899+0000","last_became_peered":"2024-09-21T01:12:11.293899+0000","last_unstale":"2024-09-21T01:12:55.823133+0000","last_undegraded":"2024-09-21T01:12:55.823133+0000","last_fullsized":"2024-09-21T01:12:55.823133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.843199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556669+0000","last_change":"2024-09-21T01:12:11.295143+0000","last_active":"2024-09-21T01:13:54.556669+0000","last_peered":"2024-09-21T01:13:54.556669+0000","last_clean":"2024-09-21T01:13:54.556669+0000","last_became_active":"2024-09-21T01:12:11.294787+0000","last_became_peered":"2024-09-21T01:12:11.294787+0000","last_unstale":"2024-09-21T01:13:54.556669+0000","last_undegraded":"2024-09-21T01:13:54.556669+0000","last_fullsized":"2024-09-21T01:13:54.556669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:34.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679505+0000","last_change":"2024-09-21T01:12:55.679399+0000","last_active":"2024-09-21T01:12:55.679505+0000","last_peered":"2024-09-21T01:12:55.679505+0000","last_clean":"2024-09-21T01:12:55.679505+0000","last_became_active":"2024-09-21T01:12:55.678933+0000","last_became_peered":"2024-09-21T01:12:55.678933+0000","last_unstale":"2024-09-21T01:12:55.679505+0000","last_undegraded":"2024-09-21T01:12:55.679505+0000","last_fullsized":"2024-09-21T01:12:55.679505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:20.204715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.680830+0000","last_change":"2024-09-21T01:12:55.680711+0000","last_active":"2024-09-21T01:12:55.680830+0000","last_peered":"2024-09-21T01:12:55.680830+0000","last_clean":"2024-09-21T01:12:55.680830+0000","last_became_active":"2024-09-21T01:12:55.680257+0000","last_became_peered":"2024-09-21T01:12:55.680257+0000","last_unstale":"2024-09-21T01:12:55.680830+0000","last_undegraded":"2024-09-21T01:12:55.680830+0000","last_fullsized":"2024-09-21T01:12:55.680830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:03.610951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671133+0000","last_change":"2024-09-21T01:12:11.308355+0000","last_active":"2024-09-21T01:12:55.671133+0000","last_peered":"2024-09-21T01:12:55.671133+0000","last_clean":"2024-09-21T01:12:55.671133+0000","last_became_active":"2024-09-21T01:12:11.307919+0000","last_became_peered":"2024-09-21T01:12:11.307919+0000","last_unstale":"2024-09-21T01:12:55.671133+0000","last_undegraded":"2024-09-21T01:12:55.671133+0000","last_fullsized":"2024-09-21T01:12:55.671133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:59.869646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.561785+0000","last_change":"2024-09-21T01:12:11.298905+0000","last_active":"2024-09-21T01:13:54.561785+0000","last_peered":"2024-09-21T01:13:54.561785+0000","last_clean":"2024-09-21T01:13:54.561785+0000","last_became_active":"2024-09-21T01:12:11.298512+0000","last_became_peered":"2024-09-21T01:12:11.298512+0000","last_unstale":"2024-09-21T01:13:54.561785+0000","last_undegraded":"2024-09-21T01:13:54.561785+0000","last_fullsized":"2024-09-21T01:13:54.561785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:05.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":125,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.422905+0000","last_change":"2024-09-21T01:12:09.294881+0000","last_active":"2024-09-21T01:13:54.422905+0000","last_peered":"2024-09-21T01:13:54.422905+0000","last_clean":"2024-09-21T01:13:54.422905+0000","last_became_active":"2024-09-21T01:12:09.294513+0000","last_became_peered":"2024-09-21T01:12:09.294513+0000","last_unstale":"2024-09-21T01:13:54.422905+0000","last_undegraded":"2024-09-21T01:13:54.422905+0000","last_fullsized":"2024-09-21T01:13:54.422905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:07.193879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.563814+0000","last_change":"2024-09-21T01:12:55.676259+0000","last_active":"2024-09-21T01:13:54.563814+0000","last_peered":"2024-09-21T01:13:54.563814+0000","last_clean":"2024-09-21T01:13:54.563814+0000","last_became_active":"2024-09-21T01:12:55.675810+0000","last_became_peered":"2024-09-21T01:12:55.675810+0000","last_unstale":"2024-09-21T01:13:54.563814+0000","last_undegraded":"2024-09-21T01:13:54.563814+0000","last_fullsized":"2024-09-21T01:13:54.563814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:34.985195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669122+0000","last_change":"2024-09-21T01:12:09.298594+0000","last_active":"2024-09-21T01:12:55.669122+0000","last_peered":"2024-09-21T01:12:55.669122+0000","last_clean":"2024-09-21T01:12:55.669122+0000","last_became_active":"2024-09-21T01:12:09.298130+0000","last_became_peered":"2024-09-21T01:12:09.298130+0000","last_unstale":"2024-09-21T01:12:55.669122+0000","last_undegraded":"2024-09-21T01:12:55.669122+0000","last_fullsized":"2024-09-21T01:12:55.669122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.964507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822858+0000","last_change":"2024-09-21T01:12:09.295997+0000","last_active":"2024-09-21T01:12:55.822858+0000","last_peered":"2024-09-21T01:12:55.822858+0000","last_clean":"2024-09-21T01:12:55.822858+0000","last_became_active":"2024-09-21T01:12:09.295472+0000","last_became_peered":"2024-09-21T01:12:09.295472+0000","last_unstale":"2024-09-21T01:12:55.822858+0000","last_undegraded":"2024-09-21T01:12:55.822858+0000","last_fullsized":"2024-09-21T01:12:55.822858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:25.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557274+0000","last_change":"2024-09-21T01:12:11.306468+0000","last_active":"2024-09-21T01:13:54.557274+0000","last_peered":"2024-09-21T01:13:54.557274+0000","last_clean":"2024-09-21T01:13:54.557274+0000","last_became_active":"2024-09-21T01:12:11.304186+0000","last_became_peered":"2024-09-21T01:12:11.304186+0000","last_unstale":"2024-09-21T01:13:54.557274+0000","last_undegraded":"2024-09-21T01:13:54.557274+0000","last_fullsized":"2024-09-21T01:13:54.557274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:28.564879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.678732+0000","last_change":"2024-09-21T01:12:09.295004+0000","last_active":"2024-09-21T01:12:55.678732+0000","last_peered":"2024-09-21T01:12:55.678732+0000","last_clean":"2024-09-21T01:12:55.678732+0000","last_became_active":"2024-09-21T01:12:09.294655+0000","last_became_peered":"2024-09-21T01:12:09.294655+0000","last_unstale":"2024-09-21T01:12:55.678732+0000","last_undegraded":"2024-09-21T01:12:55.678732+0000","last_fullsized":"2024-09-21T01:12:55.678732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:35.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.562576+0000","last_change":"2024-09-21T01:12:11.304252+0000","last_active":"2024-09-21T01:13:54.562576+0000","last_peered":"2024-09-21T01:13:54.562576+0000","last_clean":"2024-09-21T01:13:54.562576+0000","last_became_active":"2024-09-21T01:12:11.303876+0000","last_became_peered":"2024-09-21T01:12:11.303876+0000","last_unstale":"2024-09-21T01:13:54.562576+0000","last_undegraded":"2024-09-21T01:13:54.562576+0000","last_fullsized":"2024-09-21T01:13:54.562576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:48.460538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:53.420796+0000","last_change":"2024-09-21T01:12:09.298976+0000","last_active":"2024-09-21T01:13:53.420796+0000","last_peered":"2024-09-21T01:13:53.420796+0000","last_clean":"2024-09-21T01:13:53.420796+0000","last_became_active":"2024-09-21T01:12:09.298664+0000","last_became_peered":"2024-09-21T01:12:09.298664+0000","last_unstale":"2024-09-21T01:13:53.420796+0000","last_undegraded":"2024-09-21T01:13:53.420796+0000","last_fullsized":"2024-09-21T01:13:53.420796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:58.157391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328582+0000","last_change":"2024-09-21T01:12:11.313400+0000","last_active":"2024-09-21T01:12:56.328582+0000","last_peered":"2024-09-21T01:12:56.328582+0000","last_clean":"2024-09-21T01:12:56.328582+0000","last_became_active":"2024-09-21T01:12:11.312940+0000","last_became_peered":"2024-09-21T01:12:11.312940+0000","last_unstale":"2024-09-21T01:12:56.328582+0000","last_undegraded":"2024-09-21T01:12:56.328582+0000","last_fullsized":"2024-09-21T01:12:56.328582+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:22.224157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674784+0000","last_change":"2024-09-21T01:12:09.299266+0000","last_active":"2024-09-21T01:12:55.674784+0000","last_peered":"2024-09-21T01:12:55.674784+0000","last_clean":"2024-09-21T01:12:55.674784+0000","last_became_active":"2024-09-21T01:12:09.298932+0000","last_became_peered":"2024-09-21T01:12:09.298932+0000","last_unstale":"2024-09-21T01:12:55.674784+0000","last_undegraded":"2024-09-21T01:12:55.674784+0000","last_fullsized":"2024-09-21T01:12:55.674784+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:51.546829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.552612+0000","last_change":"2024-09-21T01:12:55.681618+0000","last_active":"2024-09-21T01:13:54.552612+0000","last_peered":"2024-09-21T01:13:54.552612+0000","last_clean":"2024-09-21T01:13:54.552612+0000","last_became_active":"2024-09-21T01:12:55.681211+0000","last_became_peered":"2024-09-21T01:12:55.681211+0000","last_unstale":"2024-09-21T01:13:54.552612+0000","last_undegraded":"2024-09-21T01:13:54.552612+0000","last_fullsized":"2024-09-21T01:13:54.552612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:24.588338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679447+0000","last_change":"2024-09-21T01:12:09.511908+0000","last_active":"2024-09-21T01:12:55.679447+0000","last_peered":"2024-09-21T01:12:55.679447+0000","last_clean":"2024-09-21T01:12:55.679447+0000","last_became_active":"2024-09-21T01:12:09.511550+0000","last_became_peered":"2024-09-21T01:12:09.511550+0000","last_unstale":"2024-09-21T01:12:55.679447+0000","last_undegraded":"2024-09-21T01:12:55.679447+0000","last_fullsized":"2024-09-21T01:12:55.679447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:08.743648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328216+0000","last_change":"2024-09-21T01:12:11.316005+0000","last_active":"2024-09-21T01:12:56.328216+0000","last_peered":"2024-09-21T01:12:56.328216+0000","last_clean":"2024-09-21T01:12:56.328216+0000","last_became_active":"2024-09-21T01:12:11.315245+0000","last_became_peered":"2024-09-21T01:12:11.315245+0000","last_unstale":"2024-09-21T01:12:56.328216+0000","last_undegraded":"2024-09-21T01:12:56.328216+0000","last_fullsized":"2024-09-21T01:12:56.328216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:50.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'36","reported_seq":257,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.565332+0000","last_change":"2024-09-21T01:12:09.300010+0000","last_active":"2024-09-21T01:13:54.565332+0000","last_peered":"2024-09-21T01:13:54.565332+0000","last_clean":"2024-09-21T01:13:54.565332+0000","last_became_active":"2024-09-21T01:12:09.299652+0000","last_became_peered":"2024-09-21T01:12:09.299652+0000","last_unstale":"2024-09-21T01:13:54.565332+0000","last_undegraded":"2024-09-21T01:13:54.565332+0000","last_fullsized":"2024-09-21T01:13:54.565332+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:18.610597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71745,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":164,"num_write":37,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.545083+0000","last_change":"2024-09-21T01:12:11.308675+0000","last_active":"2024-09-21T01:13:54.545083+0000","last_peered":"2024-09-21T01:13:54.545083+0000","last_clean":"2024-09-21T01:13:54.545083+0000","last_became_active":"2024-09-21T01:12:11.308317+0000","last_became_peered":"2024-09-21T01:12:11.308317+0000","last_unstale":"2024-09-21T01:13:54.545083+0000","last_undegraded":"2024-09-21T01:13:54.545083+0000","last_fullsized":"2024-09-21T01:13:54.545083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:56.081404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673306+0000","last_change":"2024-09-21T01:12:09.293716+0000","last_active":"2024-09-21T01:12:55.673306+0000","last_peered":"2024-09-21T01:12:55.673306+0000","last_clean":"2024-09-21T01:12:55.673306+0000","last_became_active":"2024-09-21T01:12:09.293205+0000","last_became_peered":"2024-09-21T01:12:09.293205+0000","last_unstale":"2024-09-21T01:12:55.673306+0000","last_undegraded":"2024-09-21T01:12:55.673306+0000","last_fullsized":"2024-09-21T01:12:55.673306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:29.955953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822913+0000","last_change":"2024-09-21T01:12:11.302736+0000","last_active":"2024-09-21T01:12:55.822913+0000","last_peered":"2024-09-21T01:12:55.822913+0000","last_clean":"2024-09-21T01:12:55.822913+0000","last_became_active":"2024-09-21T01:12:11.302357+0000","last_became_peered":"2024-09-21T01:12:11.302357+0000","last_unstale":"2024-09-21T01:12:55.822913+0000","last_undegraded":"2024-09-21T01:12:55.822913+0000","last_fullsized":"2024-09-21T01:12:55.822913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:34.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.677786+0000","last_change":"2024-09-21T01:12:09.295258+0000","last_active":"2024-09-21T01:12:55.677786+0000","last_peered":"2024-09-21T01:12:55.677786+0000","last_clean":"2024-09-21T01:12:55.677786+0000","last_became_active":"2024-09-21T01:12:09.294872+0000","last_became_peered":"2024-09-21T01:12:09.294872+0000","last_unstale":"2024-09-21T01:12:55.677786+0000","last_undegraded":"2024-09-21T01:12:55.677786+0000","last_fullsized":"2024-09-21T01:12:55.677786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.216960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557603+0000","last_change":"2024-09-21T01:12:11.303413+0000","last_active":"2024-09-21T01:13:54.557603+0000","last_peered":"2024-09-21T01:13:54.557603+0000","last_clean":"2024-09-21T01:13:54.557603+0000","last_became_active":"2024-09-21T01:12:11.303002+0000","last_became_peered":"2024-09-21T01:12:11.303002+0000","last_unstale":"2024-09-21T01:13:54.557603+0000","last_undegraded":"2024-09-21T01:13:54.557603+0000","last_fullsized":"2024-09-21T01:13:54.557603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:55.984699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'7","reported_seq":130,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:55.424886+0000","last_change":"2024-09-21T01:12:09.297392+0000","last_active":"2024-09-21T01:13:55.424886+0000","last_peered":"2024-09-21T01:13:55.424886+0000","last_clean":"2024-09-21T01:13:55.424886+0000","last_became_active":"2024-09-21T01:12:09.296882+0000","last_became_peered":"2024-09-21T01:12:09.296882+0000","last_unstale":"2024-09-21T01:13:55.424886+0000","last_undegraded":"2024-09-21T01:13:55.424886+0000","last_fullsized":"2024-09-21T01:13:55.424886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.598362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1819,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.555500+0000","last_change":"2024-09-21T01:12:11.308021+0000","last_active":"2024-09-21T01:13:54.555500+0000","last_peered":"2024-09-21T01:13:54.555500+0000","last_clean":"2024-09-21T01:13:54.555500+0000","last_became_active":"2024-09-21T01:12:11.307643+0000","last_became_peered":"2024-09-21T01:12:11.307643+0000","last_unstale":"2024-09-21T01:13:54.555500+0000","last_undegraded":"2024-09-21T01:13:54.555500+0000","last_fullsized":"2024-09-21T01:13:54.555500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:55.569855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674898+0000","last_change":"2024-09-21T01:12:09.512120+0000","last_active":"2024-09-21T01:12:55.674898+0000","last_peered":"2024-09-21T01:12:55.674898+0000","last_clean":"2024-09-21T01:12:55.674898+0000","last_became_active":"2024-09-21T01:12:09.511631+0000","last_became_peered":"2024-09-21T01:12:09.511631+0000","last_unstale":"2024-09-21T01:12:55.674898+0000","last_undegraded":"2024-09-21T01:12:55.674898+0000","last_fullsized":"2024-09-21T01:12:55.674898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:13.187219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558542+0000","last_change":"2024-09-21T01:12:11.301633+0000","last_active":"2024-09-21T01:13:54.558542+0000","last_peered":"2024-09-21T01:13:54.558542+0000","last_clean":"2024-09-21T01:13:54.558542+0000","last_became_active":"2024-09-21T01:12:11.300638+0000","last_became_peered":"2024-09-21T01:12:11.300638+0000","last_unstale":"2024-09-21T01:13:54.558542+0000","last_undegraded":"2024-09-21T01:13:54.558542+0000","last_fullsized":"2024-09-21T01:13:54.558542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:42.245596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676122+0000","last_change":"2024-09-21T01:12:09.297694+0000","last_active":"2024-09-21T01:12:55.676122+0000","last_peered":"2024-09-21T01:12:55.676122+0000","last_clean":"2024-09-21T01:12:55.676122+0000","last_became_active":"2024-09-21T01:12:09.297127+0000","last_became_peered":"2024-09-21T01:12:09.297127+0000","last_unstale":"2024-09-21T01:12:55.676122+0000","last_undegraded":"2024-09-21T01:12:55.676122+0000","last_fullsized":"2024-09-21T01:12:55.676122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:35.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671386+0000","last_change":"2024-09-21T01:12:11.303510+0000","last_active":"2024-09-21T01:12:55.671386+0000","last_peered":"2024-09-21T01:12:55.671386+0000","last_clean":"2024-09-21T01:12:55.671386+0000","last_became_active":"2024-09-21T01:12:11.303148+0000","last_became_peered":"2024-09-21T01:12:11.303148+0000","last_unstale":"2024-09-21T01:12:55.671386+0000","last_undegraded":"2024-09-21T01:12:55.671386+0000","last_fullsized":"2024-09-21T01:12:55.671386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:59.338185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823115+0000","last_change":"2024-09-21T01:12:09.293490+0000","last_active":"2024-09-21T01:12:55.823115+0000","last_peered":"2024-09-21T01:12:55.823115+0000","last_clean":"2024-09-21T01:12:55.823115+0000","last_became_active":"2024-09-21T01:12:09.293151+0000","last_became_peered":"2024-09-21T01:12:09.293151+0000","last_unstale":"2024-09-21T01:12:55.823115+0000","last_undegraded":"2024-09-21T01:12:55.823115+0000","last_fullsized":"2024-09-21T01:12:55.823115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:25.153547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558538+0000","last_change":"2024-09-21T01:12:11.311313+0000","last_active":"2024-09-21T01:13:54.558538+0000","last_peered":"2024-09-21T01:13:54.558538+0000","last_clean":"2024-09-21T01:13:54.558538+0000","last_became_active":"2024-09-21T01:12:11.310908+0000","last_became_peered":"2024-09-21T01:12:11.310908+0000","last_unstale":"2024-09-21T01:13:54.558538+0000","last_undegraded":"2024-09-21T01:13:54.558538+0000","last_fullsized":"2024-09-21T01:13:54.558538+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:15.070802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679574+0000","last_change":"2024-09-21T01:12:09.298861+0000","last_active":"2024-09-21T01:12:55.679574+0000","last_peered":"2024-09-21T01:12:55.679574+0000","last_clean":"2024-09-21T01:12:55.679574+0000","last_became_active":"2024-09-21T01:12:09.298504+0000","last_became_peered":"2024-09-21T01:12:09.298504+0000","last_unstale":"2024-09-21T01:12:55.679574+0000","last_undegraded":"2024-09-21T01:12:55.679574+0000","last_fullsized":"2024-09-21T01:12:55.679574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:10.446269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559575+0000","last_change":"2024-09-21T01:12:11.309656+0000","last_active":"2024-09-21T01:13:54.559575+0000","last_peered":"2024-09-21T01:13:54.559575+0000","last_clean":"2024-09-21T01:13:54.559575+0000","last_became_active":"2024-09-21T01:12:11.308515+0000","last_became_peered":"2024-09-21T01:12:11.308515+0000","last_unstale":"2024-09-21T01:13:54.559575+0000","last_undegraded":"2024-09-21T01:13:54.559575+0000","last_fullsized":"2024-09-21T01:13:54.559575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:38.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675314+0000","last_change":"2024-09-21T01:12:09.511434+0000","last_active":"2024-09-21T01:12:55.675314+0000","last_peered":"2024-09-21T01:12:55.675314+0000","last_clean":"2024-09-21T01:12:55.675314+0000","last_became_active":"2024-09-21T01:12:09.511043+0000","last_became_peered":"2024-09-21T01:12:09.511043+0000","last_unstale":"2024-09-21T01:12:55.675314+0000","last_undegraded":"2024-09-21T01:12:55.675314+0000","last_fullsized":"2024-09-21T01:12:55.675314+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:23.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.563217+0000","last_change":"2024-09-21T01:12:11.311989+0000","last_active":"2024-09-21T01:13:54.563217+0000","last_peered":"2024-09-21T01:13:54.563217+0000","last_clean":"2024-09-21T01:13:54.563217+0000","last_became_active":"2024-09-21T01:12:11.310338+0000","last_became_peered":"2024-09-21T01:12:11.310338+0000","last_unstale":"2024-09-21T01:13:54.563217+0000","last_undegraded":"2024-09-21T01:13:54.563217+0000","last_fullsized":"2024-09-21T01:13:54.563217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:12.675575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674556+0000","last_change":"2024-09-21T01:11:01.703479+0000","last_active":"2024-09-21T01:12:55.674556+0000","last_peered":"2024-09-21T01:12:55.674556+0000","last_clean":"2024-09-21T01:12:55.674556+0000","last_became_active":"2024-09-21T01:11:01.697351+0000","last_became_peered":"2024-09-21T01:11:01.697351+0000","last_unstale":"2024-09-21T01:12:55.674556+0000","last_undegraded":"2024-09-21T01:12:55.674556+0000","last_fullsized":"2024-09-21T01:12:55.674556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_clean_scrub_stamp":"2024-09-21T01:07:43.096984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:18.858448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784499+0000","last_change":"2024-09-21T01:12:09.295468+0000","last_active":"2024-09-21T01:12:55.784499+0000","last_peered":"2024-09-21T01:12:55.784499+0000","last_clean":"2024-09-21T01:12:55.784499+0000","last_became_active":"2024-09-21T01:12:09.295092+0000","last_became_peered":"2024-09-21T01:12:09.295092+0000","last_unstale":"2024-09-21T01:12:55.784499+0000","last_undegraded":"2024-09-21T01:12:55.784499+0000","last_fullsized":"2024-09-21T01:12:55.784499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:08.153176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558212+0000","last_change":"2024-09-21T01:12:11.308460+0000","last_active":"2024-09-21T01:13:54.558212+0000","last_peered":"2024-09-21T01:13:54.558212+0000","last_clean":"2024-09-21T01:13:54.558212+0000","last_became_active":"2024-09-21T01:12:11.307764+0000","last_became_peered":"2024-09-21T01:12:11.307764+0000","last_unstale":"2024-09-21T01:13:54.558212+0000","last_undegraded":"2024-09-21T01:13:54.558212+0000","last_fullsized":"2024-09-21T01:13:54.558212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:32.094902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674341+0000","last_change":"2024-09-21T01:12:09.296477+0000","last_active":"2024-09-21T01:12:55.674341+0000","last_peered":"2024-09-21T01:12:55.674341+0000","last_clean":"2024-09-21T01:12:55.674341+0000","last_became_active":"2024-09-21T01:12:09.296153+0000","last_became_peered":"2024-09-21T01:12:09.296153+0000","last_unstale":"2024-09-21T01:12:55.674341+0000","last_undegraded":"2024-09-21T01:12:55.674341+0000","last_fullsized":"2024-09-21T01:12:55.674341+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:42.380668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822830+0000","last_change":"2024-09-21T01:12:11.297826+0000","last_active":"2024-09-21T01:12:55.822830+0000","last_peered":"2024-09-21T01:12:55.822830+0000","last_clean":"2024-09-21T01:12:55.822830+0000","last_became_active":"2024-09-21T01:12:11.297430+0000","last_became_peered":"2024-09-21T01:12:11.297430+0000","last_unstale":"2024-09-21T01:12:55.822830+0000","last_undegraded":"2024-09-21T01:12:55.822830+0000","last_fullsized":"2024-09-21T01:12:55.822830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:09.130500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":118,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:50.416010+0000","last_change":"2024-09-21T01:12:09.511173+0000","last_active":"2024-09-21T01:13:50.416010+0000","last_peered":"2024-09-21T01:13:50.416010+0000","last_clean":"2024-09-21T01:13:50.416010+0000","last_became_active":"2024-09-21T01:12:09.510840+0000","last_became_peered":"2024-09-21T01:12:09.510840+0000","last_unstale":"2024-09-21T01:13:50.416010+0000","last_undegraded":"2024-09-21T01:13:50.416010+0000","last_fullsized":"2024-09-21T01:13:50.416010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:22.161708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.552514+0000","last_change":"2024-09-21T01:12:55.824825+0000","last_active":"2024-09-21T01:13:54.552514+0000","last_peered":"2024-09-21T01:13:54.552514+0000","last_clean":"2024-09-21T01:13:54.552514+0000","last_became_active":"2024-09-21T01:12:55.824253+0000","last_became_peered":"2024-09-21T01:12:55.824253+0000","last_unstale":"2024-09-21T01:13:54.552514+0000","last_undegraded":"2024-09-21T01:13:54.552514+0000","last_fullsized":"2024-09-21T01:13:54.552514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:14.580270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674696+0000","last_change":"2024-09-21T01:12:09.295447+0000","last_active":"2024-09-21T01:12:55.674696+0000","last_peered":"2024-09-21T01:12:55.674696+0000","last_clean":"2024-09-21T01:12:55.674696+0000","last_became_active":"2024-09-21T01:12:09.295057+0000","last_became_peered":"2024-09-21T01:12:09.295057+0000","last_unstale":"2024-09-21T01:12:55.674696+0000","last_undegraded":"2024-09-21T01:12:55.674696+0000","last_fullsized":"2024-09-21T01:12:55.674696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:59.389877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.554222+0000","last_change":"2024-09-21T01:12:11.304636+0000","last_active":"2024-09-21T01:13:54.554222+0000","last_peered":"2024-09-21T01:13:54.554222+0000","last_clean":"2024-09-21T01:13:54.554222+0000","last_became_active":"2024-09-21T01:12:11.303318+0000","last_became_peered":"2024-09-21T01:12:11.303318+0000","last_unstale":"2024-09-21T01:13:54.554222+0000","last_undegraded":"2024-09-21T01:13:54.554222+0000","last_fullsized":"2024-09-21T01:13:54.554222+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:39.377686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679281+0000","last_change":"2024-09-21T01:12:55.679156+0000","last_active":"2024-09-21T01:12:55.679281+0000","last_peered":"2024-09-21T01:12:55.679281+0000","last_clean":"2024-09-21T01:12:55.679281+0000","last_became_active":"2024-09-21T01:12:55.678638+0000","last_became_peered":"2024-09-21T01:12:55.678638+0000","last_unstale":"2024-09-21T01:12:55.679281+0000","last_undegraded":"2024-09-21T01:12:55.679281+0000","last_fullsized":"2024-09-21T01:12:55.679281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.784868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558308+0000","last_change":"2024-09-21T01:12:11.305558+0000","last_active":"2024-09-21T01:13:54.558308+0000","last_peered":"2024-09-21T01:13:54.558308+0000","last_clean":"2024-09-21T01:13:54.558308+0000","last_became_active":"2024-09-21T01:12:11.304934+0000","last_became_peered":"2024-09-21T01:12:11.304934+0000","last_unstale":"2024-09-21T01:13:54.558308+0000","last_undegraded":"2024-09-21T01:13:54.558308+0000","last_fullsized":"2024-09-21T01:13:54.558308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:52.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675716+0000","last_change":"2024-09-21T01:12:09.511384+0000","last_active":"2024-09-21T01:12:55.675716+0000","last_peered":"2024-09-21T01:12:55.675716+0000","last_clean":"2024-09-21T01:12:55.675716+0000","last_became_active":"2024-09-21T01:12:09.511006+0000","last_became_peered":"2024-09-21T01:12:09.511006+0000","last_unstale":"2024-09-21T01:12:55.675716+0000","last_undegraded":"2024-09-21T01:12:55.675716+0000","last_fullsized":"2024-09-21T01:12:55.675716+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:56.580855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823258+0000","last_change":"2024-09-21T01:12:11.304912+0000","last_active":"2024-09-21T01:12:55.823258+0000","last_peered":"2024-09-21T01:12:55.823258+0000","last_clean":"2024-09-21T01:12:55.823258+0000","last_became_active":"2024-09-21T01:12:11.304536+0000","last_became_peered":"2024-09-21T01:12:11.304536+0000","last_unstale":"2024-09-21T01:12:55.823258+0000","last_undegraded":"2024-09-21T01:12:55.823258+0000","last_fullsized":"2024-09-21T01:12:55.823258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:45.037231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673929+0000","last_change":"2024-09-21T01:12:09.294680+0000","last_active":"2024-09-21T01:12:55.673929+0000","last_peered":"2024-09-21T01:12:55.673929+0000","last_clean":"2024-09-21T01:12:55.673929+0000","last_became_active":"2024-09-21T01:12:09.294289+0000","last_became_peered":"2024-09-21T01:12:09.294289+0000","last_unstale":"2024-09-21T01:12:55.673929+0000","last_undegraded":"2024-09-21T01:12:55.673929+0000","last_fullsized":"2024-09-21T01:12:55.673929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.824781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559372+0000","last_change":"2024-09-21T01:12:11.305192+0000","last_active":"2024-09-21T01:13:54.559372+0000","last_peered":"2024-09-21T01:13:54.559372+0000","last_clean":"2024-09-21T01:13:54.559372+0000","last_became_active":"2024-09-21T01:12:11.304761+0000","last_became_peered":"2024-09-21T01:12:11.304761+0000","last_unstale":"2024-09-21T01:13:54.559372+0000","last_undegraded":"2024-09-21T01:13:54.559372+0000","last_fullsized":"2024-09-21T01:13:54.559372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:58.429511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784602+0000","last_change":"2024-09-21T01:12:09.455476+0000","last_active":"2024-09-21T01:12:55.784602+0000","last_peered":"2024-09-21T01:12:55.784602+0000","last_clean":"2024-09-21T01:12:55.784602+0000","last_became_active":"2024-09-21T01:12:09.454981+0000","last_became_peered":"2024-09-21T01:12:09.454981+0000","last_unstale":"2024-09-21T01:12:55.784602+0000","last_undegraded":"2024-09-21T01:12:55.784602+0000","last_fullsized":"2024-09-21T01:12:55.784602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:27.790928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559247+0000","last_change":"2024-09-21T01:12:11.300631+0000","last_active":"2024-09-21T01:13:54.559247+0000","last_peered":"2024-09-21T01:13:54.559247+0000","last_clean":"2024-09-21T01:13:54.559247+0000","last_became_active":"2024-09-21T01:12:11.300179+0000","last_became_peered":"2024-09-21T01:12:11.300179+0000","last_unstale":"2024-09-21T01:13:54.559247+0000","last_undegraded":"2024-09-21T01:13:54.559247+0000","last_fullsized":"2024-09-21T01:13:54.559247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:23.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328302+0000","last_change":"2024-09-21T01:12:09.511406+0000","last_active":"2024-09-21T01:12:56.328302+0000","last_peered":"2024-09-21T01:12:56.328302+0000","last_clean":"2024-09-21T01:12:56.328302+0000","last_became_active":"2024-09-21T01:12:09.511117+0000","last_became_peered":"2024-09-21T01:12:09.511117+0000","last_unstale":"2024-09-21T01:12:56.328302+0000","last_undegraded":"2024-09-21T01:12:56.328302+0000","last_fullsized":"2024-09-21T01:12:56.328302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:18.100466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.512711+0000","last_change":"2024-09-21T01:12:11.306933+0000","last_active":"2024-09-21T01:13:54.512711+0000","last_peered":"2024-09-21T01:13:54.512711+0000","last_clean":"2024-09-21T01:13:54.512711+0000","last_became_active":"2024-09-21T01:12:11.306516+0000","last_became_peered":"2024-09-21T01:12:11.306516+0000","last_unstale":"2024-09-21T01:13:54.512711+0000","last_undegraded":"2024-09-21T01:13:54.512711+0000","last_fullsized":"2024-09-21T01:13:54.512711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:40.524953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670767+0000","last_change":"2024-09-21T01:12:09.297506+0000","last_active":"2024-09-21T01:12:55.670767+0000","last_peered":"2024-09-21T01:12:55.670767+0000","last_clean":"2024-09-21T01:12:55.670767+0000","last_became_active":"2024-09-21T01:12:09.297139+0000","last_became_peered":"2024-09-21T01:12:09.297139+0000","last_unstale":"2024-09-21T01:12:55.670767+0000","last_undegraded":"2024-09-21T01:12:55.670767+0000","last_fullsized":"2024-09-21T01:12:55.670767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:05.641171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671193+0000","last_change":"2024-09-21T01:12:11.314053+0000","last_active":"2024-09-21T01:12:55.671193+0000","last_peered":"2024-09-21T01:12:55.671193+0000","last_clean":"2024-09-21T01:12:55.671193+0000","last_became_active":"2024-09-21T01:12:11.313681+0000","last_became_peered":"2024-09-21T01:12:11.313681+0000","last_unstale":"2024-09-21T01:12:55.671193+0000","last_undegraded":"2024-09-21T01:12:55.671193+0000","last_fullsized":"2024-09-21T01:12:55.671193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.108030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674195+0000","last_change":"2024-09-21T01:12:09.298602+0000","last_active":"2024-09-21T01:12:55.674195+0000","last_peered":"2024-09-21T01:12:55.674195+0000","last_clean":"2024-09-21T01:12:55.674195+0000","last_became_active":"2024-09-21T01:12:09.297295+0000","last_became_peered":"2024-09-21T01:12:09.297295+0000","last_unstale":"2024-09-21T01:12:55.674195+0000","last_undegraded":"2024-09-21T01:12:55.674195+0000","last_fullsized":"2024-09-21T01:12:55.674195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:27.253290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553729+0000","last_change":"2024-09-21T01:12:11.306120+0000","last_active":"2024-09-21T01:13:54.553729+0000","last_peered":"2024-09-21T01:13:54.553729+0000","last_clean":"2024-09-21T01:13:54.553729+0000","last_became_active":"2024-09-21T01:12:11.305771+0000","last_became_peered":"2024-09-21T01:12:11.305771+0000","last_unstale":"2024-09-21T01:13:54.553729+0000","last_undegraded":"2024-09-21T01:13:54.553729+0000","last_fullsized":"2024-09-21T01:13:54.553729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:38.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.685158+0000","last_change":"2024-09-21T01:12:55.684585+0000","last_active":"2024-09-21T01:12:55.685158+0000","last_peered":"2024-09-21T01:12:55.685158+0000","last_clean":"2024-09-21T01:12:55.685158+0000","last_became_active":"2024-09-21T01:12:55.677011+0000","last_became_peered":"2024-09-21T01:12:55.677011+0000","last_unstale":"2024-09-21T01:12:55.685158+0000","last_undegraded":"2024-09-21T01:12:55.685158+0000","last_fullsized":"2024-09-21T01:12:55.685158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:09.563212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.563428+0000","last_change":"2024-09-21T01:12:11.312392+0000","last_active":"2024-09-21T01:13:54.563428+0000","last_peered":"2024-09-21T01:13:54.563428+0000","last_clean":"2024-09-21T01:13:54.563428+0000","last_became_active":"2024-09-21T01:12:11.311120+0000","last_became_peered":"2024-09-21T01:12:11.311120+0000","last_unstale":"2024-09-21T01:13:54.563428+0000","last_undegraded":"2024-09-21T01:13:54.563428+0000","last_fullsized":"2024-09-21T01:13:54.563428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:23.292367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558845+0000","last_change":"2024-09-21T01:12:11.301350+0000","last_active":"2024-09-21T01:13:54.558845+0000","last_peered":"2024-09-21T01:13:54.558845+0000","last_clean":"2024-09-21T01:13:54.558845+0000","last_became_active":"2024-09-21T01:12:11.299746+0000","last_became_peered":"2024-09-21T01:12:11.299746+0000","last_unstale":"2024-09-21T01:13:54.558845+0000","last_undegraded":"2024-09-21T01:13:54.558845+0000","last_fullsized":"2024-09-21T01:13:54.558845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:57.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675539+0000","last_change":"2024-09-21T01:12:09.296499+0000","last_active":"2024-09-21T01:12:55.675539+0000","last_peered":"2024-09-21T01:12:55.675539+0000","last_clean":"2024-09-21T01:12:55.675539+0000","last_became_active":"2024-09-21T01:12:09.296000+0000","last_became_peered":"2024-09-21T01:12:09.296000+0000","last_unstale":"2024-09-21T01:12:55.675539+0000","last_undegraded":"2024-09-21T01:12:55.675539+0000","last_fullsized":"2024-09-21T01:12:55.675539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:37.278200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328152+0000","last_change":"2024-09-21T01:12:11.314014+0000","last_active":"2024-09-21T01:12:56.328152+0000","last_peered":"2024-09-21T01:12:56.328152+0000","last_clean":"2024-09-21T01:12:56.328152+0000","last_became_active":"2024-09-21T01:12:11.312592+0000","last_became_peered":"2024-09-21T01:12:11.312592+0000","last_unstale":"2024-09-21T01:12:56.328152+0000","last_undegraded":"2024-09-21T01:12:56.328152+0000","last_fullsized":"2024-09-21T01:12:56.328152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.074667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675558+0000","last_change":"2024-09-21T01:12:09.297088+0000","last_active":"2024-09-21T01:12:55.675558+0000","last_peered":"2024-09-21T01:12:55.675558+0000","last_clean":"2024-09-21T01:12:55.675558+0000","last_became_active":"2024-09-21T01:12:09.296707+0000","last_became_peered":"2024-09-21T01:12:09.296707+0000","last_unstale":"2024-09-21T01:12:55.675558+0000","last_undegraded":"2024-09-21T01:12:55.675558+0000","last_fullsized":"2024-09-21T01:12:55.675558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:50.138586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556295+0000","last_change":"2024-09-21T01:12:11.300991+0000","last_active":"2024-09-21T01:13:54.556295+0000","last_peered":"2024-09-21T01:13:54.556295+0000","last_clean":"2024-09-21T01:13:54.556295+0000","last_became_active":"2024-09-21T01:12:11.299934+0000","last_became_peered":"2024-09-21T01:12:11.299934+0000","last_unstale":"2024-09-21T01:13:54.556295+0000","last_undegraded":"2024-09-21T01:13:54.556295+0000","last_fullsized":"2024-09-21T01:13:54.556295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:34.300051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671316+0000","last_change":"2024-09-21T01:12:09.511289+0000","last_active":"2024-09-21T01:12:55.671316+0000","last_peered":"2024-09-21T01:12:55.671316+0000","last_clean":"2024-09-21T01:12:55.671316+0000","last_became_active":"2024-09-21T01:12:09.510879+0000","last_became_peered":"2024-09-21T01:12:09.510879+0000","last_unstale":"2024-09-21T01:12:55.671316+0000","last_undegraded":"2024-09-21T01:12:55.671316+0000","last_fullsized":"2024-09-21T01:12:55.671316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:37.950305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.543430+0000","last_change":"2024-09-21T01:12:11.312100+0000","last_active":"2024-09-21T01:13:54.543430+0000","last_peered":"2024-09-21T01:13:54.543430+0000","last_clean":"2024-09-21T01:13:54.543430+0000","last_became_active":"2024-09-21T01:12:11.311731+0000","last_became_peered":"2024-09-21T01:12:11.311731+0000","last_unstale":"2024-09-21T01:13:54.543430+0000","last_undegraded":"2024-09-21T01:13:54.543430+0000","last_fullsized":"2024-09-21T01:13:54.543430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:40.459020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674164+0000","last_change":"2024-09-21T01:12:09.294759+0000","last_active":"2024-09-21T01:12:55.674164+0000","last_peered":"2024-09-21T01:12:55.674164+0000","last_clean":"2024-09-21T01:12:55.674164+0000","last_became_active":"2024-09-21T01:12:09.294391+0000","last_became_peered":"2024-09-21T01:12:09.294391+0000","last_unstale":"2024-09-21T01:12:55.674164+0000","last_undegraded":"2024-09-21T01:12:55.674164+0000","last_fullsized":"2024-09-21T01:12:55.674164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:05.981058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76586,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":592,"num_read_kb":368,"num_write":174,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":219164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776162,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":815104,"data_stored":396084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1523712,"data_stored":1059759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":831488,"data_stored":396320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":831488,"data_stored":396240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716736,"statfs":{"total":95995035648,"available":95965937664,"internally_reserved":0,"allocated":1425408,"data_stored":988619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":819200,"data_stored":395709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32588,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712564,"statfs":{"total":95995035648,"available":95961665536,"internally_reserved":0,"allocated":1437696,"data_stored":987463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40308,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704844,"statfs":{"total":95995035648,"available":95953760256,"internally_reserved":0,"allocated":823296,"data_stored":397377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":396020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":913408,"data_stored":463300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":461950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":396980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":74554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:13:58.059 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:13:58.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.204+0000 7f3a20313640 1 -- 172.21.15.148:0/1141141848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a18102580 msgr2=0x7f3a181029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.204+0000 7f3a20313640 1 --2- 172.21.15.148:0/1141141848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a18102580 0x7f3a181029f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009900 tx=0x7f3a1402a410 comp rx=0 tx=0).stop 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 -- 172.21.15.148:0/1141141848 shutdown_connections 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 --2- 172.21.15.148:0/1141141848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a18103fa0 0x7f3a1810a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 --2- 172.21.15.148:0/1141141848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a18103600 0x7f3a18103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 --2- 172.21.15.148:0/1141141848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a18102580 0x7f3a181029f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 -- 172.21.15.148:0/1141141848 >> 172.21.15.148:0/1141141848 conn(0x7f3a180fdee0 msgr2=0x7f3a18100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 -- 172.21.15.148:0/1141141848 shutdown_connections 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 -- 172.21.15.148:0/1141141848 wait complete. 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 Processor -- start 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 -- start start 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a18102580 0x7f3a18199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.205+0000 7f3a20313640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a18103600 0x7f3a1819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a20313640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a18103fa0 0x7f3a1819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a20313640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1810f310 con 0x7f3a18102580 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a20313640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1810f190 con 0x7f3a18103fa0 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a20313640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1810f490 con 0x7f3a18103600 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1e0af640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a18102580 0x7f3a18199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1e0af640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a18102580 0x7f3a18199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51384/0 (socket says 172.21.15.148:51384) 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1e0af640 1 -- 172.21.15.148:0/369844826 learned_addr learned my addr 172.21.15.148:0/369844826 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1e8b0640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a18103fa0 0x7f3a1819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1d8ae640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a18103600 0x7f3a1819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1e0af640 1 -- 172.21.15.148:0/369844826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a18103600 msgr2=0x7f3a1819a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1e0af640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a18103600 0x7f3a1819a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1e0af640 1 -- 172.21.15.148:0/369844826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a18103fa0 msgr2=0x7f3a1819b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1e0af640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a18103fa0 0x7f3a1819b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1e0af640 1 -- 172.21.15.148:0/369844826 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1819b940 con 0x7f3a18102580 2024-09-21T01:13:58.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1d8ae640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a18103600 0x7f3a1819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:58.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a1e0af640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a18102580 0x7f3a18199f00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3a14006010 tx=0x7f3a14004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:58.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a0f7fe640 1 -- 172.21.15.148:0/369844826 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1403f030 con 0x7f3a18102580 2024-09-21T01:13:58.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a0f7fe640 1 -- 172.21.15.148:0/369844826 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a14003cb0 con 0x7f3a18102580 2024-09-21T01:13:58.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a20313640 1 -- 172.21.15.148:0/369844826 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1819bbd0 con 0x7f3a18102580 2024-09-21T01:13:58.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a0f7fe640 1 -- 172.21.15.148:0/369844826 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14035070 con 0x7f3a18102580 2024-09-21T01:13:58.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.206+0000 7f3a20313640 1 -- 172.21.15.148:0/369844826 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a181a2320 con 0x7f3a18102580 2024-09-21T01:13:58.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.207+0000 7f3a20313640 1 -- 172.21.15.148:0/369844826 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a181029f0 con 0x7f3a18102580 2024-09-21T01:13:58.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.209+0000 7f3a0f7fe640 1 -- 172.21.15.148:0/369844826 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f3a14042030 con 0x7f3a18102580 2024-09-21T01:13:58.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.210+0000 7f3a0f7fe640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a040b6620 0x7f3a040b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.210+0000 7f3a1d8ae640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a040b6620 0x7f3a040b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.210+0000 7f3a0f7fe640 1 -- 172.21.15.148:0/369844826 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f3a14108210 con 0x7f3a18102580 2024-09-21T01:13:58.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.210+0000 7f3a1d8ae640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a040b6620 0x7f3a040b8b30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a08005d00 tx=0x7f3a08005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:58.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.213+0000 7f3a0f7fe640 1 -- 172.21.15.148:0/369844826 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a140ce950 con 0x7f3a18102580 2024-09-21T01:13:58.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.391+0000 7f3a20313640 1 -- 172.21.15.148:0/369844826 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a18063800 con 0x7f3a040b6620 2024-09-21T01:13:58.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.395+0000 7f3a0f7fe640 1 -- 172.21.15.148:0/369844826 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258956 (secure 0 0 0) 0x7f3a18063800 con 0x7f3a040b6620 2024-09-21T01:13:58.398 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:58.400 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-21T01:13:58.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.398+0000 7f3a20313640 1 -- 172.21.15.148:0/369844826 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a040b6620 msgr2=0x7f3a040b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.398+0000 7f3a20313640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a040b6620 0x7f3a040b8b30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a08005d00 tx=0x7f3a08005ed0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.398+0000 7f3a20313640 1 -- 172.21.15.148:0/369844826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a18102580 msgr2=0x7f3a18199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.398+0000 7f3a20313640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a18102580 0x7f3a18199f00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3a14006010 tx=0x7f3a14004340 comp rx=0 tx=0).stop 2024-09-21T01:13:58.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.398+0000 7f3a20313640 1 -- 172.21.15.148:0/369844826 shutdown_connections 2024-09-21T01:13:58.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.398+0000 7f3a20313640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3a040b6620 0x7f3a040b8b30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.398+0000 7f3a20313640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a18103fa0 0x7f3a1819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.399+0000 7f3a20313640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a18103600 0x7f3a1819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.399+0000 7f3a20313640 1 --2- 172.21.15.148:0/369844826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a18102580 0x7f3a18199f00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.399+0000 7f3a20313640 1 -- 172.21.15.148:0/369844826 >> 172.21.15.148:0/369844826 conn(0x7f3a180fdee0 msgr2=0x7f3a18106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:58.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.399+0000 7f3a20313640 1 -- 172.21.15.148:0/369844826 shutdown_connections 2024-09-21T01:13:58.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.399+0000 7f3a20313640 1 -- 172.21.15.148:0/369844826 wait complete. 2024-09-21T01:13:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-21T01:13:58.346281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667188,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":673,"num_read_kb":437,"num_write":300,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":691,"ondisk_log_size":691,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390104,"kb_used_data":11712,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551720,"statfs":{"total":1151940427776,"available":1151540961280,"internally_reserved":0,"allocated":11993088,"data_stored":6748935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6137,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":11,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002936"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671714+0000","last_change":"2024-09-21T01:12:11.314815+0000","last_active":"2024-09-21T01:12:55.671714+0000","last_peered":"2024-09-21T01:12:55.671714+0000","last_clean":"2024-09-21T01:12:55.671714+0000","last_became_active":"2024-09-21T01:12:11.314139+0000","last_became_peered":"2024-09-21T01:12:11.314139+0000","last_unstale":"2024-09-21T01:12:55.671714+0000","last_undegraded":"2024-09-21T01:12:55.671714+0000","last_fullsized":"2024-09-21T01:12:55.671714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.538846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.551406+0000","last_change":"2024-09-21T01:12:11.309915+0000","last_active":"2024-09-21T01:13:54.551406+0000","last_peered":"2024-09-21T01:13:54.551406+0000","last_clean":"2024-09-21T01:13:54.551406+0000","last_became_active":"2024-09-21T01:12:11.309551+0000","last_became_peered":"2024-09-21T01:12:11.309551+0000","last_unstale":"2024-09-21T01:13:54.551406+0000","last_undegraded":"2024-09-21T01:13:54.551406+0000","last_fullsized":"2024-09-21T01:13:54.551406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.568041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557496+0000","last_change":"2024-09-21T01:12:11.306393+0000","last_active":"2024-09-21T01:13:54.557496+0000","last_peered":"2024-09-21T01:13:54.557496+0000","last_clean":"2024-09-21T01:13:54.557496+0000","last_became_active":"2024-09-21T01:12:11.306035+0000","last_became_peered":"2024-09-21T01:12:11.306035+0000","last_unstale":"2024-09-21T01:13:54.557496+0000","last_undegraded":"2024-09-21T01:13:54.557496+0000","last_fullsized":"2024-09-21T01:13:54.557496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:20.528141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.554699+0000","last_change":"2024-09-21T01:12:11.302339+0000","last_active":"2024-09-21T01:13:54.554699+0000","last_peered":"2024-09-21T01:13:54.554699+0000","last_clean":"2024-09-21T01:13:54.554699+0000","last_became_active":"2024-09-21T01:12:11.301890+0000","last_became_peered":"2024-09-21T01:12:11.301890+0000","last_unstale":"2024-09-21T01:13:54.554699+0000","last_undegraded":"2024-09-21T01:13:54.554699+0000","last_fullsized":"2024-09-21T01:13:54.554699+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:34.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.545070+0000","last_change":"2024-09-21T01:12:11.299171+0000","last_active":"2024-09-21T01:13:54.545070+0000","last_peered":"2024-09-21T01:13:54.545070+0000","last_clean":"2024-09-21T01:13:54.545070+0000","last_became_active":"2024-09-21T01:12:11.298764+0000","last_became_peered":"2024-09-21T01:12:11.298764+0000","last_unstale":"2024-09-21T01:13:54.545070+0000","last_undegraded":"2024-09-21T01:13:54.545070+0000","last_fullsized":"2024-09-21T01:13:54.545070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:02.078587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553317+0000","last_change":"2024-09-21T01:12:11.307909+0000","last_active":"2024-09-21T01:13:54.553317+0000","last_peered":"2024-09-21T01:13:54.553317+0000","last_clean":"2024-09-21T01:13:54.553317+0000","last_became_active":"2024-09-21T01:12:11.307546+0000","last_became_peered":"2024-09-21T01:12:11.307546+0000","last_unstale":"2024-09-21T01:13:54.553317+0000","last_undegraded":"2024-09-21T01:13:54.553317+0000","last_fullsized":"2024-09-21T01:13:54.553317+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:48.683684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553588+0000","last_change":"2024-09-21T01:12:11.309402+0000","last_active":"2024-09-21T01:13:54.553588+0000","last_peered":"2024-09-21T01:13:54.553588+0000","last_clean":"2024-09-21T01:13:54.553588+0000","last_became_active":"2024-09-21T01:12:11.309019+0000","last_became_peered":"2024-09-21T01:12:11.309019+0000","last_unstale":"2024-09-21T01:13:54.553588+0000","last_undegraded":"2024-09-21T01:13:54.553588+0000","last_fullsized":"2024-09-21T01:13:54.553588+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:55.020239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.552164+0000","last_change":"2024-09-21T01:12:11.308589+0000","last_active":"2024-09-21T01:13:54.552164+0000","last_peered":"2024-09-21T01:13:54.552164+0000","last_clean":"2024-09-21T01:13:54.552164+0000","last_became_active":"2024-09-21T01:12:11.308133+0000","last_became_peered":"2024-09-21T01:12:11.308133+0000","last_unstale":"2024-09-21T01:13:54.552164+0000","last_undegraded":"2024-09-21T01:13:54.552164+0000","last_fullsized":"2024-09-21T01:13:54.552164+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:15.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556124+0000","last_change":"2024-09-21T01:12:55.681017+0000","last_active":"2024-09-21T01:13:54.556124+0000","last_peered":"2024-09-21T01:13:54.556124+0000","last_clean":"2024-09-21T01:13:54.556124+0000","last_became_active":"2024-09-21T01:12:55.680594+0000","last_became_peered":"2024-09-21T01:12:55.680594+0000","last_unstale":"2024-09-21T01:13:54.556124+0000","last_undegraded":"2024-09-21T01:13:54.556124+0000","last_fullsized":"2024-09-21T01:13:54.556124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.847129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553601+0000","last_change":"2024-09-21T01:12:11.311426+0000","last_active":"2024-09-21T01:13:54.553601+0000","last_peered":"2024-09-21T01:13:54.553601+0000","last_clean":"2024-09-21T01:13:54.553601+0000","last_became_active":"2024-09-21T01:12:11.309351+0000","last_became_peered":"2024-09-21T01:12:11.309351+0000","last_unstale":"2024-09-21T01:13:54.553601+0000","last_undegraded":"2024-09-21T01:13:54.553601+0000","last_fullsized":"2024-09-21T01:13:54.553601+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:31.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.562551+0000","last_change":"2024-09-21T01:12:11.312171+0000","last_active":"2024-09-21T01:13:54.562551+0000","last_peered":"2024-09-21T01:13:54.562551+0000","last_clean":"2024-09-21T01:13:54.562551+0000","last_became_active":"2024-09-21T01:12:11.311542+0000","last_became_peered":"2024-09-21T01:12:11.311542+0000","last_unstale":"2024-09-21T01:13:54.562551+0000","last_undegraded":"2024-09-21T01:13:54.562551+0000","last_fullsized":"2024-09-21T01:13:54.562551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:13.257463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.554226+0000","last_change":"2024-09-21T01:12:11.301344+0000","last_active":"2024-09-21T01:13:54.554226+0000","last_peered":"2024-09-21T01:13:54.554226+0000","last_clean":"2024-09-21T01:13:54.554226+0000","last_became_active":"2024-09-21T01:12:11.300593+0000","last_became_peered":"2024-09-21T01:12:11.300593+0000","last_unstale":"2024-09-21T01:13:54.554226+0000","last_undegraded":"2024-09-21T01:13:54.554226+0000","last_fullsized":"2024-09-21T01:13:54.554226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:12.659972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556456+0000","last_change":"2024-09-21T01:12:11.298690+0000","last_active":"2024-09-21T01:13:54.556456+0000","last_peered":"2024-09-21T01:13:54.556456+0000","last_clean":"2024-09-21T01:13:54.556456+0000","last_became_active":"2024-09-21T01:12:11.298418+0000","last_became_peered":"2024-09-21T01:12:11.298418+0000","last_unstale":"2024-09-21T01:13:54.556456+0000","last_undegraded":"2024-09-21T01:13:54.556456+0000","last_fullsized":"2024-09-21T01:13:54.556456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:08.311791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557890+0000","last_change":"2024-09-21T01:12:11.299382+0000","last_active":"2024-09-21T01:13:54.557890+0000","last_peered":"2024-09-21T01:13:54.557890+0000","last_clean":"2024-09-21T01:13:54.557890+0000","last_became_active":"2024-09-21T01:12:11.298428+0000","last_became_peered":"2024-09-21T01:12:11.298428+0000","last_unstale":"2024-09-21T01:13:54.557890+0000","last_undegraded":"2024-09-21T01:13:54.557890+0000","last_fullsized":"2024-09-21T01:13:54.557890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:02.472994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557508+0000","last_change":"2024-09-21T01:12:11.305018+0000","last_active":"2024-09-21T01:13:54.557508+0000","last_peered":"2024-09-21T01:13:54.557508+0000","last_clean":"2024-09-21T01:13:54.557508+0000","last_became_active":"2024-09-21T01:12:11.304607+0000","last_became_peered":"2024-09-21T01:12:11.304607+0000","last_unstale":"2024-09-21T01:13:54.557508+0000","last_undegraded":"2024-09-21T01:13:54.557508+0000","last_fullsized":"2024-09-21T01:13:54.557508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:39.552633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.560273+0000","last_change":"2024-09-21T01:12:11.308846+0000","last_active":"2024-09-21T01:13:54.560273+0000","last_peered":"2024-09-21T01:13:54.560273+0000","last_clean":"2024-09-21T01:13:54.560273+0000","last_became_active":"2024-09-21T01:12:11.308486+0000","last_became_peered":"2024-09-21T01:12:11.308486+0000","last_unstale":"2024-09-21T01:13:54.560273+0000","last_undegraded":"2024-09-21T01:13:54.560273+0000","last_fullsized":"2024-09-21T01:13:54.560273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:29.072947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671796+0000","last_change":"2024-09-21T01:12:11.316277+0000","last_active":"2024-09-21T01:12:55.671796+0000","last_peered":"2024-09-21T01:12:55.671796+0000","last_clean":"2024-09-21T01:12:55.671796+0000","last_became_active":"2024-09-21T01:12:11.315364+0000","last_became_peered":"2024-09-21T01:12:11.315364+0000","last_unstale":"2024-09-21T01:12:55.671796+0000","last_undegraded":"2024-09-21T01:12:55.671796+0000","last_fullsized":"2024-09-21T01:12:55.671796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:50.281556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.561432+0000","last_change":"2024-09-21T01:12:11.300761+0000","last_active":"2024-09-21T01:13:54.561432+0000","last_peered":"2024-09-21T01:13:54.561432+0000","last_clean":"2024-09-21T01:13:54.561432+0000","last_became_active":"2024-09-21T01:12:11.300343+0000","last_became_peered":"2024-09-21T01:12:11.300343+0000","last_unstale":"2024-09-21T01:13:54.561432+0000","last_undegraded":"2024-09-21T01:13:54.561432+0000","last_fullsized":"2024-09-21T01:13:54.561432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:29.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553156+0000","last_change":"2024-09-21T01:12:11.305370+0000","last_active":"2024-09-21T01:13:54.553156+0000","last_peered":"2024-09-21T01:13:54.553156+0000","last_clean":"2024-09-21T01:13:54.553156+0000","last_became_active":"2024-09-21T01:12:11.304991+0000","last_became_peered":"2024-09-21T01:12:11.304991+0000","last_unstale":"2024-09-21T01:13:54.553156+0000","last_undegraded":"2024-09-21T01:13:54.553156+0000","last_fullsized":"2024-09-21T01:13:54.553156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:12.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671227+0000","last_change":"2024-09-21T01:12:11.303981+0000","last_active":"2024-09-21T01:12:55.671227+0000","last_peered":"2024-09-21T01:12:55.671227+0000","last_clean":"2024-09-21T01:12:55.671227+0000","last_became_active":"2024-09-21T01:12:11.303602+0000","last_became_peered":"2024-09-21T01:12:11.303602+0000","last_unstale":"2024-09-21T01:12:55.671227+0000","last_undegraded":"2024-09-21T01:12:55.671227+0000","last_fullsized":"2024-09-21T01:12:55.671227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:24.513365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559884+0000","last_change":"2024-09-21T01:12:11.302849+0000","last_active":"2024-09-21T01:13:54.559884+0000","last_peered":"2024-09-21T01:13:54.559884+0000","last_clean":"2024-09-21T01:13:54.559884+0000","last_became_active":"2024-09-21T01:12:11.302487+0000","last_became_peered":"2024-09-21T01:12:11.302487+0000","last_unstale":"2024-09-21T01:13:54.559884+0000","last_undegraded":"2024-09-21T01:13:54.559884+0000","last_fullsized":"2024-09-21T01:13:54.559884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:44.174213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.560302+0000","last_change":"2024-09-21T01:12:11.315578+0000","last_active":"2024-09-21T01:13:54.560302+0000","last_peered":"2024-09-21T01:13:54.560302+0000","last_clean":"2024-09-21T01:13:54.560302+0000","last_became_active":"2024-09-21T01:12:11.315174+0000","last_became_peered":"2024-09-21T01:12:11.315174+0000","last_unstale":"2024-09-21T01:13:54.560302+0000","last_undegraded":"2024-09-21T01:13:54.560302+0000","last_fullsized":"2024-09-21T01:13:54.560302+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:46.172101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556898+0000","last_change":"2024-09-21T01:12:11.308086+0000","last_active":"2024-09-21T01:13:54.556898+0000","last_peered":"2024-09-21T01:13:54.556898+0000","last_clean":"2024-09-21T01:13:54.556898+0000","last_became_active":"2024-09-21T01:12:11.307248+0000","last_became_peered":"2024-09-21T01:12:11.307248+0000","last_unstale":"2024-09-21T01:13:54.556898+0000","last_undegraded":"2024-09-21T01:13:54.556898+0000","last_fullsized":"2024-09-21T01:13:54.556898+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:11.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553469+0000","last_change":"2024-09-21T01:12:11.301672+0000","last_active":"2024-09-21T01:13:54.553469+0000","last_peered":"2024-09-21T01:13:54.553469+0000","last_clean":"2024-09-21T01:13:54.553469+0000","last_became_active":"2024-09-21T01:12:11.298775+0000","last_became_peered":"2024-09-21T01:12:11.298775+0000","last_unstale":"2024-09-21T01:13:54.553469+0000","last_undegraded":"2024-09-21T01:13:54.553469+0000","last_fullsized":"2024-09-21T01:13:54.553469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:30.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.547049+0000","last_change":"2024-09-21T01:12:11.311947+0000","last_active":"2024-09-21T01:13:54.547049+0000","last_peered":"2024-09-21T01:13:54.547049+0000","last_clean":"2024-09-21T01:13:54.547049+0000","last_became_active":"2024-09-21T01:12:11.311616+0000","last_became_peered":"2024-09-21T01:12:11.311616+0000","last_unstale":"2024-09-21T01:13:54.547049+0000","last_undegraded":"2024-09-21T01:13:54.547049+0000","last_fullsized":"2024-09-21T01:13:54.547049+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:25.727807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557055+0000","last_change":"2024-09-21T01:12:11.312161+0000","last_active":"2024-09-21T01:13:54.557055+0000","last_peered":"2024-09-21T01:13:54.557055+0000","last_clean":"2024-09-21T01:13:54.557055+0000","last_became_active":"2024-09-21T01:12:11.311781+0000","last_became_peered":"2024-09-21T01:12:11.311781+0000","last_unstale":"2024-09-21T01:13:54.557055+0000","last_undegraded":"2024-09-21T01:13:54.557055+0000","last_fullsized":"2024-09-21T01:13:54.557055+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:01.923801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671385+0000","last_change":"2024-09-21T01:12:11.310698+0000","last_active":"2024-09-21T01:12:55.671385+0000","last_peered":"2024-09-21T01:12:55.671385+0000","last_clean":"2024-09-21T01:12:55.671385+0000","last_became_active":"2024-09-21T01:12:11.310226+0000","last_became_peered":"2024-09-21T01:12:11.310226+0000","last_unstale":"2024-09-21T01:12:55.671385+0000","last_undegraded":"2024-09-21T01:12:55.671385+0000","last_fullsized":"2024-09-21T01:12:55.671385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:27.428457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.560242+0000","last_change":"2024-09-21T01:12:11.294598+0000","last_active":"2024-09-21T01:13:54.560242+0000","last_peered":"2024-09-21T01:13:54.560242+0000","last_clean":"2024-09-21T01:13:54.560242+0000","last_became_active":"2024-09-21T01:12:11.293899+0000","last_became_peered":"2024-09-21T01:12:11.293899+0000","last_unstale":"2024-09-21T01:13:54.560242+0000","last_undegraded":"2024-09-21T01:13:54.560242+0000","last_fullsized":"2024-09-21T01:13:54.560242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.843199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556669+0000","last_change":"2024-09-21T01:12:11.295143+0000","last_active":"2024-09-21T01:13:54.556669+0000","last_peered":"2024-09-21T01:13:54.556669+0000","last_clean":"2024-09-21T01:13:54.556669+0000","last_became_active":"2024-09-21T01:12:11.294787+0000","last_became_peered":"2024-09-21T01:12:11.294787+0000","last_unstale":"2024-09-21T01:13:54.556669+0000","last_undegraded":"2024-09-21T01:13:54.556669+0000","last_fullsized":"2024-09-21T01:13:54.556669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:34.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.561724+0000","last_change":"2024-09-21T01:12:55.679399+0000","last_active":"2024-09-21T01:13:54.561724+0000","last_peered":"2024-09-21T01:13:54.561724+0000","last_clean":"2024-09-21T01:13:54.561724+0000","last_became_active":"2024-09-21T01:12:55.678933+0000","last_became_peered":"2024-09-21T01:12:55.678933+0000","last_unstale":"2024-09-21T01:13:54.561724+0000","last_undegraded":"2024-09-21T01:13:54.561724+0000","last_fullsized":"2024-09-21T01:13:54.561724+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:20.204715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.548138+0000","last_change":"2024-09-21T01:12:55.680711+0000","last_active":"2024-09-21T01:13:54.548138+0000","last_peered":"2024-09-21T01:13:54.548138+0000","last_clean":"2024-09-21T01:13:54.548138+0000","last_became_active":"2024-09-21T01:12:55.680257+0000","last_became_peered":"2024-09-21T01:12:55.680257+0000","last_unstale":"2024-09-21T01:13:54.548138+0000","last_undegraded":"2024-09-21T01:13:54.548138+0000","last_fullsized":"2024-09-21T01:13:54.548138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:03.610951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671133+0000","last_change":"2024-09-21T01:12:11.308355+0000","last_active":"2024-09-21T01:12:55.671133+0000","last_peered":"2024-09-21T01:12:55.671133+0000","last_clean":"2024-09-21T01:12:55.671133+0000","last_became_active":"2024-09-21T01:12:11.307919+0000","last_became_peered":"2024-09-21T01:12:11.307919+0000","last_unstale":"2024-09-21T01:12:55.671133+0000","last_undegraded":"2024-09-21T01:12:55.671133+0000","last_fullsized":"2024-09-21T01:12:55.671133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:59.869646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.561785+0000","last_change":"2024-09-21T01:12:11.298905+0000","last_active":"2024-09-21T01:13:54.561785+0000","last_peered":"2024-09-21T01:13:54.561785+0000","last_clean":"2024-09-21T01:13:54.561785+0000","last_became_active":"2024-09-21T01:12:11.298512+0000","last_became_peered":"2024-09-21T01:12:11.298512+0000","last_unstale":"2024-09-21T01:13:54.561785+0000","last_undegraded":"2024-09-21T01:13:54.561785+0000","last_fullsized":"2024-09-21T01:13:54.561785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:05.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":125,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.422905+0000","last_change":"2024-09-21T01:12:09.294881+0000","last_active":"2024-09-21T01:13:54.422905+0000","last_peered":"2024-09-21T01:13:54.422905+0000","last_clean":"2024-09-21T01:13:54.422905+0000","last_became_active":"2024-09-21T01:12:09.294513+0000","last_became_peered":"2024-09-21T01:12:09.294513+0000","last_unstale":"2024-09-21T01:13:54.422905+0000","last_undegraded":"2024-09-21T01:13:54.422905+0000","last_fullsized":"2024-09-21T01:13:54.422905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:07.193879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.563814+0000","last_change":"2024-09-21T01:12:55.676259+0000","last_active":"2024-09-21T01:13:54.563814+0000","last_peered":"2024-09-21T01:13:54.563814+0000","last_clean":"2024-09-21T01:13:54.563814+0000","last_became_active":"2024-09-21T01:12:55.675810+0000","last_became_peered":"2024-09-21T01:12:55.675810+0000","last_unstale":"2024-09-21T01:13:54.563814+0000","last_undegraded":"2024-09-21T01:13:54.563814+0000","last_fullsized":"2024-09-21T01:13:54.563814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:34.985195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669122+0000","last_change":"2024-09-21T01:12:09.298594+0000","last_active":"2024-09-21T01:12:55.669122+0000","last_peered":"2024-09-21T01:12:55.669122+0000","last_clean":"2024-09-21T01:12:55.669122+0000","last_became_active":"2024-09-21T01:12:09.298130+0000","last_became_peered":"2024-09-21T01:12:09.298130+0000","last_unstale":"2024-09-21T01:12:55.669122+0000","last_undegraded":"2024-09-21T01:12:55.669122+0000","last_fullsized":"2024-09-21T01:12:55.669122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.964507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822858+0000","last_change":"2024-09-21T01:12:09.295997+0000","last_active":"2024-09-21T01:12:55.822858+0000","last_peered":"2024-09-21T01:12:55.822858+0000","last_clean":"2024-09-21T01:12:55.822858+0000","last_became_active":"2024-09-21T01:12:09.295472+0000","last_became_peered":"2024-09-21T01:12:09.295472+0000","last_unstale":"2024-09-21T01:12:55.822858+0000","last_undegraded":"2024-09-21T01:12:55.822858+0000","last_fullsized":"2024-09-21T01:12:55.822858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:25.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557274+0000","last_change":"2024-09-21T01:12:11.306468+0000","last_active":"2024-09-21T01:13:54.557274+0000","last_peered":"2024-09-21T01:13:54.557274+0000","last_clean":"2024-09-21T01:13:54.557274+0000","last_became_active":"2024-09-21T01:12:11.304186+0000","last_became_peered":"2024-09-21T01:12:11.304186+0000","last_unstale":"2024-09-21T01:13:54.557274+0000","last_undegraded":"2024-09-21T01:13:54.557274+0000","last_fullsized":"2024-09-21T01:13:54.557274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:28.564879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.678732+0000","last_change":"2024-09-21T01:12:09.295004+0000","last_active":"2024-09-21T01:12:55.678732+0000","last_peered":"2024-09-21T01:12:55.678732+0000","last_clean":"2024-09-21T01:12:55.678732+0000","last_became_active":"2024-09-21T01:12:09.294655+0000","last_became_peered":"2024-09-21T01:12:09.294655+0000","last_unstale":"2024-09-21T01:12:55.678732+0000","last_undegraded":"2024-09-21T01:12:55.678732+0000","last_fullsized":"2024-09-21T01:12:55.678732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:35.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.562576+0000","last_change":"2024-09-21T01:12:11.304252+0000","last_active":"2024-09-21T01:13:54.562576+0000","last_peered":"2024-09-21T01:13:54.562576+0000","last_clean":"2024-09-21T01:13:54.562576+0000","last_became_active":"2024-09-21T01:12:11.303876+0000","last_became_peered":"2024-09-21T01:12:11.303876+0000","last_unstale":"2024-09-21T01:13:54.562576+0000","last_undegraded":"2024-09-21T01:13:54.562576+0000","last_fullsized":"2024-09-21T01:13:54.562576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:48.460538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:53.420796+0000","last_change":"2024-09-21T01:12:09.298976+0000","last_active":"2024-09-21T01:13:53.420796+0000","last_peered":"2024-09-21T01:13:53.420796+0000","last_clean":"2024-09-21T01:13:53.420796+0000","last_became_active":"2024-09-21T01:12:09.298664+0000","last_became_peered":"2024-09-21T01:12:09.298664+0000","last_unstale":"2024-09-21T01:13:53.420796+0000","last_undegraded":"2024-09-21T01:13:53.420796+0000","last_fullsized":"2024-09-21T01:13:53.420796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:58.157391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.560268+0000","last_change":"2024-09-21T01:12:11.313400+0000","last_active":"2024-09-21T01:13:54.560268+0000","last_peered":"2024-09-21T01:13:54.560268+0000","last_clean":"2024-09-21T01:13:54.560268+0000","last_became_active":"2024-09-21T01:12:11.312940+0000","last_became_peered":"2024-09-21T01:12:11.312940+0000","last_unstale":"2024-09-21T01:13:54.560268+0000","last_undegraded":"2024-09-21T01:13:54.560268+0000","last_fullsized":"2024-09-21T01:13:54.560268+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:22.224157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674784+0000","last_change":"2024-09-21T01:12:09.299266+0000","last_active":"2024-09-21T01:12:55.674784+0000","last_peered":"2024-09-21T01:12:55.674784+0000","last_clean":"2024-09-21T01:12:55.674784+0000","last_became_active":"2024-09-21T01:12:09.298932+0000","last_became_peered":"2024-09-21T01:12:09.298932+0000","last_unstale":"2024-09-21T01:12:55.674784+0000","last_undegraded":"2024-09-21T01:12:55.674784+0000","last_fullsized":"2024-09-21T01:12:55.674784+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:51.546829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.552612+0000","last_change":"2024-09-21T01:12:55.681618+0000","last_active":"2024-09-21T01:13:54.552612+0000","last_peered":"2024-09-21T01:13:54.552612+0000","last_clean":"2024-09-21T01:13:54.552612+0000","last_became_active":"2024-09-21T01:12:55.681211+0000","last_became_peered":"2024-09-21T01:12:55.681211+0000","last_unstale":"2024-09-21T01:13:54.552612+0000","last_undegraded":"2024-09-21T01:13:54.552612+0000","last_fullsized":"2024-09-21T01:13:54.552612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:24.588338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679447+0000","last_change":"2024-09-21T01:12:09.511908+0000","last_active":"2024-09-21T01:12:55.679447+0000","last_peered":"2024-09-21T01:12:55.679447+0000","last_clean":"2024-09-21T01:12:55.679447+0000","last_became_active":"2024-09-21T01:12:09.511550+0000","last_became_peered":"2024-09-21T01:12:09.511550+0000","last_unstale":"2024-09-21T01:12:55.679447+0000","last_undegraded":"2024-09-21T01:12:55.679447+0000","last_fullsized":"2024-09-21T01:12:55.679447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:08.743648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.561546+0000","last_change":"2024-09-21T01:12:11.316005+0000","last_active":"2024-09-21T01:13:54.561546+0000","last_peered":"2024-09-21T01:13:54.561546+0000","last_clean":"2024-09-21T01:13:54.561546+0000","last_became_active":"2024-09-21T01:12:11.315245+0000","last_became_peered":"2024-09-21T01:12:11.315245+0000","last_unstale":"2024-09-21T01:13:54.561546+0000","last_undegraded":"2024-09-21T01:13:54.561546+0000","last_fullsized":"2024-09-21T01:13:54.561546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:50.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'36","reported_seq":257,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.565332+0000","last_change":"2024-09-21T01:12:09.300010+0000","last_active":"2024-09-21T01:13:54.565332+0000","last_peered":"2024-09-21T01:13:54.565332+0000","last_clean":"2024-09-21T01:13:54.565332+0000","last_became_active":"2024-09-21T01:12:09.299652+0000","last_became_peered":"2024-09-21T01:12:09.299652+0000","last_unstale":"2024-09-21T01:13:54.565332+0000","last_undegraded":"2024-09-21T01:13:54.565332+0000","last_fullsized":"2024-09-21T01:13:54.565332+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:18.610597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71745,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":164,"num_write":37,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.545083+0000","last_change":"2024-09-21T01:12:11.308675+0000","last_active":"2024-09-21T01:13:54.545083+0000","last_peered":"2024-09-21T01:13:54.545083+0000","last_clean":"2024-09-21T01:13:54.545083+0000","last_became_active":"2024-09-21T01:12:11.308317+0000","last_became_peered":"2024-09-21T01:12:11.308317+0000","last_unstale":"2024-09-21T01:13:54.545083+0000","last_undegraded":"2024-09-21T01:13:54.545083+0000","last_fullsized":"2024-09-21T01:13:54.545083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:56.081404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673306+0000","last_change":"2024-09-21T01:12:09.293716+0000","last_active":"2024-09-21T01:12:55.673306+0000","last_peered":"2024-09-21T01:12:55.673306+0000","last_clean":"2024-09-21T01:12:55.673306+0000","last_became_active":"2024-09-21T01:12:09.293205+0000","last_became_peered":"2024-09-21T01:12:09.293205+0000","last_unstale":"2024-09-21T01:12:55.673306+0000","last_undegraded":"2024-09-21T01:12:55.673306+0000","last_fullsized":"2024-09-21T01:12:55.673306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:29.955953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556073+0000","last_change":"2024-09-21T01:12:11.302736+0000","last_active":"2024-09-21T01:13:54.556073+0000","last_peered":"2024-09-21T01:13:54.556073+0000","last_clean":"2024-09-21T01:13:54.556073+0000","last_became_active":"2024-09-21T01:12:11.302357+0000","last_became_peered":"2024-09-21T01:12:11.302357+0000","last_unstale":"2024-09-21T01:13:54.556073+0000","last_undegraded":"2024-09-21T01:13:54.556073+0000","last_fullsized":"2024-09-21T01:13:54.556073+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:34.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.677786+0000","last_change":"2024-09-21T01:12:09.295258+0000","last_active":"2024-09-21T01:12:55.677786+0000","last_peered":"2024-09-21T01:12:55.677786+0000","last_clean":"2024-09-21T01:12:55.677786+0000","last_became_active":"2024-09-21T01:12:09.294872+0000","last_became_peered":"2024-09-21T01:12:09.294872+0000","last_unstale":"2024-09-21T01:12:55.677786+0000","last_undegraded":"2024-09-21T01:12:55.677786+0000","last_fullsized":"2024-09-21T01:12:55.677786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.216960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557603+0000","last_change":"2024-09-21T01:12:11.303413+0000","last_active":"2024-09-21T01:13:54.557603+0000","last_peered":"2024-09-21T01:13:54.557603+0000","last_clean":"2024-09-21T01:13:54.557603+0000","last_became_active":"2024-09-21T01:12:11.303002+0000","last_became_peered":"2024-09-21T01:12:11.303002+0000","last_unstale":"2024-09-21T01:13:54.557603+0000","last_undegraded":"2024-09-21T01:13:54.557603+0000","last_fullsized":"2024-09-21T01:13:54.557603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:55.984699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'7","reported_seq":130,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:55.424886+0000","last_change":"2024-09-21T01:12:09.297392+0000","last_active":"2024-09-21T01:13:55.424886+0000","last_peered":"2024-09-21T01:13:55.424886+0000","last_clean":"2024-09-21T01:13:55.424886+0000","last_became_active":"2024-09-21T01:12:09.296882+0000","last_became_peered":"2024-09-21T01:12:09.296882+0000","last_unstale":"2024-09-21T01:13:55.424886+0000","last_undegraded":"2024-09-21T01:13:55.424886+0000","last_fullsized":"2024-09-21T01:13:55.424886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.598362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1819,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.555500+0000","last_change":"2024-09-21T01:12:11.308021+0000","last_active":"2024-09-21T01:13:54.555500+0000","last_peered":"2024-09-21T01:13:54.555500+0000","last_clean":"2024-09-21T01:13:54.555500+0000","last_became_active":"2024-09-21T01:12:11.307643+0000","last_became_peered":"2024-09-21T01:12:11.307643+0000","last_unstale":"2024-09-21T01:13:54.555500+0000","last_undegraded":"2024-09-21T01:13:54.555500+0000","last_fullsized":"2024-09-21T01:13:54.555500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:55.569855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674898+0000","last_change":"2024-09-21T01:12:09.512120+0000","last_active":"2024-09-21T01:12:55.674898+0000","last_peered":"2024-09-21T01:12:55.674898+0000","last_clean":"2024-09-21T01:12:55.674898+0000","last_became_active":"2024-09-21T01:12:09.511631+0000","last_became_peered":"2024-09-21T01:12:09.511631+0000","last_unstale":"2024-09-21T01:12:55.674898+0000","last_undegraded":"2024-09-21T01:12:55.674898+0000","last_fullsized":"2024-09-21T01:12:55.674898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:13.187219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558542+0000","last_change":"2024-09-21T01:12:11.301633+0000","last_active":"2024-09-21T01:13:54.558542+0000","last_peered":"2024-09-21T01:13:54.558542+0000","last_clean":"2024-09-21T01:13:54.558542+0000","last_became_active":"2024-09-21T01:12:11.300638+0000","last_became_peered":"2024-09-21T01:12:11.300638+0000","last_unstale":"2024-09-21T01:13:54.558542+0000","last_undegraded":"2024-09-21T01:13:54.558542+0000","last_fullsized":"2024-09-21T01:13:54.558542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:42.245596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676122+0000","last_change":"2024-09-21T01:12:09.297694+0000","last_active":"2024-09-21T01:12:55.676122+0000","last_peered":"2024-09-21T01:12:55.676122+0000","last_clean":"2024-09-21T01:12:55.676122+0000","last_became_active":"2024-09-21T01:12:09.297127+0000","last_became_peered":"2024-09-21T01:12:09.297127+0000","last_unstale":"2024-09-21T01:12:55.676122+0000","last_undegraded":"2024-09-21T01:12:55.676122+0000","last_fullsized":"2024-09-21T01:12:55.676122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:35.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671386+0000","last_change":"2024-09-21T01:12:11.303510+0000","last_active":"2024-09-21T01:12:55.671386+0000","last_peered":"2024-09-21T01:12:55.671386+0000","last_clean":"2024-09-21T01:12:55.671386+0000","last_became_active":"2024-09-21T01:12:11.303148+0000","last_became_peered":"2024-09-21T01:12:11.303148+0000","last_unstale":"2024-09-21T01:12:55.671386+0000","last_undegraded":"2024-09-21T01:12:55.671386+0000","last_fullsized":"2024-09-21T01:12:55.671386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:59.338185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823115+0000","last_change":"2024-09-21T01:12:09.293490+0000","last_active":"2024-09-21T01:12:55.823115+0000","last_peered":"2024-09-21T01:12:55.823115+0000","last_clean":"2024-09-21T01:12:55.823115+0000","last_became_active":"2024-09-21T01:12:09.293151+0000","last_became_peered":"2024-09-21T01:12:09.293151+0000","last_unstale":"2024-09-21T01:12:55.823115+0000","last_undegraded":"2024-09-21T01:12:55.823115+0000","last_fullsized":"2024-09-21T01:12:55.823115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:25.153547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558538+0000","last_change":"2024-09-21T01:12:11.311313+0000","last_active":"2024-09-21T01:13:54.558538+0000","last_peered":"2024-09-21T01:13:54.558538+0000","last_clean":"2024-09-21T01:13:54.558538+0000","last_became_active":"2024-09-21T01:12:11.310908+0000","last_became_peered":"2024-09-21T01:12:11.310908+0000","last_unstale":"2024-09-21T01:13:54.558538+0000","last_undegraded":"2024-09-21T01:13:54.558538+0000","last_fullsized":"2024-09-21T01:13:54.558538+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:15.070802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679574+0000","last_change":"2024-09-21T01:12:09.298861+0000","last_active":"2024-09-21T01:12:55.679574+0000","last_peered":"2024-09-21T01:12:55.679574+0000","last_clean":"2024-09-21T01:12:55.679574+0000","last_became_active":"2024-09-21T01:12:09.298504+0000","last_became_peered":"2024-09-21T01:12:09.298504+0000","last_unstale":"2024-09-21T01:12:55.679574+0000","last_undegraded":"2024-09-21T01:12:55.679574+0000","last_fullsized":"2024-09-21T01:12:55.679574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:10.446269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559575+0000","last_change":"2024-09-21T01:12:11.309656+0000","last_active":"2024-09-21T01:13:54.559575+0000","last_peered":"2024-09-21T01:13:54.559575+0000","last_clean":"2024-09-21T01:13:54.559575+0000","last_became_active":"2024-09-21T01:12:11.308515+0000","last_became_peered":"2024-09-21T01:12:11.308515+0000","last_unstale":"2024-09-21T01:13:54.559575+0000","last_undegraded":"2024-09-21T01:13:54.559575+0000","last_fullsized":"2024-09-21T01:13:54.559575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:38.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675314+0000","last_change":"2024-09-21T01:12:09.511434+0000","last_active":"2024-09-21T01:12:55.675314+0000","last_peered":"2024-09-21T01:12:55.675314+0000","last_clean":"2024-09-21T01:12:55.675314+0000","last_became_active":"2024-09-21T01:12:09.511043+0000","last_became_peered":"2024-09-21T01:12:09.511043+0000","last_unstale":"2024-09-21T01:12:55.675314+0000","last_undegraded":"2024-09-21T01:12:55.675314+0000","last_fullsized":"2024-09-21T01:12:55.675314+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:23.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.563217+0000","last_change":"2024-09-21T01:12:11.311989+0000","last_active":"2024-09-21T01:13:54.563217+0000","last_peered":"2024-09-21T01:13:54.563217+0000","last_clean":"2024-09-21T01:13:54.563217+0000","last_became_active":"2024-09-21T01:12:11.310338+0000","last_became_peered":"2024-09-21T01:12:11.310338+0000","last_unstale":"2024-09-21T01:13:54.563217+0000","last_undegraded":"2024-09-21T01:13:54.563217+0000","last_fullsized":"2024-09-21T01:13:54.563217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:12.675575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674556+0000","last_change":"2024-09-21T01:11:01.703479+0000","last_active":"2024-09-21T01:12:55.674556+0000","last_peered":"2024-09-21T01:12:55.674556+0000","last_clean":"2024-09-21T01:12:55.674556+0000","last_became_active":"2024-09-21T01:11:01.697351+0000","last_became_peered":"2024-09-21T01:11:01.697351+0000","last_unstale":"2024-09-21T01:12:55.674556+0000","last_undegraded":"2024-09-21T01:12:55.674556+0000","last_fullsized":"2024-09-21T01:12:55.674556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_clean_scrub_stamp":"2024-09-21T01:07:43.096984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:18.858448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784499+0000","last_change":"2024-09-21T01:12:09.295468+0000","last_active":"2024-09-21T01:12:55.784499+0000","last_peered":"2024-09-21T01:12:55.784499+0000","last_clean":"2024-09-21T01:12:55.784499+0000","last_became_active":"2024-09-21T01:12:09.295092+0000","last_became_peered":"2024-09-21T01:12:09.295092+0000","last_unstale":"2024-09-21T01:12:55.784499+0000","last_undegraded":"2024-09-21T01:12:55.784499+0000","last_fullsized":"2024-09-21T01:12:55.784499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:08.153176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558212+0000","last_change":"2024-09-21T01:12:11.308460+0000","last_active":"2024-09-21T01:13:54.558212+0000","last_peered":"2024-09-21T01:13:54.558212+0000","last_clean":"2024-09-21T01:13:54.558212+0000","last_became_active":"2024-09-21T01:12:11.307764+0000","last_became_peered":"2024-09-21T01:12:11.307764+0000","last_unstale":"2024-09-21T01:13:54.558212+0000","last_undegraded":"2024-09-21T01:13:54.558212+0000","last_fullsized":"2024-09-21T01:13:54.558212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:32.094902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674341+0000","last_change":"2024-09-21T01:12:09.296477+0000","last_active":"2024-09-21T01:12:55.674341+0000","last_peered":"2024-09-21T01:12:55.674341+0000","last_clean":"2024-09-21T01:12:55.674341+0000","last_became_active":"2024-09-21T01:12:09.296153+0000","last_became_peered":"2024-09-21T01:12:09.296153+0000","last_unstale":"2024-09-21T01:12:55.674341+0000","last_undegraded":"2024-09-21T01:12:55.674341+0000","last_fullsized":"2024-09-21T01:12:55.674341+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:42.380668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556641+0000","last_change":"2024-09-21T01:12:11.297826+0000","last_active":"2024-09-21T01:13:54.556641+0000","last_peered":"2024-09-21T01:13:54.556641+0000","last_clean":"2024-09-21T01:13:54.556641+0000","last_became_active":"2024-09-21T01:12:11.297430+0000","last_became_peered":"2024-09-21T01:12:11.297430+0000","last_unstale":"2024-09-21T01:13:54.556641+0000","last_undegraded":"2024-09-21T01:13:54.556641+0000","last_fullsized":"2024-09-21T01:13:54.556641+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:09.130500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":124,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:55.424428+0000","last_change":"2024-09-21T01:12:09.511173+0000","last_active":"2024-09-21T01:13:55.424428+0000","last_peered":"2024-09-21T01:13:55.424428+0000","last_clean":"2024-09-21T01:13:55.424428+0000","last_became_active":"2024-09-21T01:12:09.510840+0000","last_became_peered":"2024-09-21T01:12:09.510840+0000","last_unstale":"2024-09-21T01:13:55.424428+0000","last_undegraded":"2024-09-21T01:13:55.424428+0000","last_fullsized":"2024-09-21T01:13:55.424428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:22.161708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.552514+0000","last_change":"2024-09-21T01:12:55.824825+0000","last_active":"2024-09-21T01:13:54.552514+0000","last_peered":"2024-09-21T01:13:54.552514+0000","last_clean":"2024-09-21T01:13:54.552514+0000","last_became_active":"2024-09-21T01:12:55.824253+0000","last_became_peered":"2024-09-21T01:12:55.824253+0000","last_unstale":"2024-09-21T01:13:54.552514+0000","last_undegraded":"2024-09-21T01:13:54.552514+0000","last_fullsized":"2024-09-21T01:13:54.552514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:14.580270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674696+0000","last_change":"2024-09-21T01:12:09.295447+0000","last_active":"2024-09-21T01:12:55.674696+0000","last_peered":"2024-09-21T01:12:55.674696+0000","last_clean":"2024-09-21T01:12:55.674696+0000","last_became_active":"2024-09-21T01:12:09.295057+0000","last_became_peered":"2024-09-21T01:12:09.295057+0000","last_unstale":"2024-09-21T01:12:55.674696+0000","last_undegraded":"2024-09-21T01:12:55.674696+0000","last_fullsized":"2024-09-21T01:12:55.674696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:59.389877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.554222+0000","last_change":"2024-09-21T01:12:11.304636+0000","last_active":"2024-09-21T01:13:54.554222+0000","last_peered":"2024-09-21T01:13:54.554222+0000","last_clean":"2024-09-21T01:13:54.554222+0000","last_became_active":"2024-09-21T01:12:11.303318+0000","last_became_peered":"2024-09-21T01:12:11.303318+0000","last_unstale":"2024-09-21T01:13:54.554222+0000","last_undegraded":"2024-09-21T01:13:54.554222+0000","last_fullsized":"2024-09-21T01:13:54.554222+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:39.377686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679281+0000","last_change":"2024-09-21T01:12:55.679156+0000","last_active":"2024-09-21T01:12:55.679281+0000","last_peered":"2024-09-21T01:12:55.679281+0000","last_clean":"2024-09-21T01:12:55.679281+0000","last_became_active":"2024-09-21T01:12:55.678638+0000","last_became_peered":"2024-09-21T01:12:55.678638+0000","last_unstale":"2024-09-21T01:12:55.679281+0000","last_undegraded":"2024-09-21T01:12:55.679281+0000","last_fullsized":"2024-09-21T01:12:55.679281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.784868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558308+0000","last_change":"2024-09-21T01:12:11.305558+0000","last_active":"2024-09-21T01:13:54.558308+0000","last_peered":"2024-09-21T01:13:54.558308+0000","last_clean":"2024-09-21T01:13:54.558308+0000","last_became_active":"2024-09-21T01:12:11.304934+0000","last_became_peered":"2024-09-21T01:12:11.304934+0000","last_unstale":"2024-09-21T01:13:54.558308+0000","last_undegraded":"2024-09-21T01:13:54.558308+0000","last_fullsized":"2024-09-21T01:13:54.558308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:52.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675716+0000","last_change":"2024-09-21T01:12:09.511384+0000","last_active":"2024-09-21T01:12:55.675716+0000","last_peered":"2024-09-21T01:12:55.675716+0000","last_clean":"2024-09-21T01:12:55.675716+0000","last_became_active":"2024-09-21T01:12:09.511006+0000","last_became_peered":"2024-09-21T01:12:09.511006+0000","last_unstale":"2024-09-21T01:12:55.675716+0000","last_undegraded":"2024-09-21T01:12:55.675716+0000","last_fullsized":"2024-09-21T01:12:55.675716+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:56.580855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.555176+0000","last_change":"2024-09-21T01:12:11.304912+0000","last_active":"2024-09-21T01:13:54.555176+0000","last_peered":"2024-09-21T01:13:54.555176+0000","last_clean":"2024-09-21T01:13:54.555176+0000","last_became_active":"2024-09-21T01:12:11.304536+0000","last_became_peered":"2024-09-21T01:12:11.304536+0000","last_unstale":"2024-09-21T01:13:54.555176+0000","last_undegraded":"2024-09-21T01:13:54.555176+0000","last_fullsized":"2024-09-21T01:13:54.555176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:45.037231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673929+0000","last_change":"2024-09-21T01:12:09.294680+0000","last_active":"2024-09-21T01:12:55.673929+0000","last_peered":"2024-09-21T01:12:55.673929+0000","last_clean":"2024-09-21T01:12:55.673929+0000","last_became_active":"2024-09-21T01:12:09.294289+0000","last_became_peered":"2024-09-21T01:12:09.294289+0000","last_unstale":"2024-09-21T01:12:55.673929+0000","last_undegraded":"2024-09-21T01:12:55.673929+0000","last_fullsized":"2024-09-21T01:12:55.673929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.824781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559372+0000","last_change":"2024-09-21T01:12:11.305192+0000","last_active":"2024-09-21T01:13:54.559372+0000","last_peered":"2024-09-21T01:13:54.559372+0000","last_clean":"2024-09-21T01:13:54.559372+0000","last_became_active":"2024-09-21T01:12:11.304761+0000","last_became_peered":"2024-09-21T01:12:11.304761+0000","last_unstale":"2024-09-21T01:13:54.559372+0000","last_undegraded":"2024-09-21T01:13:54.559372+0000","last_fullsized":"2024-09-21T01:13:54.559372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:58.429511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784602+0000","last_change":"2024-09-21T01:12:09.455476+0000","last_active":"2024-09-21T01:12:55.784602+0000","last_peered":"2024-09-21T01:12:55.784602+0000","last_clean":"2024-09-21T01:12:55.784602+0000","last_became_active":"2024-09-21T01:12:09.454981+0000","last_became_peered":"2024-09-21T01:12:09.454981+0000","last_unstale":"2024-09-21T01:12:55.784602+0000","last_undegraded":"2024-09-21T01:12:55.784602+0000","last_fullsized":"2024-09-21T01:12:55.784602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:27.790928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559247+0000","last_change":"2024-09-21T01:12:11.300631+0000","last_active":"2024-09-21T01:13:54.559247+0000","last_peered":"2024-09-21T01:13:54.559247+0000","last_clean":"2024-09-21T01:13:54.559247+0000","last_became_active":"2024-09-21T01:12:11.300179+0000","last_became_peered":"2024-09-21T01:12:11.300179+0000","last_unstale":"2024-09-21T01:13:54.559247+0000","last_undegraded":"2024-09-21T01:13:54.559247+0000","last_fullsized":"2024-09-21T01:13:54.559247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:23.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328302+0000","last_change":"2024-09-21T01:12:09.511406+0000","last_active":"2024-09-21T01:12:56.328302+0000","last_peered":"2024-09-21T01:12:56.328302+0000","last_clean":"2024-09-21T01:12:56.328302+0000","last_became_active":"2024-09-21T01:12:09.511117+0000","last_became_peered":"2024-09-21T01:12:09.511117+0000","last_unstale":"2024-09-21T01:12:56.328302+0000","last_undegraded":"2024-09-21T01:12:56.328302+0000","last_fullsized":"2024-09-21T01:12:56.328302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:18.100466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.512711+0000","last_change":"2024-09-21T01:12:11.306933+0000","last_active":"2024-09-21T01:13:54.512711+0000","last_peered":"2024-09-21T01:13:54.512711+0000","last_clean":"2024-09-21T01:13:54.512711+0000","last_became_active":"2024-09-21T01:12:11.306516+0000","last_became_peered":"2024-09-21T01:12:11.306516+0000","last_unstale":"2024-09-21T01:13:54.512711+0000","last_undegraded":"2024-09-21T01:13:54.512711+0000","last_fullsized":"2024-09-21T01:13:54.512711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:40.524953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670767+0000","last_change":"2024-09-21T01:12:09.297506+0000","last_active":"2024-09-21T01:12:55.670767+0000","last_peered":"2024-09-21T01:12:55.670767+0000","last_clean":"2024-09-21T01:12:55.670767+0000","last_became_active":"2024-09-21T01:12:09.297139+0000","last_became_peered":"2024-09-21T01:12:09.297139+0000","last_unstale":"2024-09-21T01:12:55.670767+0000","last_undegraded":"2024-09-21T01:12:55.670767+0000","last_fullsized":"2024-09-21T01:12:55.670767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:05.641171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671193+0000","last_change":"2024-09-21T01:12:11.314053+0000","last_active":"2024-09-21T01:12:55.671193+0000","last_peered":"2024-09-21T01:12:55.671193+0000","last_clean":"2024-09-21T01:12:55.671193+0000","last_became_active":"2024-09-21T01:12:11.313681+0000","last_became_peered":"2024-09-21T01:12:11.313681+0000","last_unstale":"2024-09-21T01:12:55.671193+0000","last_undegraded":"2024-09-21T01:12:55.671193+0000","last_fullsized":"2024-09-21T01:12:55.671193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.108030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674195+0000","last_change":"2024-09-21T01:12:09.298602+0000","last_active":"2024-09-21T01:12:55.674195+0000","last_peered":"2024-09-21T01:12:55.674195+0000","last_clean":"2024-09-21T01:12:55.674195+0000","last_became_active":"2024-09-21T01:12:09.297295+0000","last_became_peered":"2024-09-21T01:12:09.297295+0000","last_unstale":"2024-09-21T01:12:55.674195+0000","last_undegraded":"2024-09-21T01:12:55.674195+0000","last_fullsized":"2024-09-21T01:12:55.674195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:27.253290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553729+0000","last_change":"2024-09-21T01:12:11.306120+0000","last_active":"2024-09-21T01:13:54.553729+0000","last_peered":"2024-09-21T01:13:54.553729+0000","last_clean":"2024-09-21T01:13:54.553729+0000","last_became_active":"2024-09-21T01:12:11.305771+0000","last_became_peered":"2024-09-21T01:12:11.305771+0000","last_unstale":"2024-09-21T01:13:54.553729+0000","last_undegraded":"2024-09-21T01:13:54.553729+0000","last_fullsized":"2024-09-21T01:13:54.553729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:38.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.685158+0000","last_change":"2024-09-21T01:12:55.684585+0000","last_active":"2024-09-21T01:12:55.685158+0000","last_peered":"2024-09-21T01:12:55.685158+0000","last_clean":"2024-09-21T01:12:55.685158+0000","last_became_active":"2024-09-21T01:12:55.677011+0000","last_became_peered":"2024-09-21T01:12:55.677011+0000","last_unstale":"2024-09-21T01:12:55.685158+0000","last_undegraded":"2024-09-21T01:12:55.685158+0000","last_fullsized":"2024-09-21T01:12:55.685158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:09.563212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.563428+0000","last_change":"2024-09-21T01:12:11.312392+0000","last_active":"2024-09-21T01:13:54.563428+0000","last_peered":"2024-09-21T01:13:54.563428+0000","last_clean":"2024-09-21T01:13:54.563428+0000","last_became_active":"2024-09-21T01:12:11.311120+0000","last_became_peered":"2024-09-21T01:12:11.311120+0000","last_unstale":"2024-09-21T01:13:54.563428+0000","last_undegraded":"2024-09-21T01:13:54.563428+0000","last_fullsized":"2024-09-21T01:13:54.563428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:23.292367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558845+0000","last_change":"2024-09-21T01:12:11.301350+0000","last_active":"2024-09-21T01:13:54.558845+0000","last_peered":"2024-09-21T01:13:54.558845+0000","last_clean":"2024-09-21T01:13:54.558845+0000","last_became_active":"2024-09-21T01:12:11.299746+0000","last_became_peered":"2024-09-21T01:12:11.299746+0000","last_unstale":"2024-09-21T01:13:54.558845+0000","last_undegraded":"2024-09-21T01:13:54.558845+0000","last_fullsized":"2024-09-21T01:13:54.558845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:57.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675539+0000","last_change":"2024-09-21T01:12:09.296499+0000","last_active":"2024-09-21T01:12:55.675539+0000","last_peered":"2024-09-21T01:12:55.675539+0000","last_clean":"2024-09-21T01:12:55.675539+0000","last_became_active":"2024-09-21T01:12:09.296000+0000","last_became_peered":"2024-09-21T01:12:09.296000+0000","last_unstale":"2024-09-21T01:12:55.675539+0000","last_undegraded":"2024-09-21T01:12:55.675539+0000","last_fullsized":"2024-09-21T01:12:55.675539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:37.278200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.560633+0000","last_change":"2024-09-21T01:12:11.314014+0000","last_active":"2024-09-21T01:13:54.560633+0000","last_peered":"2024-09-21T01:13:54.560633+0000","last_clean":"2024-09-21T01:13:54.560633+0000","last_became_active":"2024-09-21T01:12:11.312592+0000","last_became_peered":"2024-09-21T01:12:11.312592+0000","last_unstale":"2024-09-21T01:13:54.560633+0000","last_undegraded":"2024-09-21T01:13:54.560633+0000","last_fullsized":"2024-09-21T01:13:54.560633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.074667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675558+0000","last_change":"2024-09-21T01:12:09.297088+0000","last_active":"2024-09-21T01:12:55.675558+0000","last_peered":"2024-09-21T01:12:55.675558+0000","last_clean":"2024-09-21T01:12:55.675558+0000","last_became_active":"2024-09-21T01:12:09.296707+0000","last_became_peered":"2024-09-21T01:12:09.296707+0000","last_unstale":"2024-09-21T01:12:55.675558+0000","last_undegraded":"2024-09-21T01:12:55.675558+0000","last_fullsized":"2024-09-21T01:12:55.675558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:50.138586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556295+0000","last_change":"2024-09-21T01:12:11.300991+0000","last_active":"2024-09-21T01:13:54.556295+0000","last_peered":"2024-09-21T01:13:54.556295+0000","last_clean":"2024-09-21T01:13:54.556295+0000","last_became_active":"2024-09-21T01:12:11.299934+0000","last_became_peered":"2024-09-21T01:12:11.299934+0000","last_unstale":"2024-09-21T01:13:54.556295+0000","last_undegraded":"2024-09-21T01:13:54.556295+0000","last_fullsized":"2024-09-21T01:13:54.556295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:34.300051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671316+0000","last_change":"2024-09-21T01:12:09.511289+0000","last_active":"2024-09-21T01:12:55.671316+0000","last_peered":"2024-09-21T01:12:55.671316+0000","last_clean":"2024-09-21T01:12:55.671316+0000","last_became_active":"2024-09-21T01:12:09.510879+0000","last_became_peered":"2024-09-21T01:12:09.510879+0000","last_unstale":"2024-09-21T01:12:55.671316+0000","last_undegraded":"2024-09-21T01:12:55.671316+0000","last_fullsized":"2024-09-21T01:12:55.671316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:37.950305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.543430+0000","last_change":"2024-09-21T01:12:11.312100+0000","last_active":"2024-09-21T01:13:54.543430+0000","last_peered":"2024-09-21T01:13:54.543430+0000","last_clean":"2024-09-21T01:13:54.543430+0000","last_became_active":"2024-09-21T01:12:11.311731+0000","last_became_peered":"2024-09-21T01:12:11.311731+0000","last_unstale":"2024-09-21T01:13:54.543430+0000","last_undegraded":"2024-09-21T01:13:54.543430+0000","last_fullsized":"2024-09-21T01:13:54.543430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:40.459020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674164+0000","last_change":"2024-09-21T01:12:09.294759+0000","last_active":"2024-09-21T01:12:55.674164+0000","last_peered":"2024-09-21T01:12:55.674164+0000","last_clean":"2024-09-21T01:12:55.674164+0000","last_became_active":"2024-09-21T01:12:09.294391+0000","last_became_peered":"2024-09-21T01:12:09.294391+0000","last_unstale":"2024-09-21T01:12:55.674164+0000","last_undegraded":"2024-09-21T01:12:55.674164+0000","last_fullsized":"2024-09-21T01:12:55.674164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:05.981058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":449,"ondisk_log_size":449,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76586,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":597,"num_read_kb":373,"num_write":175,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":232278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776162,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":815104,"data_stored":396084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1523712,"data_stored":1059759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":831488,"data_stored":396320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":831488,"data_stored":396240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716736,"statfs":{"total":95995035648,"available":95965937664,"internally_reserved":0,"allocated":1425408,"data_stored":988619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36144,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709008,"statfs":{"total":95995035648,"available":95958024192,"internally_reserved":0,"allocated":819200,"data_stored":395709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32588,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712564,"statfs":{"total":95995035648,"available":95961665536,"internally_reserved":0,"allocated":1437696,"data_stored":987463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40308,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704844,"statfs":{"total":95995035648,"available":95953760256,"internally_reserved":0,"allocated":823296,"data_stored":397377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":396020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":471117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":467247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":396980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":75615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":74554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:13:58.415 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T01:13:58.415 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:13:58.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.560+0000 7fcac78be640 1 -- 172.21.15.148:0/1337206412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcac01093b0 msgr2=0x7fcac010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.560+0000 7fcac78be640 1 --2- 172.21.15.148:0/1337206412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcac01093b0 0x7fcac010b8c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009ca0 tx=0x7fcab802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 -- 172.21.15.148:0/1337206412 shutdown_connections 2024-09-21T01:13:58.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 --2- 172.21.15.148:0/1337206412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcac01093b0 0x7fcac010b8c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 --2- 172.21.15.148:0/1337206412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcac0106830 0x7fcac0108c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 --2- 172.21.15.148:0/1337206412 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcac006c440 0x7fcac01062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 -- 172.21.15.148:0/1337206412 >> 172.21.15.148:0/1337206412 conn(0x7fcac00fdeb0 msgr2=0x7fcac0100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 -- 172.21.15.148:0/1337206412 shutdown_connections 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 -- 172.21.15.148:0/1337206412 wait complete. 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 Processor -- start 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 -- start start 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcac006c440 0x7fcac0199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcac0106830 0x7fcac019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcac01093b0 0x7fcac019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcac010f2c0 con 0x7fcac01093b0 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcac010f140 con 0x7fcac006c440 2024-09-21T01:13:58.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.561+0000 7fcac78be640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcac010f440 con 0x7fcac0106830 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac5e5b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcac01093b0 0x7fcac019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac5e5b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcac01093b0 0x7fcac019b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51390/0 (socket says 172.21.15.148:51390) 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac5e5b640 1 -- 172.21.15.148:0/3106215949 learned_addr learned my addr 172.21.15.148:0/3106215949 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac4e59640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcac0106830 0x7fcac019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac565a640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcac006c440 0x7fcac0199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac5e5b640 1 -- 172.21.15.148:0/3106215949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcac0106830 msgr2=0x7fcac019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac5e5b640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcac0106830 0x7fcac019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac5e5b640 1 -- 172.21.15.148:0/3106215949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcac006c440 msgr2=0x7fcac0199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac5e5b640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcac006c440 0x7fcac0199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac5e5b640 1 -- 172.21.15.148:0/3106215949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac019b8c0 con 0x7fcac01093b0 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac565a640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcac006c440 0x7fcac0199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac5e5b640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcac01093b0 0x7fcac019b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcab80097b0 tx=0x7fcab8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcab67fc640 1 -- 172.21.15.148:0/3106215949 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8004240 con 0x7fcac01093b0 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcab67fc640 1 -- 172.21.15.148:0/3106215949 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcab802f380 con 0x7fcac01093b0 2024-09-21T01:13:58.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac78be640 1 -- 172.21.15.148:0/3106215949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac019bb50 con 0x7fcac01093b0 2024-09-21T01:13:58.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcab67fc640 1 -- 172.21.15.148:0/3106215949 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab802fc30 con 0x7fcac01093b0 2024-09-21T01:13:58.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.562+0000 7fcac78be640 1 -- 172.21.15.148:0/3106215949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac01a22a0 con 0x7fcac01093b0 2024-09-21T01:13:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.563+0000 7fcac78be640 1 -- 172.21.15.148:0/3106215949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac0106c60 con 0x7fcac01093b0 2024-09-21T01:13:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.565+0000 7fcab67fc640 1 -- 172.21.15.148:0/3106215949 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7fcab80043e0 con 0x7fcac01093b0 2024-09-21T01:13:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.566+0000 7fcab67fc640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcaac0b65a0 0x7fcaac0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.566+0000 7fcac565a640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcaac0b65a0 0x7fcaac0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.566+0000 7fcab67fc640 1 -- 172.21.15.148:0/3106215949 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fcab8108b40 con 0x7fcac01093b0 2024-09-21T01:13:58.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.566+0000 7fcac565a640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcaac0b65a0 0x7fcaac0b8ab0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0058c0 tx=0x7fcabc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:58.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.569+0000 7fcab67fc640 1 -- 172.21.15.148:0/3106215949 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcab80cf280 con 0x7fcac01093b0 2024-09-21T01:13:58.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:58 smithi148 ceph-mon[31000]: pgmap v337: 97 pgs: 97 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T01:13:58.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:58 smithi148 ceph-mon[31000]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T01:13:58.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:58 smithi181 ceph-mon[34811]: pgmap v337: 97 pgs: 97 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T01:13:58.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:58 smithi181 ceph-mon[34811]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T01:13:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:58 smithi157 ceph-mon[34140]: pgmap v337: 97 pgs: 97 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T01:13:58.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:58 smithi157 ceph-mon[34140]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T01:13:58.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.744+0000 7fcac78be640 1 -- 172.21.15.148:0/3106215949 --> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcac0063800 con 0x7fcaac0b65a0 2024-09-21T01:13:58.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.749+0000 7fcab67fc640 1 -- 172.21.15.148:0/3106215949 <== mgr.14152 v2:172.21.15.148:6800/1101840134 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258956 (secure 0 0 0) 0x7fcac0063800 con 0x7fcaac0b65a0 2024-09-21T01:13:58.752 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:58.753 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 -- 172.21.15.148:0/3106215949 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcaac0b65a0 msgr2=0x7fcaac0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcaac0b65a0 0x7fcaac0b8ab0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0058c0 tx=0x7fcabc005850 comp rx=0 tx=0).stop 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 -- 172.21.15.148:0/3106215949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcac01093b0 msgr2=0x7fcac019b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcac01093b0 0x7fcac019b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcab80097b0 tx=0x7fcab8003c20 comp rx=0 tx=0).stop 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 -- 172.21.15.148:0/3106215949 shutdown_connections 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcaac0b65a0 0x7fcaac0b8ab0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcac01093b0 0x7fcac019b0a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcac0106830 0x7fcac019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 --2- 172.21.15.148:0/3106215949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcac006c440 0x7fcac0199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 -- 172.21.15.148:0/3106215949 >> 172.21.15.148:0/3106215949 conn(0x7fcac00fdeb0 msgr2=0x7fcac0104ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:58.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 -- 172.21.15.148:0/3106215949 shutdown_connections 2024-09-21T01:13:58.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:58.752+0000 7fcac78be640 1 -- 172.21.15.148:0/3106215949 wait complete. 2024-09-21T01:13:58.764 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-21T01:13:58.346281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667188,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":673,"num_read_kb":437,"num_write":300,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":691,"ondisk_log_size":691,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390104,"kb_used_data":11712,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551720,"statfs":{"total":1151940427776,"available":1151540961280,"internally_reserved":0,"allocated":11993088,"data_stored":6748935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6137,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":11,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002936"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671714+0000","last_change":"2024-09-21T01:12:11.314815+0000","last_active":"2024-09-21T01:12:55.671714+0000","last_peered":"2024-09-21T01:12:55.671714+0000","last_clean":"2024-09-21T01:12:55.671714+0000","last_became_active":"2024-09-21T01:12:11.314139+0000","last_became_peered":"2024-09-21T01:12:11.314139+0000","last_unstale":"2024-09-21T01:12:55.671714+0000","last_undegraded":"2024-09-21T01:12:55.671714+0000","last_fullsized":"2024-09-21T01:12:55.671714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:51.538846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.551406+0000","last_change":"2024-09-21T01:12:11.309915+0000","last_active":"2024-09-21T01:13:54.551406+0000","last_peered":"2024-09-21T01:13:54.551406+0000","last_clean":"2024-09-21T01:13:54.551406+0000","last_became_active":"2024-09-21T01:12:11.309551+0000","last_became_peered":"2024-09-21T01:12:11.309551+0000","last_unstale":"2024-09-21T01:13:54.551406+0000","last_undegraded":"2024-09-21T01:13:54.551406+0000","last_fullsized":"2024-09-21T01:13:54.551406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.568041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557496+0000","last_change":"2024-09-21T01:12:11.306393+0000","last_active":"2024-09-21T01:13:54.557496+0000","last_peered":"2024-09-21T01:13:54.557496+0000","last_clean":"2024-09-21T01:13:54.557496+0000","last_became_active":"2024-09-21T01:12:11.306035+0000","last_became_peered":"2024-09-21T01:12:11.306035+0000","last_unstale":"2024-09-21T01:13:54.557496+0000","last_undegraded":"2024-09-21T01:13:54.557496+0000","last_fullsized":"2024-09-21T01:13:54.557496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:20.528141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.554699+0000","last_change":"2024-09-21T01:12:11.302339+0000","last_active":"2024-09-21T01:13:54.554699+0000","last_peered":"2024-09-21T01:13:54.554699+0000","last_clean":"2024-09-21T01:13:54.554699+0000","last_became_active":"2024-09-21T01:12:11.301890+0000","last_became_peered":"2024-09-21T01:12:11.301890+0000","last_unstale":"2024-09-21T01:13:54.554699+0000","last_undegraded":"2024-09-21T01:13:54.554699+0000","last_fullsized":"2024-09-21T01:13:54.554699+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:34.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.545070+0000","last_change":"2024-09-21T01:12:11.299171+0000","last_active":"2024-09-21T01:13:54.545070+0000","last_peered":"2024-09-21T01:13:54.545070+0000","last_clean":"2024-09-21T01:13:54.545070+0000","last_became_active":"2024-09-21T01:12:11.298764+0000","last_became_peered":"2024-09-21T01:12:11.298764+0000","last_unstale":"2024-09-21T01:13:54.545070+0000","last_undegraded":"2024-09-21T01:13:54.545070+0000","last_fullsized":"2024-09-21T01:13:54.545070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:02.078587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553317+0000","last_change":"2024-09-21T01:12:11.307909+0000","last_active":"2024-09-21T01:13:54.553317+0000","last_peered":"2024-09-21T01:13:54.553317+0000","last_clean":"2024-09-21T01:13:54.553317+0000","last_became_active":"2024-09-21T01:12:11.307546+0000","last_became_peered":"2024-09-21T01:12:11.307546+0000","last_unstale":"2024-09-21T01:13:54.553317+0000","last_undegraded":"2024-09-21T01:13:54.553317+0000","last_fullsized":"2024-09-21T01:13:54.553317+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:48.683684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553588+0000","last_change":"2024-09-21T01:12:11.309402+0000","last_active":"2024-09-21T01:13:54.553588+0000","last_peered":"2024-09-21T01:13:54.553588+0000","last_clean":"2024-09-21T01:13:54.553588+0000","last_became_active":"2024-09-21T01:12:11.309019+0000","last_became_peered":"2024-09-21T01:12:11.309019+0000","last_unstale":"2024-09-21T01:13:54.553588+0000","last_undegraded":"2024-09-21T01:13:54.553588+0000","last_fullsized":"2024-09-21T01:13:54.553588+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:55.020239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.552164+0000","last_change":"2024-09-21T01:12:11.308589+0000","last_active":"2024-09-21T01:13:54.552164+0000","last_peered":"2024-09-21T01:13:54.552164+0000","last_clean":"2024-09-21T01:13:54.552164+0000","last_became_active":"2024-09-21T01:12:11.308133+0000","last_became_peered":"2024-09-21T01:12:11.308133+0000","last_unstale":"2024-09-21T01:13:54.552164+0000","last_undegraded":"2024-09-21T01:13:54.552164+0000","last_fullsized":"2024-09-21T01:13:54.552164+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:15.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556124+0000","last_change":"2024-09-21T01:12:55.681017+0000","last_active":"2024-09-21T01:13:54.556124+0000","last_peered":"2024-09-21T01:13:54.556124+0000","last_clean":"2024-09-21T01:13:54.556124+0000","last_became_active":"2024-09-21T01:12:55.680594+0000","last_became_peered":"2024-09-21T01:12:55.680594+0000","last_unstale":"2024-09-21T01:13:54.556124+0000","last_undegraded":"2024-09-21T01:13:54.556124+0000","last_fullsized":"2024-09-21T01:13:54.556124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:13.847129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553601+0000","last_change":"2024-09-21T01:12:11.311426+0000","last_active":"2024-09-21T01:13:54.553601+0000","last_peered":"2024-09-21T01:13:54.553601+0000","last_clean":"2024-09-21T01:13:54.553601+0000","last_became_active":"2024-09-21T01:12:11.309351+0000","last_became_peered":"2024-09-21T01:12:11.309351+0000","last_unstale":"2024-09-21T01:13:54.553601+0000","last_undegraded":"2024-09-21T01:13:54.553601+0000","last_fullsized":"2024-09-21T01:13:54.553601+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:31.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.562551+0000","last_change":"2024-09-21T01:12:11.312171+0000","last_active":"2024-09-21T01:13:54.562551+0000","last_peered":"2024-09-21T01:13:54.562551+0000","last_clean":"2024-09-21T01:13:54.562551+0000","last_became_active":"2024-09-21T01:12:11.311542+0000","last_became_peered":"2024-09-21T01:12:11.311542+0000","last_unstale":"2024-09-21T01:13:54.562551+0000","last_undegraded":"2024-09-21T01:13:54.562551+0000","last_fullsized":"2024-09-21T01:13:54.562551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:13.257463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.554226+0000","last_change":"2024-09-21T01:12:11.301344+0000","last_active":"2024-09-21T01:13:54.554226+0000","last_peered":"2024-09-21T01:13:54.554226+0000","last_clean":"2024-09-21T01:13:54.554226+0000","last_became_active":"2024-09-21T01:12:11.300593+0000","last_became_peered":"2024-09-21T01:12:11.300593+0000","last_unstale":"2024-09-21T01:13:54.554226+0000","last_undegraded":"2024-09-21T01:13:54.554226+0000","last_fullsized":"2024-09-21T01:13:54.554226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:12.659972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556456+0000","last_change":"2024-09-21T01:12:11.298690+0000","last_active":"2024-09-21T01:13:54.556456+0000","last_peered":"2024-09-21T01:13:54.556456+0000","last_clean":"2024-09-21T01:13:54.556456+0000","last_became_active":"2024-09-21T01:12:11.298418+0000","last_became_peered":"2024-09-21T01:12:11.298418+0000","last_unstale":"2024-09-21T01:13:54.556456+0000","last_undegraded":"2024-09-21T01:13:54.556456+0000","last_fullsized":"2024-09-21T01:13:54.556456+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:13:08.311791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557890+0000","last_change":"2024-09-21T01:12:11.299382+0000","last_active":"2024-09-21T01:13:54.557890+0000","last_peered":"2024-09-21T01:13:54.557890+0000","last_clean":"2024-09-21T01:13:54.557890+0000","last_became_active":"2024-09-21T01:12:11.298428+0000","last_became_peered":"2024-09-21T01:12:11.298428+0000","last_unstale":"2024-09-21T01:13:54.557890+0000","last_undegraded":"2024-09-21T01:13:54.557890+0000","last_fullsized":"2024-09-21T01:13:54.557890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:02.472994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557508+0000","last_change":"2024-09-21T01:12:11.305018+0000","last_active":"2024-09-21T01:13:54.557508+0000","last_peered":"2024-09-21T01:13:54.557508+0000","last_clean":"2024-09-21T01:13:54.557508+0000","last_became_active":"2024-09-21T01:12:11.304607+0000","last_became_peered":"2024-09-21T01:12:11.304607+0000","last_unstale":"2024-09-21T01:13:54.557508+0000","last_undegraded":"2024-09-21T01:13:54.557508+0000","last_fullsized":"2024-09-21T01:13:54.557508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:23:39.552633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.560273+0000","last_change":"2024-09-21T01:12:11.308846+0000","last_active":"2024-09-21T01:13:54.560273+0000","last_peered":"2024-09-21T01:13:54.560273+0000","last_clean":"2024-09-21T01:13:54.560273+0000","last_became_active":"2024-09-21T01:12:11.308486+0000","last_became_peered":"2024-09-21T01:12:11.308486+0000","last_unstale":"2024-09-21T01:13:54.560273+0000","last_undegraded":"2024-09-21T01:13:54.560273+0000","last_fullsized":"2024-09-21T01:13:54.560273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:29.072947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671796+0000","last_change":"2024-09-21T01:12:11.316277+0000","last_active":"2024-09-21T01:12:55.671796+0000","last_peered":"2024-09-21T01:12:55.671796+0000","last_clean":"2024-09-21T01:12:55.671796+0000","last_became_active":"2024-09-21T01:12:11.315364+0000","last_became_peered":"2024-09-21T01:12:11.315364+0000","last_unstale":"2024-09-21T01:12:55.671796+0000","last_undegraded":"2024-09-21T01:12:55.671796+0000","last_fullsized":"2024-09-21T01:12:55.671796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:50.281556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.561432+0000","last_change":"2024-09-21T01:12:11.300761+0000","last_active":"2024-09-21T01:13:54.561432+0000","last_peered":"2024-09-21T01:13:54.561432+0000","last_clean":"2024-09-21T01:13:54.561432+0000","last_became_active":"2024-09-21T01:12:11.300343+0000","last_became_peered":"2024-09-21T01:12:11.300343+0000","last_unstale":"2024-09-21T01:13:54.561432+0000","last_undegraded":"2024-09-21T01:13:54.561432+0000","last_fullsized":"2024-09-21T01:13:54.561432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:29.634930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553156+0000","last_change":"2024-09-21T01:12:11.305370+0000","last_active":"2024-09-21T01:13:54.553156+0000","last_peered":"2024-09-21T01:13:54.553156+0000","last_clean":"2024-09-21T01:13:54.553156+0000","last_became_active":"2024-09-21T01:12:11.304991+0000","last_became_peered":"2024-09-21T01:12:11.304991+0000","last_unstale":"2024-09-21T01:13:54.553156+0000","last_undegraded":"2024-09-21T01:13:54.553156+0000","last_fullsized":"2024-09-21T01:13:54.553156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:14:12.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671227+0000","last_change":"2024-09-21T01:12:11.303981+0000","last_active":"2024-09-21T01:12:55.671227+0000","last_peered":"2024-09-21T01:12:55.671227+0000","last_clean":"2024-09-21T01:12:55.671227+0000","last_became_active":"2024-09-21T01:12:11.303602+0000","last_became_peered":"2024-09-21T01:12:11.303602+0000","last_unstale":"2024-09-21T01:12:55.671227+0000","last_undegraded":"2024-09-21T01:12:55.671227+0000","last_fullsized":"2024-09-21T01:12:55.671227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:24.513365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559884+0000","last_change":"2024-09-21T01:12:11.302849+0000","last_active":"2024-09-21T01:13:54.559884+0000","last_peered":"2024-09-21T01:13:54.559884+0000","last_clean":"2024-09-21T01:13:54.559884+0000","last_became_active":"2024-09-21T01:12:11.302487+0000","last_became_peered":"2024-09-21T01:12:11.302487+0000","last_unstale":"2024-09-21T01:13:54.559884+0000","last_undegraded":"2024-09-21T01:13:54.559884+0000","last_fullsized":"2024-09-21T01:13:54.559884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:44.174213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.560302+0000","last_change":"2024-09-21T01:12:11.315578+0000","last_active":"2024-09-21T01:13:54.560302+0000","last_peered":"2024-09-21T01:13:54.560302+0000","last_clean":"2024-09-21T01:13:54.560302+0000","last_became_active":"2024-09-21T01:12:11.315174+0000","last_became_peered":"2024-09-21T01:12:11.315174+0000","last_unstale":"2024-09-21T01:13:54.560302+0000","last_undegraded":"2024-09-21T01:13:54.560302+0000","last_fullsized":"2024-09-21T01:13:54.560302+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:46.172101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556898+0000","last_change":"2024-09-21T01:12:11.308086+0000","last_active":"2024-09-21T01:13:54.556898+0000","last_peered":"2024-09-21T01:13:54.556898+0000","last_clean":"2024-09-21T01:13:54.556898+0000","last_became_active":"2024-09-21T01:12:11.307248+0000","last_became_peered":"2024-09-21T01:12:11.307248+0000","last_unstale":"2024-09-21T01:13:54.556898+0000","last_undegraded":"2024-09-21T01:13:54.556898+0000","last_fullsized":"2024-09-21T01:13:54.556898+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:11.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553469+0000","last_change":"2024-09-21T01:12:11.301672+0000","last_active":"2024-09-21T01:13:54.553469+0000","last_peered":"2024-09-21T01:13:54.553469+0000","last_clean":"2024-09-21T01:13:54.553469+0000","last_became_active":"2024-09-21T01:12:11.298775+0000","last_became_peered":"2024-09-21T01:12:11.298775+0000","last_unstale":"2024-09-21T01:13:54.553469+0000","last_undegraded":"2024-09-21T01:13:54.553469+0000","last_fullsized":"2024-09-21T01:13:54.553469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:30.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.547049+0000","last_change":"2024-09-21T01:12:11.311947+0000","last_active":"2024-09-21T01:13:54.547049+0000","last_peered":"2024-09-21T01:13:54.547049+0000","last_clean":"2024-09-21T01:13:54.547049+0000","last_became_active":"2024-09-21T01:12:11.311616+0000","last_became_peered":"2024-09-21T01:12:11.311616+0000","last_unstale":"2024-09-21T01:13:54.547049+0000","last_undegraded":"2024-09-21T01:13:54.547049+0000","last_fullsized":"2024-09-21T01:13:54.547049+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:25.727807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557055+0000","last_change":"2024-09-21T01:12:11.312161+0000","last_active":"2024-09-21T01:13:54.557055+0000","last_peered":"2024-09-21T01:13:54.557055+0000","last_clean":"2024-09-21T01:13:54.557055+0000","last_became_active":"2024-09-21T01:12:11.311781+0000","last_became_peered":"2024-09-21T01:12:11.311781+0000","last_unstale":"2024-09-21T01:13:54.557055+0000","last_undegraded":"2024-09-21T01:13:54.557055+0000","last_fullsized":"2024-09-21T01:13:54.557055+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:01.923801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671385+0000","last_change":"2024-09-21T01:12:11.310698+0000","last_active":"2024-09-21T01:12:55.671385+0000","last_peered":"2024-09-21T01:12:55.671385+0000","last_clean":"2024-09-21T01:12:55.671385+0000","last_became_active":"2024-09-21T01:12:11.310226+0000","last_became_peered":"2024-09-21T01:12:11.310226+0000","last_unstale":"2024-09-21T01:12:55.671385+0000","last_undegraded":"2024-09-21T01:12:55.671385+0000","last_fullsized":"2024-09-21T01:12:55.671385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:27.428457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.560242+0000","last_change":"2024-09-21T01:12:11.294598+0000","last_active":"2024-09-21T01:13:54.560242+0000","last_peered":"2024-09-21T01:13:54.560242+0000","last_clean":"2024-09-21T01:13:54.560242+0000","last_became_active":"2024-09-21T01:12:11.293899+0000","last_became_peered":"2024-09-21T01:12:11.293899+0000","last_unstale":"2024-09-21T01:13:54.560242+0000","last_undegraded":"2024-09-21T01:13:54.560242+0000","last_fullsized":"2024-09-21T01:13:54.560242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.843199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556669+0000","last_change":"2024-09-21T01:12:11.295143+0000","last_active":"2024-09-21T01:13:54.556669+0000","last_peered":"2024-09-21T01:13:54.556669+0000","last_clean":"2024-09-21T01:13:54.556669+0000","last_became_active":"2024-09-21T01:12:11.294787+0000","last_became_peered":"2024-09-21T01:12:11.294787+0000","last_unstale":"2024-09-21T01:13:54.556669+0000","last_undegraded":"2024-09-21T01:13:54.556669+0000","last_fullsized":"2024-09-21T01:13:54.556669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:34.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.561724+0000","last_change":"2024-09-21T01:12:55.679399+0000","last_active":"2024-09-21T01:13:54.561724+0000","last_peered":"2024-09-21T01:13:54.561724+0000","last_clean":"2024-09-21T01:13:54.561724+0000","last_became_active":"2024-09-21T01:12:55.678933+0000","last_became_peered":"2024-09-21T01:12:55.678933+0000","last_unstale":"2024-09-21T01:13:54.561724+0000","last_undegraded":"2024-09-21T01:13:54.561724+0000","last_fullsized":"2024-09-21T01:13:54.561724+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:20.204715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.548138+0000","last_change":"2024-09-21T01:12:55.680711+0000","last_active":"2024-09-21T01:13:54.548138+0000","last_peered":"2024-09-21T01:13:54.548138+0000","last_clean":"2024-09-21T01:13:54.548138+0000","last_became_active":"2024-09-21T01:12:55.680257+0000","last_became_peered":"2024-09-21T01:12:55.680257+0000","last_unstale":"2024-09-21T01:13:54.548138+0000","last_undegraded":"2024-09-21T01:13:54.548138+0000","last_fullsized":"2024-09-21T01:13:54.548138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:03.610951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671133+0000","last_change":"2024-09-21T01:12:11.308355+0000","last_active":"2024-09-21T01:12:55.671133+0000","last_peered":"2024-09-21T01:12:55.671133+0000","last_clean":"2024-09-21T01:12:55.671133+0000","last_became_active":"2024-09-21T01:12:11.307919+0000","last_became_peered":"2024-09-21T01:12:11.307919+0000","last_unstale":"2024-09-21T01:12:55.671133+0000","last_undegraded":"2024-09-21T01:12:55.671133+0000","last_fullsized":"2024-09-21T01:12:55.671133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:59.869646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.561785+0000","last_change":"2024-09-21T01:12:11.298905+0000","last_active":"2024-09-21T01:13:54.561785+0000","last_peered":"2024-09-21T01:13:54.561785+0000","last_clean":"2024-09-21T01:13:54.561785+0000","last_became_active":"2024-09-21T01:12:11.298512+0000","last_became_peered":"2024-09-21T01:12:11.298512+0000","last_unstale":"2024-09-21T01:13:54.561785+0000","last_undegraded":"2024-09-21T01:13:54.561785+0000","last_fullsized":"2024-09-21T01:13:54.561785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:05.290239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":125,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.422905+0000","last_change":"2024-09-21T01:12:09.294881+0000","last_active":"2024-09-21T01:13:54.422905+0000","last_peered":"2024-09-21T01:13:54.422905+0000","last_clean":"2024-09-21T01:13:54.422905+0000","last_became_active":"2024-09-21T01:12:09.294513+0000","last_became_peered":"2024-09-21T01:12:09.294513+0000","last_unstale":"2024-09-21T01:13:54.422905+0000","last_undegraded":"2024-09-21T01:13:54.422905+0000","last_fullsized":"2024-09-21T01:13:54.422905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:07.193879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.563814+0000","last_change":"2024-09-21T01:12:55.676259+0000","last_active":"2024-09-21T01:13:54.563814+0000","last_peered":"2024-09-21T01:13:54.563814+0000","last_clean":"2024-09-21T01:13:54.563814+0000","last_became_active":"2024-09-21T01:12:55.675810+0000","last_became_peered":"2024-09-21T01:12:55.675810+0000","last_unstale":"2024-09-21T01:13:54.563814+0000","last_undegraded":"2024-09-21T01:13:54.563814+0000","last_fullsized":"2024-09-21T01:13:54.563814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:34.985195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.669122+0000","last_change":"2024-09-21T01:12:09.298594+0000","last_active":"2024-09-21T01:12:55.669122+0000","last_peered":"2024-09-21T01:12:55.669122+0000","last_clean":"2024-09-21T01:12:55.669122+0000","last_became_active":"2024-09-21T01:12:09.298130+0000","last_became_peered":"2024-09-21T01:12:09.298130+0000","last_unstale":"2024-09-21T01:12:55.669122+0000","last_undegraded":"2024-09-21T01:12:55.669122+0000","last_fullsized":"2024-09-21T01:12:55.669122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.964507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.822858+0000","last_change":"2024-09-21T01:12:09.295997+0000","last_active":"2024-09-21T01:12:55.822858+0000","last_peered":"2024-09-21T01:12:55.822858+0000","last_clean":"2024-09-21T01:12:55.822858+0000","last_became_active":"2024-09-21T01:12:09.295472+0000","last_became_peered":"2024-09-21T01:12:09.295472+0000","last_unstale":"2024-09-21T01:12:55.822858+0000","last_undegraded":"2024-09-21T01:12:55.822858+0000","last_fullsized":"2024-09-21T01:12:55.822858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:25.129076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557274+0000","last_change":"2024-09-21T01:12:11.306468+0000","last_active":"2024-09-21T01:13:54.557274+0000","last_peered":"2024-09-21T01:13:54.557274+0000","last_clean":"2024-09-21T01:13:54.557274+0000","last_became_active":"2024-09-21T01:12:11.304186+0000","last_became_peered":"2024-09-21T01:12:11.304186+0000","last_unstale":"2024-09-21T01:13:54.557274+0000","last_undegraded":"2024-09-21T01:13:54.557274+0000","last_fullsized":"2024-09-21T01:13:54.557274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:28.564879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.678732+0000","last_change":"2024-09-21T01:12:09.295004+0000","last_active":"2024-09-21T01:12:55.678732+0000","last_peered":"2024-09-21T01:12:55.678732+0000","last_clean":"2024-09-21T01:12:55.678732+0000","last_became_active":"2024-09-21T01:12:09.294655+0000","last_became_peered":"2024-09-21T01:12:09.294655+0000","last_unstale":"2024-09-21T01:12:55.678732+0000","last_undegraded":"2024-09-21T01:12:55.678732+0000","last_fullsized":"2024-09-21T01:12:55.678732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:35.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.562576+0000","last_change":"2024-09-21T01:12:11.304252+0000","last_active":"2024-09-21T01:13:54.562576+0000","last_peered":"2024-09-21T01:13:54.562576+0000","last_clean":"2024-09-21T01:13:54.562576+0000","last_became_active":"2024-09-21T01:12:11.303876+0000","last_became_peered":"2024-09-21T01:12:11.303876+0000","last_unstale":"2024-09-21T01:13:54.562576+0000","last_undegraded":"2024-09-21T01:13:54.562576+0000","last_fullsized":"2024-09-21T01:13:54.562576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:48.460538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":120,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:53.420796+0000","last_change":"2024-09-21T01:12:09.298976+0000","last_active":"2024-09-21T01:13:53.420796+0000","last_peered":"2024-09-21T01:13:53.420796+0000","last_clean":"2024-09-21T01:13:53.420796+0000","last_became_active":"2024-09-21T01:12:09.298664+0000","last_became_peered":"2024-09-21T01:12:09.298664+0000","last_unstale":"2024-09-21T01:13:53.420796+0000","last_undegraded":"2024-09-21T01:13:53.420796+0000","last_fullsized":"2024-09-21T01:13:53.420796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:58.157391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.560268+0000","last_change":"2024-09-21T01:12:11.313400+0000","last_active":"2024-09-21T01:13:54.560268+0000","last_peered":"2024-09-21T01:13:54.560268+0000","last_clean":"2024-09-21T01:13:54.560268+0000","last_became_active":"2024-09-21T01:12:11.312940+0000","last_became_peered":"2024-09-21T01:12:11.312940+0000","last_unstale":"2024-09-21T01:13:54.560268+0000","last_undegraded":"2024-09-21T01:13:54.560268+0000","last_fullsized":"2024-09-21T01:13:54.560268+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:22.224157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674784+0000","last_change":"2024-09-21T01:12:09.299266+0000","last_active":"2024-09-21T01:12:55.674784+0000","last_peered":"2024-09-21T01:12:55.674784+0000","last_clean":"2024-09-21T01:12:55.674784+0000","last_became_active":"2024-09-21T01:12:09.298932+0000","last_became_peered":"2024-09-21T01:12:09.298932+0000","last_unstale":"2024-09-21T01:12:55.674784+0000","last_undegraded":"2024-09-21T01:12:55.674784+0000","last_fullsized":"2024-09-21T01:12:55.674784+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:33:51.546829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.552612+0000","last_change":"2024-09-21T01:12:55.681618+0000","last_active":"2024-09-21T01:13:54.552612+0000","last_peered":"2024-09-21T01:13:54.552612+0000","last_clean":"2024-09-21T01:13:54.552612+0000","last_became_active":"2024-09-21T01:12:55.681211+0000","last_became_peered":"2024-09-21T01:12:55.681211+0000","last_unstale":"2024-09-21T01:13:54.552612+0000","last_undegraded":"2024-09-21T01:13:54.552612+0000","last_fullsized":"2024-09-21T01:13:54.552612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:24.588338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679447+0000","last_change":"2024-09-21T01:12:09.511908+0000","last_active":"2024-09-21T01:12:55.679447+0000","last_peered":"2024-09-21T01:12:55.679447+0000","last_clean":"2024-09-21T01:12:55.679447+0000","last_became_active":"2024-09-21T01:12:09.511550+0000","last_became_peered":"2024-09-21T01:12:09.511550+0000","last_unstale":"2024-09-21T01:12:55.679447+0000","last_undegraded":"2024-09-21T01:12:55.679447+0000","last_fullsized":"2024-09-21T01:12:55.679447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:08.743648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.561546+0000","last_change":"2024-09-21T01:12:11.316005+0000","last_active":"2024-09-21T01:13:54.561546+0000","last_peered":"2024-09-21T01:13:54.561546+0000","last_clean":"2024-09-21T01:13:54.561546+0000","last_became_active":"2024-09-21T01:12:11.315245+0000","last_became_peered":"2024-09-21T01:12:11.315245+0000","last_unstale":"2024-09-21T01:13:54.561546+0000","last_undegraded":"2024-09-21T01:13:54.561546+0000","last_fullsized":"2024-09-21T01:13:54.561546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:50.056886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'36","reported_seq":257,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.565332+0000","last_change":"2024-09-21T01:12:09.300010+0000","last_active":"2024-09-21T01:13:54.565332+0000","last_peered":"2024-09-21T01:13:54.565332+0000","last_clean":"2024-09-21T01:13:54.565332+0000","last_became_active":"2024-09-21T01:12:09.299652+0000","last_became_peered":"2024-09-21T01:12:09.299652+0000","last_unstale":"2024-09-21T01:13:54.565332+0000","last_undegraded":"2024-09-21T01:13:54.565332+0000","last_fullsized":"2024-09-21T01:13:54.565332+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:24:18.610597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71745,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":164,"num_write":37,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.545083+0000","last_change":"2024-09-21T01:12:11.308675+0000","last_active":"2024-09-21T01:13:54.545083+0000","last_peered":"2024-09-21T01:13:54.545083+0000","last_clean":"2024-09-21T01:13:54.545083+0000","last_became_active":"2024-09-21T01:12:11.308317+0000","last_became_peered":"2024-09-21T01:12:11.308317+0000","last_unstale":"2024-09-21T01:13:54.545083+0000","last_undegraded":"2024-09-21T01:13:54.545083+0000","last_fullsized":"2024-09-21T01:13:54.545083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:56.081404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673306+0000","last_change":"2024-09-21T01:12:09.293716+0000","last_active":"2024-09-21T01:12:55.673306+0000","last_peered":"2024-09-21T01:12:55.673306+0000","last_clean":"2024-09-21T01:12:55.673306+0000","last_became_active":"2024-09-21T01:12:09.293205+0000","last_became_peered":"2024-09-21T01:12:09.293205+0000","last_unstale":"2024-09-21T01:12:55.673306+0000","last_undegraded":"2024-09-21T01:12:55.673306+0000","last_fullsized":"2024-09-21T01:12:55.673306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:29.955953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556073+0000","last_change":"2024-09-21T01:12:11.302736+0000","last_active":"2024-09-21T01:13:54.556073+0000","last_peered":"2024-09-21T01:13:54.556073+0000","last_clean":"2024-09-21T01:13:54.556073+0000","last_became_active":"2024-09-21T01:12:11.302357+0000","last_became_peered":"2024-09-21T01:12:11.302357+0000","last_unstale":"2024-09-21T01:13:54.556073+0000","last_undegraded":"2024-09-21T01:13:54.556073+0000","last_fullsized":"2024-09-21T01:13:54.556073+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:34.756518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.677786+0000","last_change":"2024-09-21T01:12:09.295258+0000","last_active":"2024-09-21T01:12:55.677786+0000","last_peered":"2024-09-21T01:12:55.677786+0000","last_clean":"2024-09-21T01:12:55.677786+0000","last_became_active":"2024-09-21T01:12:09.294872+0000","last_became_peered":"2024-09-21T01:12:09.294872+0000","last_unstale":"2024-09-21T01:12:55.677786+0000","last_undegraded":"2024-09-21T01:12:55.677786+0000","last_fullsized":"2024-09-21T01:12:55.677786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.216960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.557603+0000","last_change":"2024-09-21T01:12:11.303413+0000","last_active":"2024-09-21T01:13:54.557603+0000","last_peered":"2024-09-21T01:13:54.557603+0000","last_clean":"2024-09-21T01:13:54.557603+0000","last_became_active":"2024-09-21T01:12:11.303002+0000","last_became_peered":"2024-09-21T01:12:11.303002+0000","last_unstale":"2024-09-21T01:13:54.557603+0000","last_undegraded":"2024-09-21T01:13:54.557603+0000","last_fullsized":"2024-09-21T01:13:54.557603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:55.984699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'7","reported_seq":130,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:55.424886+0000","last_change":"2024-09-21T01:12:09.297392+0000","last_active":"2024-09-21T01:13:55.424886+0000","last_peered":"2024-09-21T01:13:55.424886+0000","last_clean":"2024-09-21T01:13:55.424886+0000","last_became_active":"2024-09-21T01:12:09.296882+0000","last_became_peered":"2024-09-21T01:12:09.296882+0000","last_unstale":"2024-09-21T01:13:55.424886+0000","last_undegraded":"2024-09-21T01:13:55.424886+0000","last_fullsized":"2024-09-21T01:13:55.424886+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.598362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1819,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.555500+0000","last_change":"2024-09-21T01:12:11.308021+0000","last_active":"2024-09-21T01:13:54.555500+0000","last_peered":"2024-09-21T01:13:54.555500+0000","last_clean":"2024-09-21T01:13:54.555500+0000","last_became_active":"2024-09-21T01:12:11.307643+0000","last_became_peered":"2024-09-21T01:12:11.307643+0000","last_unstale":"2024-09-21T01:13:54.555500+0000","last_undegraded":"2024-09-21T01:13:54.555500+0000","last_fullsized":"2024-09-21T01:13:54.555500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:55.569855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674898+0000","last_change":"2024-09-21T01:12:09.512120+0000","last_active":"2024-09-21T01:12:55.674898+0000","last_peered":"2024-09-21T01:12:55.674898+0000","last_clean":"2024-09-21T01:12:55.674898+0000","last_became_active":"2024-09-21T01:12:09.511631+0000","last_became_peered":"2024-09-21T01:12:09.511631+0000","last_unstale":"2024-09-21T01:12:55.674898+0000","last_undegraded":"2024-09-21T01:12:55.674898+0000","last_fullsized":"2024-09-21T01:12:55.674898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:13.187219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558542+0000","last_change":"2024-09-21T01:12:11.301633+0000","last_active":"2024-09-21T01:13:54.558542+0000","last_peered":"2024-09-21T01:13:54.558542+0000","last_clean":"2024-09-21T01:13:54.558542+0000","last_became_active":"2024-09-21T01:12:11.300638+0000","last_became_peered":"2024-09-21T01:12:11.300638+0000","last_unstale":"2024-09-21T01:13:54.558542+0000","last_undegraded":"2024-09-21T01:13:54.558542+0000","last_fullsized":"2024-09-21T01:13:54.558542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:42.245596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.676122+0000","last_change":"2024-09-21T01:12:09.297694+0000","last_active":"2024-09-21T01:12:55.676122+0000","last_peered":"2024-09-21T01:12:55.676122+0000","last_clean":"2024-09-21T01:12:55.676122+0000","last_became_active":"2024-09-21T01:12:09.297127+0000","last_became_peered":"2024-09-21T01:12:09.297127+0000","last_unstale":"2024-09-21T01:12:55.676122+0000","last_undegraded":"2024-09-21T01:12:55.676122+0000","last_fullsized":"2024-09-21T01:12:55.676122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:35.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671386+0000","last_change":"2024-09-21T01:12:11.303510+0000","last_active":"2024-09-21T01:12:55.671386+0000","last_peered":"2024-09-21T01:12:55.671386+0000","last_clean":"2024-09-21T01:12:55.671386+0000","last_became_active":"2024-09-21T01:12:11.303148+0000","last_became_peered":"2024-09-21T01:12:11.303148+0000","last_unstale":"2024-09-21T01:12:55.671386+0000","last_undegraded":"2024-09-21T01:12:55.671386+0000","last_fullsized":"2024-09-21T01:12:55.671386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:59.338185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.823115+0000","last_change":"2024-09-21T01:12:09.293490+0000","last_active":"2024-09-21T01:12:55.823115+0000","last_peered":"2024-09-21T01:12:55.823115+0000","last_clean":"2024-09-21T01:12:55.823115+0000","last_became_active":"2024-09-21T01:12:09.293151+0000","last_became_peered":"2024-09-21T01:12:09.293151+0000","last_unstale":"2024-09-21T01:12:55.823115+0000","last_undegraded":"2024-09-21T01:12:55.823115+0000","last_fullsized":"2024-09-21T01:12:55.823115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:59:25.153547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558538+0000","last_change":"2024-09-21T01:12:11.311313+0000","last_active":"2024-09-21T01:13:54.558538+0000","last_peered":"2024-09-21T01:13:54.558538+0000","last_clean":"2024-09-21T01:13:54.558538+0000","last_became_active":"2024-09-21T01:12:11.310908+0000","last_became_peered":"2024-09-21T01:12:11.310908+0000","last_unstale":"2024-09-21T01:13:54.558538+0000","last_undegraded":"2024-09-21T01:13:54.558538+0000","last_fullsized":"2024-09-21T01:13:54.558538+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:15.070802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679574+0000","last_change":"2024-09-21T01:12:09.298861+0000","last_active":"2024-09-21T01:12:55.679574+0000","last_peered":"2024-09-21T01:12:55.679574+0000","last_clean":"2024-09-21T01:12:55.679574+0000","last_became_active":"2024-09-21T01:12:09.298504+0000","last_became_peered":"2024-09-21T01:12:09.298504+0000","last_unstale":"2024-09-21T01:12:55.679574+0000","last_undegraded":"2024-09-21T01:12:55.679574+0000","last_fullsized":"2024-09-21T01:12:55.679574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:10.446269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559575+0000","last_change":"2024-09-21T01:12:11.309656+0000","last_active":"2024-09-21T01:13:54.559575+0000","last_peered":"2024-09-21T01:13:54.559575+0000","last_clean":"2024-09-21T01:13:54.559575+0000","last_became_active":"2024-09-21T01:12:11.308515+0000","last_became_peered":"2024-09-21T01:12:11.308515+0000","last_unstale":"2024-09-21T01:13:54.559575+0000","last_undegraded":"2024-09-21T01:13:54.559575+0000","last_fullsized":"2024-09-21T01:13:54.559575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:38.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675314+0000","last_change":"2024-09-21T01:12:09.511434+0000","last_active":"2024-09-21T01:12:55.675314+0000","last_peered":"2024-09-21T01:12:55.675314+0000","last_clean":"2024-09-21T01:12:55.675314+0000","last_became_active":"2024-09-21T01:12:09.511043+0000","last_became_peered":"2024-09-21T01:12:09.511043+0000","last_unstale":"2024-09-21T01:12:55.675314+0000","last_undegraded":"2024-09-21T01:12:55.675314+0000","last_fullsized":"2024-09-21T01:12:55.675314+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:23.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.563217+0000","last_change":"2024-09-21T01:12:11.311989+0000","last_active":"2024-09-21T01:13:54.563217+0000","last_peered":"2024-09-21T01:13:54.563217+0000","last_clean":"2024-09-21T01:13:54.563217+0000","last_became_active":"2024-09-21T01:12:11.310338+0000","last_became_peered":"2024-09-21T01:12:11.310338+0000","last_unstale":"2024-09-21T01:13:54.563217+0000","last_undegraded":"2024-09-21T01:13:54.563217+0000","last_fullsized":"2024-09-21T01:13:54.563217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:12.675575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674556+0000","last_change":"2024-09-21T01:11:01.703479+0000","last_active":"2024-09-21T01:12:55.674556+0000","last_peered":"2024-09-21T01:12:55.674556+0000","last_clean":"2024-09-21T01:12:55.674556+0000","last_became_active":"2024-09-21T01:11:01.697351+0000","last_became_peered":"2024-09-21T01:11:01.697351+0000","last_unstale":"2024-09-21T01:12:55.674556+0000","last_undegraded":"2024-09-21T01:12:55.674556+0000","last_fullsized":"2024-09-21T01:12:55.674556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:07:43.096984+0000","last_clean_scrub_stamp":"2024-09-21T01:07:43.096984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:18.858448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784499+0000","last_change":"2024-09-21T01:12:09.295468+0000","last_active":"2024-09-21T01:12:55.784499+0000","last_peered":"2024-09-21T01:12:55.784499+0000","last_clean":"2024-09-21T01:12:55.784499+0000","last_became_active":"2024-09-21T01:12:09.295092+0000","last_became_peered":"2024-09-21T01:12:09.295092+0000","last_unstale":"2024-09-21T01:12:55.784499+0000","last_undegraded":"2024-09-21T01:12:55.784499+0000","last_fullsized":"2024-09-21T01:12:55.784499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:08.153176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558212+0000","last_change":"2024-09-21T01:12:11.308460+0000","last_active":"2024-09-21T01:13:54.558212+0000","last_peered":"2024-09-21T01:13:54.558212+0000","last_clean":"2024-09-21T01:13:54.558212+0000","last_became_active":"2024-09-21T01:12:11.307764+0000","last_became_peered":"2024-09-21T01:12:11.307764+0000","last_unstale":"2024-09-21T01:13:54.558212+0000","last_undegraded":"2024-09-21T01:13:54.558212+0000","last_fullsized":"2024-09-21T01:13:54.558212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:32.094902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674341+0000","last_change":"2024-09-21T01:12:09.296477+0000","last_active":"2024-09-21T01:12:55.674341+0000","last_peered":"2024-09-21T01:12:55.674341+0000","last_clean":"2024-09-21T01:12:55.674341+0000","last_became_active":"2024-09-21T01:12:09.296153+0000","last_became_peered":"2024-09-21T01:12:09.296153+0000","last_unstale":"2024-09-21T01:12:55.674341+0000","last_undegraded":"2024-09-21T01:12:55.674341+0000","last_fullsized":"2024-09-21T01:12:55.674341+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:42.380668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556641+0000","last_change":"2024-09-21T01:12:11.297826+0000","last_active":"2024-09-21T01:13:54.556641+0000","last_peered":"2024-09-21T01:13:54.556641+0000","last_clean":"2024-09-21T01:13:54.556641+0000","last_became_active":"2024-09-21T01:12:11.297430+0000","last_became_peered":"2024-09-21T01:12:11.297430+0000","last_unstale":"2024-09-21T01:13:54.556641+0000","last_undegraded":"2024-09-21T01:13:54.556641+0000","last_fullsized":"2024-09-21T01:13:54.556641+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:09.130500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":124,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:55.424428+0000","last_change":"2024-09-21T01:12:09.511173+0000","last_active":"2024-09-21T01:13:55.424428+0000","last_peered":"2024-09-21T01:13:55.424428+0000","last_clean":"2024-09-21T01:13:55.424428+0000","last_became_active":"2024-09-21T01:12:09.510840+0000","last_became_peered":"2024-09-21T01:12:09.510840+0000","last_unstale":"2024-09-21T01:13:55.424428+0000","last_undegraded":"2024-09-21T01:13:55.424428+0000","last_fullsized":"2024-09-21T01:13:55.424428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:22.161708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.552514+0000","last_change":"2024-09-21T01:12:55.824825+0000","last_active":"2024-09-21T01:13:54.552514+0000","last_peered":"2024-09-21T01:13:54.552514+0000","last_clean":"2024-09-21T01:13:54.552514+0000","last_became_active":"2024-09-21T01:12:55.824253+0000","last_became_peered":"2024-09-21T01:12:55.824253+0000","last_unstale":"2024-09-21T01:13:54.552514+0000","last_undegraded":"2024-09-21T01:13:54.552514+0000","last_fullsized":"2024-09-21T01:13:54.552514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:14.580270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674696+0000","last_change":"2024-09-21T01:12:09.295447+0000","last_active":"2024-09-21T01:12:55.674696+0000","last_peered":"2024-09-21T01:12:55.674696+0000","last_clean":"2024-09-21T01:12:55.674696+0000","last_became_active":"2024-09-21T01:12:09.295057+0000","last_became_peered":"2024-09-21T01:12:09.295057+0000","last_unstale":"2024-09-21T01:12:55.674696+0000","last_undegraded":"2024-09-21T01:12:55.674696+0000","last_fullsized":"2024-09-21T01:12:55.674696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:59.389877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.554222+0000","last_change":"2024-09-21T01:12:11.304636+0000","last_active":"2024-09-21T01:13:54.554222+0000","last_peered":"2024-09-21T01:13:54.554222+0000","last_clean":"2024-09-21T01:13:54.554222+0000","last_became_active":"2024-09-21T01:12:11.303318+0000","last_became_peered":"2024-09-21T01:12:11.303318+0000","last_unstale":"2024-09-21T01:13:54.554222+0000","last_undegraded":"2024-09-21T01:13:54.554222+0000","last_fullsized":"2024-09-21T01:13:54.554222+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:39.377686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.679281+0000","last_change":"2024-09-21T01:12:55.679156+0000","last_active":"2024-09-21T01:12:55.679281+0000","last_peered":"2024-09-21T01:12:55.679281+0000","last_clean":"2024-09-21T01:12:55.679281+0000","last_became_active":"2024-09-21T01:12:55.678638+0000","last_became_peered":"2024-09-21T01:12:55.678638+0000","last_unstale":"2024-09-21T01:12:55.679281+0000","last_undegraded":"2024-09-21T01:12:55.679281+0000","last_fullsized":"2024-09-21T01:12:55.679281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.784868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558308+0000","last_change":"2024-09-21T01:12:11.305558+0000","last_active":"2024-09-21T01:13:54.558308+0000","last_peered":"2024-09-21T01:13:54.558308+0000","last_clean":"2024-09-21T01:13:54.558308+0000","last_became_active":"2024-09-21T01:12:11.304934+0000","last_became_peered":"2024-09-21T01:12:11.304934+0000","last_unstale":"2024-09-21T01:13:54.558308+0000","last_undegraded":"2024-09-21T01:13:54.558308+0000","last_fullsized":"2024-09-21T01:13:54.558308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:52.060131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675716+0000","last_change":"2024-09-21T01:12:09.511384+0000","last_active":"2024-09-21T01:12:55.675716+0000","last_peered":"2024-09-21T01:12:55.675716+0000","last_clean":"2024-09-21T01:12:55.675716+0000","last_became_active":"2024-09-21T01:12:09.511006+0000","last_became_peered":"2024-09-21T01:12:09.511006+0000","last_unstale":"2024-09-21T01:12:55.675716+0000","last_undegraded":"2024-09-21T01:12:55.675716+0000","last_fullsized":"2024-09-21T01:12:55.675716+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:56.580855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.555176+0000","last_change":"2024-09-21T01:12:11.304912+0000","last_active":"2024-09-21T01:13:54.555176+0000","last_peered":"2024-09-21T01:13:54.555176+0000","last_clean":"2024-09-21T01:13:54.555176+0000","last_became_active":"2024-09-21T01:12:11.304536+0000","last_became_peered":"2024-09-21T01:12:11.304536+0000","last_unstale":"2024-09-21T01:13:54.555176+0000","last_undegraded":"2024-09-21T01:13:54.555176+0000","last_fullsized":"2024-09-21T01:13:54.555176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:45.037231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.673929+0000","last_change":"2024-09-21T01:12:09.294680+0000","last_active":"2024-09-21T01:12:55.673929+0000","last_peered":"2024-09-21T01:12:55.673929+0000","last_clean":"2024-09-21T01:12:55.673929+0000","last_became_active":"2024-09-21T01:12:09.294289+0000","last_became_peered":"2024-09-21T01:12:09.294289+0000","last_unstale":"2024-09-21T01:12:55.673929+0000","last_undegraded":"2024-09-21T01:12:55.673929+0000","last_fullsized":"2024-09-21T01:12:55.673929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:12.824781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559372+0000","last_change":"2024-09-21T01:12:11.305192+0000","last_active":"2024-09-21T01:13:54.559372+0000","last_peered":"2024-09-21T01:13:54.559372+0000","last_clean":"2024-09-21T01:13:54.559372+0000","last_became_active":"2024-09-21T01:12:11.304761+0000","last_became_peered":"2024-09-21T01:12:11.304761+0000","last_unstale":"2024-09-21T01:13:54.559372+0000","last_undegraded":"2024-09-21T01:13:54.559372+0000","last_fullsized":"2024-09-21T01:13:54.559372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:58.429511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.784602+0000","last_change":"2024-09-21T01:12:09.455476+0000","last_active":"2024-09-21T01:12:55.784602+0000","last_peered":"2024-09-21T01:12:55.784602+0000","last_clean":"2024-09-21T01:12:55.784602+0000","last_became_active":"2024-09-21T01:12:09.454981+0000","last_became_peered":"2024-09-21T01:12:09.454981+0000","last_unstale":"2024-09-21T01:12:55.784602+0000","last_undegraded":"2024-09-21T01:12:55.784602+0000","last_fullsized":"2024-09-21T01:12:55.784602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:27.790928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.559247+0000","last_change":"2024-09-21T01:12:11.300631+0000","last_active":"2024-09-21T01:13:54.559247+0000","last_peered":"2024-09-21T01:13:54.559247+0000","last_clean":"2024-09-21T01:13:54.559247+0000","last_became_active":"2024-09-21T01:12:11.300179+0000","last_became_peered":"2024-09-21T01:12:11.300179+0000","last_unstale":"2024-09-21T01:13:54.559247+0000","last_undegraded":"2024-09-21T01:13:54.559247+0000","last_fullsized":"2024-09-21T01:13:54.559247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:23.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:56.328302+0000","last_change":"2024-09-21T01:12:09.511406+0000","last_active":"2024-09-21T01:12:56.328302+0000","last_peered":"2024-09-21T01:12:56.328302+0000","last_clean":"2024-09-21T01:12:56.328302+0000","last_became_active":"2024-09-21T01:12:09.511117+0000","last_became_peered":"2024-09-21T01:12:09.511117+0000","last_unstale":"2024-09-21T01:12:56.328302+0000","last_undegraded":"2024-09-21T01:12:56.328302+0000","last_fullsized":"2024-09-21T01:12:56.328302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:18.100466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.512711+0000","last_change":"2024-09-21T01:12:11.306933+0000","last_active":"2024-09-21T01:13:54.512711+0000","last_peered":"2024-09-21T01:13:54.512711+0000","last_clean":"2024-09-21T01:13:54.512711+0000","last_became_active":"2024-09-21T01:12:11.306516+0000","last_became_peered":"2024-09-21T01:12:11.306516+0000","last_unstale":"2024-09-21T01:13:54.512711+0000","last_undegraded":"2024-09-21T01:13:54.512711+0000","last_fullsized":"2024-09-21T01:13:54.512711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:40.524953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.670767+0000","last_change":"2024-09-21T01:12:09.297506+0000","last_active":"2024-09-21T01:12:55.670767+0000","last_peered":"2024-09-21T01:12:55.670767+0000","last_clean":"2024-09-21T01:12:55.670767+0000","last_became_active":"2024-09-21T01:12:09.297139+0000","last_became_peered":"2024-09-21T01:12:09.297139+0000","last_unstale":"2024-09-21T01:12:55.670767+0000","last_undegraded":"2024-09-21T01:12:55.670767+0000","last_fullsized":"2024-09-21T01:12:55.670767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:05.641171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671193+0000","last_change":"2024-09-21T01:12:11.314053+0000","last_active":"2024-09-21T01:12:55.671193+0000","last_peered":"2024-09-21T01:12:55.671193+0000","last_clean":"2024-09-21T01:12:55.671193+0000","last_became_active":"2024-09-21T01:12:11.313681+0000","last_became_peered":"2024-09-21T01:12:11.313681+0000","last_unstale":"2024-09-21T01:12:55.671193+0000","last_undegraded":"2024-09-21T01:12:55.671193+0000","last_fullsized":"2024-09-21T01:12:55.671193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:44.108030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674195+0000","last_change":"2024-09-21T01:12:09.298602+0000","last_active":"2024-09-21T01:12:55.674195+0000","last_peered":"2024-09-21T01:12:55.674195+0000","last_clean":"2024-09-21T01:12:55.674195+0000","last_became_active":"2024-09-21T01:12:09.297295+0000","last_became_peered":"2024-09-21T01:12:09.297295+0000","last_unstale":"2024-09-21T01:12:55.674195+0000","last_undegraded":"2024-09-21T01:12:55.674195+0000","last_fullsized":"2024-09-21T01:12:55.674195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:27.253290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.553729+0000","last_change":"2024-09-21T01:12:11.306120+0000","last_active":"2024-09-21T01:13:54.553729+0000","last_peered":"2024-09-21T01:13:54.553729+0000","last_clean":"2024-09-21T01:13:54.553729+0000","last_became_active":"2024-09-21T01:12:11.305771+0000","last_became_peered":"2024-09-21T01:12:11.305771+0000","last_unstale":"2024-09-21T01:13:54.553729+0000","last_undegraded":"2024-09-21T01:13:54.553729+0000","last_fullsized":"2024-09-21T01:13:54.553729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:38.685712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.685158+0000","last_change":"2024-09-21T01:12:55.684585+0000","last_active":"2024-09-21T01:12:55.685158+0000","last_peered":"2024-09-21T01:12:55.685158+0000","last_clean":"2024-09-21T01:12:55.685158+0000","last_became_active":"2024-09-21T01:12:55.677011+0000","last_became_peered":"2024-09-21T01:12:55.677011+0000","last_unstale":"2024-09-21T01:12:55.685158+0000","last_undegraded":"2024-09-21T01:12:55.685158+0000","last_fullsized":"2024-09-21T01:12:55.685158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:09.563212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.563428+0000","last_change":"2024-09-21T01:12:11.312392+0000","last_active":"2024-09-21T01:13:54.563428+0000","last_peered":"2024-09-21T01:13:54.563428+0000","last_clean":"2024-09-21T01:13:54.563428+0000","last_became_active":"2024-09-21T01:12:11.311120+0000","last_became_peered":"2024-09-21T01:12:11.311120+0000","last_unstale":"2024-09-21T01:13:54.563428+0000","last_undegraded":"2024-09-21T01:13:54.563428+0000","last_fullsized":"2024-09-21T01:13:54.563428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:23.292367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.558845+0000","last_change":"2024-09-21T01:12:11.301350+0000","last_active":"2024-09-21T01:13:54.558845+0000","last_peered":"2024-09-21T01:13:54.558845+0000","last_clean":"2024-09-21T01:13:54.558845+0000","last_became_active":"2024-09-21T01:12:11.299746+0000","last_became_peered":"2024-09-21T01:12:11.299746+0000","last_unstale":"2024-09-21T01:13:54.558845+0000","last_undegraded":"2024-09-21T01:13:54.558845+0000","last_fullsized":"2024-09-21T01:13:54.558845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:57.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675539+0000","last_change":"2024-09-21T01:12:09.296499+0000","last_active":"2024-09-21T01:12:55.675539+0000","last_peered":"2024-09-21T01:12:55.675539+0000","last_clean":"2024-09-21T01:12:55.675539+0000","last_became_active":"2024-09-21T01:12:09.296000+0000","last_became_peered":"2024-09-21T01:12:09.296000+0000","last_unstale":"2024-09-21T01:12:55.675539+0000","last_undegraded":"2024-09-21T01:12:55.675539+0000","last_fullsized":"2024-09-21T01:12:55.675539+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:37.278200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.560633+0000","last_change":"2024-09-21T01:12:11.314014+0000","last_active":"2024-09-21T01:13:54.560633+0000","last_peered":"2024-09-21T01:13:54.560633+0000","last_clean":"2024-09-21T01:13:54.560633+0000","last_became_active":"2024-09-21T01:12:11.312592+0000","last_became_peered":"2024-09-21T01:12:11.312592+0000","last_unstale":"2024-09-21T01:13:54.560633+0000","last_undegraded":"2024-09-21T01:13:54.560633+0000","last_fullsized":"2024-09-21T01:13:54.560633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.074667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.675558+0000","last_change":"2024-09-21T01:12:09.297088+0000","last_active":"2024-09-21T01:12:55.675558+0000","last_peered":"2024-09-21T01:12:55.675558+0000","last_clean":"2024-09-21T01:12:55.675558+0000","last_became_active":"2024-09-21T01:12:09.296707+0000","last_became_peered":"2024-09-21T01:12:09.296707+0000","last_unstale":"2024-09-21T01:12:55.675558+0000","last_undegraded":"2024-09-21T01:12:55.675558+0000","last_fullsized":"2024-09-21T01:12:55.675558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:50.138586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.556295+0000","last_change":"2024-09-21T01:12:11.300991+0000","last_active":"2024-09-21T01:13:54.556295+0000","last_peered":"2024-09-21T01:13:54.556295+0000","last_clean":"2024-09-21T01:13:54.556295+0000","last_became_active":"2024-09-21T01:12:11.299934+0000","last_became_peered":"2024-09-21T01:12:11.299934+0000","last_unstale":"2024-09-21T01:13:54.556295+0000","last_undegraded":"2024-09-21T01:13:54.556295+0000","last_fullsized":"2024-09-21T01:13:54.556295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:34.300051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.671316+0000","last_change":"2024-09-21T01:12:09.511289+0000","last_active":"2024-09-21T01:12:55.671316+0000","last_peered":"2024-09-21T01:12:55.671316+0000","last_clean":"2024-09-21T01:12:55.671316+0000","last_became_active":"2024-09-21T01:12:09.510879+0000","last_became_peered":"2024-09-21T01:12:09.510879+0000","last_unstale":"2024-09-21T01:12:55.671316+0000","last_undegraded":"2024-09-21T01:12:55.671316+0000","last_fullsized":"2024-09-21T01:12:55.671316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:37.950305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:13:54.543430+0000","last_change":"2024-09-21T01:12:11.312100+0000","last_active":"2024-09-21T01:13:54.543430+0000","last_peered":"2024-09-21T01:13:54.543430+0000","last_clean":"2024-09-21T01:13:54.543430+0000","last_became_active":"2024-09-21T01:12:11.311731+0000","last_became_peered":"2024-09-21T01:12:11.311731+0000","last_unstale":"2024-09-21T01:13:54.543430+0000","last_undegraded":"2024-09-21T01:13:54.543430+0000","last_fullsized":"2024-09-21T01:13:54.543430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:10.279899+0000","last_clean_scrub_stamp":"2024-09-21T01:12:10.279899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:40.459020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:12:55.674164+0000","last_change":"2024-09-21T01:12:09.294759+0000","last_active":"2024-09-21T01:12:55.674164+0000","last_peered":"2024-09-21T01:12:55.674164+0000","last_clean":"2024-09-21T01:12:55.674164+0000","last_became_active":"2024-09-21T01:12:09.294391+0000","last_became_peered":"2024-09-21T01:12:09.294391+0000","last_unstale":"2024-09-21T01:12:55.674164+0000","last_undegraded":"2024-09-21T01:12:55.674164+0000","last_fullsized":"2024-09-21T01:12:55.674164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:12:08.271097+0000","last_clean_scrub_stamp":"2024-09-21T01:12:08.271097+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:05.981058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":449,"ondisk_log_size":449,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76586,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":597,"num_read_kb":373,"num_write":175,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":232278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776162,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":815104,"data_stored":396084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1523712,"data_stored":1059759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":831488,"data_stored":396320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":831488,"data_stored":396240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716736,"statfs":{"total":95995035648,"available":95965937664,"internally_reserved":0,"allocated":1425408,"data_stored":988619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36144,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709008,"statfs":{"total":95995035648,"available":95958024192,"internally_reserved":0,"allocated":819200,"data_stored":395709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32588,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712564,"statfs":{"total":95995035648,"available":95961665536,"internally_reserved":0,"allocated":1437696,"data_stored":987463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40308,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704844,"statfs":{"total":95995035648,"available":95953760256,"internally_reserved":0,"allocated":823296,"data_stored":397377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":396020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":471117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":467247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":396980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":75615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":74554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:13:58.768 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:59.053 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:59.454 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:59 smithi148 ceph-mon[31000]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:59.454 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:59 smithi148 ceph-mon[31000]: pgmap v338: 97 pgs: 97 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:13:59.454 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:59 smithi148 ceph-mon[31000]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:59.454 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:13:59 smithi148 ceph-mon[31000]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:59.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.543+0000 7f1122992640 1 -- 172.21.15.148:0/981200700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f111c108d10 msgr2=0x7f111c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:59.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.543+0000 7f1122992640 1 --2- 172.21.15.148:0/981200700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f111c108d10 0x7f111c10f540 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1114009ca0 tx=0x7f111402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:59.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.543+0000 7f1122992640 1 -- 172.21.15.148:0/981200700 shutdown_connections 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.543+0000 7f1122992640 1 --2- 172.21.15.148:0/981200700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f111c108d10 0x7f111c10f540 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.543+0000 7f1122992640 1 --2- 172.21.15.148:0/981200700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111c1083c0 0x7f111c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.543+0000 7f1122992640 1 --2- 172.21.15.148:0/981200700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f111c102a80 0x7f111c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.543+0000 7f1122992640 1 -- 172.21.15.148:0/981200700 >> 172.21.15.148:0/981200700 conn(0x7f111c079740 msgr2=0x7f111c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.543+0000 7f1122992640 1 -- 172.21.15.148:0/981200700 shutdown_connections 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.543+0000 7f1122992640 1 -- 172.21.15.148:0/981200700 wait complete. 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1122992640 1 Processor -- start 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1122992640 1 -- start start 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1122992640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f111c102a80 0x7f111c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1122992640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111c1083c0 0x7f111c199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1122992640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f111c108d10 0x7f111c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1122992640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f111c1129e0 con 0x7f111c108d10 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1122992640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f111c112860 con 0x7f111c102a80 2024-09-21T01:13:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1122992640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f111c112b60 con 0x7f111c1083c0 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1120f2f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f111c108d10 0x7f111c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1120f2f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f111c108d10 0x7f111c19ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51422/0 (socket says 172.21.15.148:51422) 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f1120f2f640 1 -- 172.21.15.148:0/2659922538 learned_addr learned my addr 172.21.15.148:0/2659922538 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.544+0000 7f111b7fe640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111c1083c0 0x7f111c199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f111bfff640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f111c102a80 0x7f111c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f1120f2f640 1 -- 172.21.15.148:0/2659922538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111c1083c0 msgr2=0x7f111c199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f1120f2f640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111c1083c0 0x7f111c199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f1120f2f640 1 -- 172.21.15.148:0/2659922538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f111c102a80 msgr2=0x7f111c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f1120f2f640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f111c102a80 0x7f111c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f1120f2f640 1 -- 172.21.15.148:0/2659922538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c19f240 con 0x7f111c108d10 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f1120f2f640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f111c108d10 0x7f111c19ebd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1114005cc0 tx=0x7f111402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f11197fa640 1 -- 172.21.15.148:0/2659922538 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114003cf0 con 0x7f111c108d10 2024-09-21T01:13:59.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f11197fa640 1 -- 172.21.15.148:0/2659922538 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11140044f0 con 0x7f111c108d10 2024-09-21T01:13:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f1122992640 1 -- 172.21.15.148:0/2659922538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111c19f4d0 con 0x7f111c108d10 2024-09-21T01:13:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f11197fa640 1 -- 172.21.15.148:0/2659922538 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111402fc30 con 0x7f111c108d10 2024-09-21T01:13:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.545+0000 7f1122992640 1 -- 172.21.15.148:0/2659922538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111c1a5d50 con 0x7f111c108d10 2024-09-21T01:13:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.546+0000 7f1122992640 1 -- 172.21.15.148:0/2659922538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111c103d00 con 0x7f111c108d10 2024-09-21T01:13:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.548+0000 7f11197fa640 1 -- 172.21.15.148:0/2659922538 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f11140046a0 con 0x7f111c108d10 2024-09-21T01:13:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.549+0000 7f11197fa640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f11040b65d0 0x7f11040b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.549+0000 7f111bfff640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f11040b65d0 0x7f11040b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.549+0000 7f11197fa640 1 -- 172.21.15.148:0/2659922538 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f1114108af0 con 0x7f111c108d10 2024-09-21T01:13:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.550+0000 7f111bfff640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f11040b65d0 0x7f11040b8ae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f110c009890 tx=0x7f110c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.553+0000 7f11197fa640 1 -- 172.21.15.148:0/2659922538 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11140cf230 con 0x7f111c108d10 2024-09-21T01:13:59.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:59 smithi181 ceph-mon[34811]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:59.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:59 smithi181 ceph-mon[34811]: pgmap v338: 97 pgs: 97 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:13:59.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:59 smithi181 ceph-mon[34811]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:59.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:13:59 smithi181 ceph-mon[34811]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:59.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:59 smithi157 ceph-mon[34140]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:59.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:59 smithi157 ceph-mon[34140]: pgmap v338: 97 pgs: 97 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:13:59.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:59 smithi157 ceph-mon[34140]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:59.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:13:59 smithi157 ceph-mon[34140]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:13:59.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.768+0000 7f1122992640 1 -- 172.21.15.148:0/2659922538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f111c19a4c0 con 0x7f111c108d10 2024-09-21T01:13:59.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.769+0000 7f11197fa640 1 -- 172.21.15.148:0/2659922538 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11926 (secure 0 0 0) 0x7f11140d3610 con 0x7f111c108d10 2024-09-21T01:13:59.770 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:13:59.770 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"btime":"2024-09-21T01:13:54:310474+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:13:54.159441+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24631,24646,24665]},"id":1}]} 2024-09-21T01:13:59.770 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-09-21T01:13:59.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.771+0000 7f1122992640 1 -- 172.21.15.148:0/2659922538 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f11040b65d0 msgr2=0x7f11040b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:59.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.771+0000 7f1122992640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f11040b65d0 0x7f11040b8ae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f110c009890 tx=0x7f110c008040 comp rx=0 tx=0).stop 2024-09-21T01:13:59.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.771+0000 7f1122992640 1 -- 172.21.15.148:0/2659922538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f111c108d10 msgr2=0x7f111c19ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:59.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.771+0000 7f1122992640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f111c108d10 0x7f111c19ebd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1114005cc0 tx=0x7f111402f470 comp rx=0 tx=0).stop 2024-09-21T01:13:59.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.772+0000 7f1122992640 1 -- 172.21.15.148:0/2659922538 shutdown_connections 2024-09-21T01:13:59.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.772+0000 7f1122992640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f11040b65d0 0x7f11040b8ae0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:59.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.772+0000 7f1122992640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f111c108d10 0x7f111c19ebd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:59.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.772+0000 7f1122992640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111c1083c0 0x7f111c199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:59.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.772+0000 7f1122992640 1 --2- 172.21.15.148:0/2659922538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f111c102a80 0x7f111c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:59.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.772+0000 7f1122992640 1 -- 172.21.15.148:0/2659922538 >> 172.21.15.148:0/2659922538 conn(0x7f111c079740 msgr2=0x7f111c105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:59.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.772+0000 7f1122992640 1 -- 172.21.15.148:0/2659922538 shutdown_connections 2024-09-21T01:13:59.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:13:59.772+0000 7f1122992640 1 -- 172.21.15.148:0/2659922538 wait complete. 2024-09-21T01:14:00.373 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:14:00.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:00 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2659922538' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:14:00.622 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:00.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:00 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2659922538' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:14:00.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:00 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2659922538' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:14:01.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.065+0000 7fe0c1da9640 1 -- 172.21.15.148:0/3397392245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0bc1083a0 msgr2=0x7fe0bc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:01.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.065+0000 7fe0c1da9640 1 --2- 172.21.15.148:0/3397392245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0bc1083a0 0x7fe0bc1087b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009900 tx=0x7fe0a402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:14:01.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.065+0000 7fe0c1da9640 1 -- 172.21.15.148:0/3397392245 shutdown_connections 2024-09-21T01:14:01.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.065+0000 7fe0c1da9640 1 --2- 172.21.15.148:0/3397392245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0bc1083a0 0x7fe0bc1087b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:01.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.065+0000 7fe0c1da9640 1 --2- 172.21.15.148:0/3397392245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0bc108cf0 0x7fe0bc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:01.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.065+0000 7fe0c1da9640 1 --2- 172.21.15.148:0/3397392245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0bc102a60 0x7fe0bc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:01.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.065+0000 7fe0c1da9640 1 -- 172.21.15.148:0/3397392245 >> 172.21.15.148:0/3397392245 conn(0x7fe0bc079730 msgr2=0x7fe0bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:01.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.065+0000 7fe0c1da9640 1 -- 172.21.15.148:0/3397392245 shutdown_connections 2024-09-21T01:14:01.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.065+0000 7fe0c1da9640 1 -- 172.21.15.148:0/3397392245 wait complete. 2024-09-21T01:14:01.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.066+0000 7fe0c1da9640 1 Processor -- start 2024-09-21T01:14:01.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.066+0000 7fe0c1da9640 1 -- start start 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0c1da9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0bc102a60 0x7fe0bc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0c1da9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0bc1083a0 0x7fe0bc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0c1da9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0bc108cf0 0x7fe0bc19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0c1da9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc113ac0 con 0x7fe0bc108cf0 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0c1da9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc113940 con 0x7fe0bc102a60 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0c1da9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc113c40 con 0x7fe0bc1083a0 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0bbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0bc108cf0 0x7fe0bc19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0bbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0bc108cf0 0x7fe0bc19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51438/0 (socket says 172.21.15.148:51438) 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0bbfff640 1 -- 172.21.15.148:0/2525174209 learned_addr learned my addr 172.21.15.148:0/2525174209 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0b2ffd640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0bc1083a0 0x7fe0bc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0bb7fe640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0bc102a60 0x7fe0bc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0bbfff640 1 -- 172.21.15.148:0/2525174209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0bc1083a0 msgr2=0x7fe0bc19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0bbfff640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0bc1083a0 0x7fe0bc19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:01.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0bbfff640 1 -- 172.21.15.148:0/2525174209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0bc102a60 msgr2=0x7fe0bc19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:01.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0bbfff640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0bc102a60 0x7fe0bc19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:01.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0bbfff640 1 -- 172.21.15.148:0/2525174209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc1a0500 con 0x7fe0bc108cf0 2024-09-21T01:14:01.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.067+0000 7fe0bb7fe640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0bc102a60 0x7fe0bc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:01.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.068+0000 7fe0bbfff640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0bc108cf0 0x7fe0bc19fdd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400eaa0 tx=0x7fe0b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:01.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.068+0000 7fe0b97fa640 1 -- 172.21.15.148:0/2525174209 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b400cdb0 con 0x7fe0bc108cf0 2024-09-21T01:14:01.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.068+0000 7fe0b97fa640 1 -- 172.21.15.148:0/2525174209 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b4005020 con 0x7fe0bc108cf0 2024-09-21T01:14:01.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.068+0000 7fe0b97fa640 1 -- 172.21.15.148:0/2525174209 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40116d0 con 0x7fe0bc108cf0 2024-09-21T01:14:01.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.068+0000 7fe0c1da9640 1 -- 172.21.15.148:0/2525174209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0bc1a07f0 con 0x7fe0bc108cf0 2024-09-21T01:14:01.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.068+0000 7fe0c1da9640 1 -- 172.21.15.148:0/2525174209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0bc1a6f50 con 0x7fe0bc108cf0 2024-09-21T01:14:01.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.069+0000 7fe0c1da9640 1 -- 172.21.15.148:0/2525174209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0bc102e70 con 0x7fe0bc108cf0 2024-09-21T01:14:01.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.070+0000 7fe0b97fa640 1 -- 172.21.15.148:0/2525174209 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7fe0b40051d0 con 0x7fe0bc108cf0 2024-09-21T01:14:01.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.071+0000 7fe0b97fa640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a80b6620 0x7fe0a80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:01.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.071+0000 7fe0bb7fe640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a80b6620 0x7fe0a80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:01.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.071+0000 7fe0b97fa640 1 -- 172.21.15.148:0/2525174209 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fe0b40e7980 con 0x7fe0bc108cf0 2024-09-21T01:14:01.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.072+0000 7fe0bb7fe640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a80b6620 0x7fe0a80b8b30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009930 tx=0x7fe0ac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.074+0000 7fe0b97fa640 1 -- 172.21.15.148:0/2525174209 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0b4016030 con 0x7fe0bc108cf0 2024-09-21T01:14:01.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.251+0000 7fe0c1da9640 1 -- 172.21.15.148:0/2525174209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0bc19b6c0 con 0x7fe0bc108cf0 2024-09-21T01:14:01.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.252+0000 7fe0b97fa640 1 -- 172.21.15.148:0/2525174209 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22837 (secure 0 0 0) 0x7fe0bc19b6c0 con 0x7fe0bc108cf0 2024-09-21T01:14:01.253 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:14:01.254 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":76,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:55.664651+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 -- 172.21.15.148:0/2525174209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a80b6620 msgr2=0x7fe0a80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a80b6620 0x7fe0a80b8b30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009930 tx=0x7fe0ac008040 comp rx=0 tx=0).stop 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 -- 172.21.15.148:0/2525174209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0bc108cf0 msgr2=0x7fe0bc19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0bc108cf0 0x7fe0bc19fdd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400eaa0 tx=0x7fe0b400ef60 comp rx=0 tx=0).stop 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 -- 172.21.15.148:0/2525174209 shutdown_connections 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a80b6620 0x7fe0a80b8b30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0bc108cf0 0x7fe0bc19fdd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0bc1083a0 0x7fe0bc19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 --2- 172.21.15.148:0/2525174209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0bc102a60 0x7fe0bc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 -- 172.21.15.148:0/2525174209 >> 172.21.15.148:0/2525174209 conn(0x7fe0bc079730 msgr2=0x7fe0bc105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 -- 172.21.15.148:0/2525174209 shutdown_connections 2024-09-21T01:14:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:01.255+0000 7fe0c1da9640 1 -- 172.21.15.148:0/2525174209 wait complete. 2024-09-21T01:14:01.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:01 smithi148 ceph-mon[31000]: pgmap v339: 97 pgs: 97 active+clean; 652 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T01:14:01.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:01 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2525174209' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:01.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:01 smithi181 ceph-mon[34811]: pgmap v339: 97 pgs: 97 active+clean; 652 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T01:14:01.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:01 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2525174209' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:01.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:01 smithi157 ceph-mon[34140]: pgmap v339: 97 pgs: 97 active+clean; 652 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T01:14:01.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:01 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2525174209' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:01.868 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T01:14:01.868 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T01:14:01.878 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T01:14:01.878 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T01:14:01.878 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T01:14:01.879 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:14:01.879 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:14:01.883 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T01:14:01.896 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:14:01.896 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T01:14:01.896 INFO:tasks.workunit:timeout=3h 2024-09-21T01:14:01.896 INFO:tasks.workunit:cleanup=True 2024-09-21T01:14:01.896 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T01:14:01.913 INFO:teuthology.orchestra.run.smithi148.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T01:14:01.913 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T01:14:01.914 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T01:14:01.914 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:14:01.914 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T01:14:01.914 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 01:12:29.927857810 +0000 2024-09-21T01:14:01.914 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 01:12:29.927857810 +0000 2024-09-21T01:14:01.914 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 01:13:53.423185562 +0000 2024-09-21T01:14:01.914 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 01:12:29.927857810 +0000 2024-09-21T01:14:01.914 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T01:14:01.914 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T01:14:01.988 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:14:02.044 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T01:14:02.139 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:02.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.657+0000 7fd0ce540640 1 -- 172.21.15.148:0/578911920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0c8108cf0 msgr2=0x7fd0c810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.657+0000 7fd0ce540640 1 --2- 172.21.15.148:0/578911920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0c8108cf0 0x7fd0c810f520 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009ca0 tx=0x7fd0c002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.657+0000 7fd0ce540640 1 -- 172.21.15.148:0/578911920 shutdown_connections 2024-09-21T01:14:02.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.657+0000 7fd0ce540640 1 --2- 172.21.15.148:0/578911920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0c8108cf0 0x7fd0c810f520 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.657+0000 7fd0ce540640 1 --2- 172.21.15.148:0/578911920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0c81083a0 0x7fd0c81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.657+0000 7fd0ce540640 1 --2- 172.21.15.148:0/578911920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0c8102a60 0x7fd0c8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.657+0000 7fd0ce540640 1 -- 172.21.15.148:0/578911920 >> 172.21.15.148:0/578911920 conn(0x7fd0c8079730 msgr2=0x7fd0c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:02.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.657+0000 7fd0ce540640 1 -- 172.21.15.148:0/578911920 shutdown_connections 2024-09-21T01:14:02.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.657+0000 7fd0ce540640 1 -- 172.21.15.148:0/578911920 wait complete. 2024-09-21T01:14:02.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ce540640 1 Processor -- start 2024-09-21T01:14:02.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ce540640 1 -- start start 2024-09-21T01:14:02.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ce540640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0c8102a60 0x7fd0c819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ce540640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0c81083a0 0x7fd0c819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ce540640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0c8108cf0 0x7fd0c819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ce540640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c8112960 con 0x7fd0c8108cf0 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ce540640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c81127e0 con 0x7fd0c8102a60 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ce540640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c8112ae0 con 0x7fd0c81083a0 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ccadd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0c8108cf0 0x7fd0c819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ccadd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0c8108cf0 0x7fd0c819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51464/0 (socket says 172.21.15.148:51464) 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0ccadd640 1 -- 172.21.15.148:0/1557082430 learned_addr learned my addr 172.21.15.148:0/1557082430 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0c77fe640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0c81083a0 0x7fd0c819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.658+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0c8102a60 0x7fd0c819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0ccadd640 1 -- 172.21.15.148:0/1557082430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0c81083a0 msgr2=0x7fd0c819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0ccadd640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0c81083a0 0x7fd0c819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0ccadd640 1 -- 172.21.15.148:0/1557082430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0c8102a60 msgr2=0x7fd0c819b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0ccadd640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0c8102a60 0x7fd0c819b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0ccadd640 1 -- 172.21.15.148:0/1557082430 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c81a65b0 con 0x7fd0c8108cf0 2024-09-21T01:14:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0ccadd640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0c8108cf0 0x7fd0c819bd70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0005cc0 tx=0x7fd0c002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0c57fa640 1 -- 172.21.15.148:0/1557082430 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0003bf0 con 0x7fd0c8108cf0 2024-09-21T01:14:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0c57fa640 1 -- 172.21.15.148:0/1557082430 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0c0003d90 con 0x7fd0c8108cf0 2024-09-21T01:14:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0ce540640 1 -- 172.21.15.148:0/1557082430 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c81a6840 con 0x7fd0c8108cf0 2024-09-21T01:14:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0c57fa640 1 -- 172.21.15.148:0/1557082430 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c002fbc0 con 0x7fd0c8108cf0 2024-09-21T01:14:02.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.659+0000 7fd0ce540640 1 -- 172.21.15.148:0/1557082430 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c81a6dd0 con 0x7fd0c8108cf0 2024-09-21T01:14:02.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.662+0000 7fd0d4ab4740 1 Processor -- start 2024-09-21T01:14:02.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.662+0000 7fd0c57fa640 1 -- 172.21.15.148:0/1557082430 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7fd0c002fd60 con 0x7fd0c8108cf0 2024-09-21T01:14:02.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.662+0000 7fd0d4ab4740 1 -- start start 2024-09-21T01:14:02.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.662+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d4402430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.662+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d4032490 0x55f9d4402970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.662+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d4402eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.662+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f9d4378e60 con 0x55f9d405b350 2024-09-21T01:14:02.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.662+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55f9d4368290 con 0x55f9d4032490 2024-09-21T01:14:02.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.662+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f9d436c0a0 con 0x55f9d403a670 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.662+0000 7fd0c77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d4402430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d4402430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51468/0 (socket says 172.21.15.148:51468) 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c77fe640 1 -- 172.21.15.148:0/1866105365 learned_addr learned my addr 172.21.15.148:0/1866105365 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/1866105365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d4032490 0x55f9d4402970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c77fe640 1 --2- 172.21.15.148:0/1866105365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d4402eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c77fe640 1 -- 172.21.15.148:0/1866105365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 msgr2=0x55f9d4402eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c77fe640 1 --2- 172.21.15.148:0/1866105365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d4402eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c77fe640 1 -- 172.21.15.148:0/1866105365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d4032490 msgr2=0x55f9d4402970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c77fe640 1 --2- 172.21.15.148:0/1866105365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d4032490 0x55f9d4402970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c77fe640 1 -- 172.21.15.148:0/1866105365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d40c6930 con 0x55f9d405b350 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c57fa640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd0b00b6620 0x7fd0b00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd0b00b6620 0x7fd0b00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c77fe640 1 --2- 172.21.15.148:0/1866105365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d4402430 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00bf70 tx=0x7fd0bc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fd2fec5eb6eea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:02.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0c57fa640 1 -- 172.21.15.148:0/1557082430 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fd0c01088f0 con 0x7fd0c8108cf0 2024-09-21T01:14:02.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0ae7fc640 1 -- 172.21.15.148:0/1866105365 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc004030 con 0x55f9d405b350 2024-09-21T01:14:02.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0ae7fc640 1 -- 172.21.15.148:0/1866105365 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0bc0054d0 con 0x55f9d405b350 2024-09-21T01:14:02.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.663+0000 7fd0ae7fc640 1 -- 172.21.15.148:0/1866105365 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc004a90 con 0x55f9d405b350 2024-09-21T01:14:02.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.664+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/1866105365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 msgr2=0x55f9d4402430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.664+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd0b00b6620 0x7fd0b00b8b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8005fd0 tx=0x7fd0b8005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.664+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/1866105365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d4402430 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00bf70 tx=0x7fd0bc00b780 comp rx=0 tx=0).stop 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.664+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/1866105365 shutdown_connections 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.664+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/1866105365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d4402eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.664+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/1866105365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d4032490 0x55f9d4402970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.664+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/1866105365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d4402430 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.664+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/1866105365 >> 172.21.15.148:0/1866105365 conn(0x55f9d404f740 msgr2=0x55f9d4400320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.664+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/1866105365 shutdown_connections 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.664+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/1866105365 wait complete. 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0d4ab4740 1 -- start start 2024-09-21T01:14:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0d4ab4740 1 Processor -- start 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d4412410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d4412950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 0x55f9d441e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f9d41c9890 con 0x55f9d4032490 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55f9d4302d40 con 0x55f9d405b350 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f9d4414f70 con 0x55f9d403a670 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0d4ab4740 10 client.0 _ll_register_callbacks cb 0x55f9d4366c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d4412410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d4412410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51476/0 (socket says 172.21.15.148:51476) 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.665+0000 7fd0c7fff640 1 -- 172.21.15.148:0/366442507 learned_addr learned my addr 172.21.15.148:0/366442507 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0ccadd640 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 0x55f9d441e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0c7fff640 1 -- 172.21.15.148:0/366442507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 msgr2=0x55f9d4412950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d4412950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0c7fff640 1 -- 172.21.15.148:0/366442507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 msgr2=0x55f9d441e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 0x55f9d441e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0c7fff640 1 -- 172.21.15.148:0/366442507 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d441e860 con 0x55f9d4032490 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0ccadd640 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 0x55f9d441e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d4412410 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8012730 tx=0x7fd0b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187338950742f4cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0a77fe640 1 -- 172.21.15.148:0/366442507 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b801f920 con 0x55f9d4032490 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0a77fe640 1 -- 172.21.15.148:0/366442507 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fd0b801fac0 con 0x55f9d4032490 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/366442507 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0bc0054d0 con 0x55f9d4032490 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0a77fe640 1 -- 172.21.15.148:0/366442507 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd0b801fcc0 con 0x55f9d4032490 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0d4ab4740 10 client.15405 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.666+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/366442507 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f9d44211f0 con 0x55f9d4032490 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.667+0000 7fd0a77fe640 1 -- 172.21.15.148:0/366442507 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0bc0054d0 con 0x55f9d4032490 2024-09-21T01:14:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.667+0000 7fd0a77fe640 1 -- 172.21.15.148:0/366442507 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd0b8027400 con 0x55f9d4032490 2024-09-21T01:14:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.667+0000 7fd0d4ab4740 10 client.15405 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.667+0000 7fd0d4ab4740 10 client.15405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.667+0000 7fd0d4ab4740 20 client.15405 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.667+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f9d4019cd0 0x55f9d44247a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.667+0000 7fd0d4ab4740 4 client.15405 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.667+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/366442507 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9d437adb0 con 0x55f9d4019cd0 2024-09-21T01:14:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.667+0000 7fd0c77fe640 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f9d4019cd0 0x55f9d44247a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.668+0000 7fd0c77fe640 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f9d4019cd0 0x55f9d44247a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b58b9dccec43bc6 server_cookie=3beeb31678a508c7 in_seq=0 out_seq=0 2024-09-21T01:14:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.668+0000 7fd0a77fe640 10 client.15405 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:02.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.668+0000 7fd0a77fe640 1 -- 172.21.15.148:0/366442507 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9d437adb0 con 0x55f9d4019cd0 2024-09-21T01:14:02.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.668+0000 7fd0a77fe640 10 client.15405 handle_command_reply: tid=0 2024-09-21T01:14:02.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 client.15405 shutdown 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/366442507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 msgr2=0x55f9d4412410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d4412410 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8012730 tx=0x7fd0b80046c0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/366442507 shutdown_connections 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f9d4019cd0 0x55f9d44247a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 0x55f9d441e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d4412950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/366442507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d4412410 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/366442507 >> 172.21.15.148:0/366442507 conn(0x55f9d404f740 msgr2=0x55f9d43fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0a77fe640 0 client.15405 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/366442507 shutdown_connections 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/366442507 wait complete. 2024-09-21T01:14:02.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.669+0000 7fd0d4ab4740 20 client.15405 trim_cache size 0 max 16384 2024-09-21T01:14:02.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.686+0000 7fd0d4ab4740 1 Processor -- start 2024-09-21T01:14:02.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.686+0000 7fd0d4ab4740 1 -- start start 2024-09-21T01:14:02.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d43fe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d43fed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 0x55f9d440f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c81afaa0 con 0x55f9d4032490 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c81ad370 con 0x55f9d405b350 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c81ab1c0 con 0x55f9d403a670 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d43fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d43fe850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51480/0 (socket says 172.21.15.148:51480) 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c7fff640 1 -- 172.21.15.148:0/3843274413 learned_addr learned my addr 172.21.15.148:0/3843274413 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0ccadd640 1 --2- 172.21.15.148:0/3843274413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 0x55f9d440f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c77fe640 1 --2- 172.21.15.148:0/3843274413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d43fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c7fff640 1 -- 172.21.15.148:0/3843274413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 msgr2=0x55f9d43fed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/3843274413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d43fed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c7fff640 1 -- 172.21.15.148:0/3843274413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 msgr2=0x55f9d440f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/3843274413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 0x55f9d440f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c7fff640 1 -- 172.21.15.148:0/3843274413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d4413160 con 0x55f9d4032490 2024-09-21T01:14:02.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c77fe640 1 --2- 172.21.15.148:0/3843274413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d43fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:02.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/3843274413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d43fe850 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8011d30 tx=0x7fd0b8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0f0758a31d25bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:02.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0adffb640 1 -- 172.21.15.148:0/3843274413 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b801fe60 con 0x55f9d4032490 2024-09-21T01:14:02.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0adffb640 1 -- 172.21.15.148:0/3843274413 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b8027c50 con 0x55f9d4032490 2024-09-21T01:14:02.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.687+0000 7fd0adffb640 1 -- 172.21.15.148:0/3843274413 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80035f0 con 0x55f9d4032490 2024-09-21T01:14:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.688+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/3843274413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 msgr2=0x55f9d43fe850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.688+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/3843274413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d43fe850 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8011d30 tx=0x7fd0b8005740 comp rx=0 tx=0).stop 2024-09-21T01:14:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.688+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/3843274413 shutdown_connections 2024-09-21T01:14:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.688+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/3843274413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d405b350 0x55f9d440f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.688+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/3843274413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d403a670 0x55f9d43fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.688+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/3843274413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d4032490 0x55f9d43fe850 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.688+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/3843274413 >> 172.21.15.148:0/3843274413 conn(0x55f9d404f740 msgr2=0x55f9d4410a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.688+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/3843274413 shutdown_connections 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.688+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/3843274413 wait complete. 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0d4ab4740 1 -- start start 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0d4ab4740 1 Processor -- start 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d4032490 0x55f9d441a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d403a670 0x55f9d441a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0d4ab4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d44151c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c81ab830 con 0x55f9d405b350 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c81acca0 con 0x55f9d403a670 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0d4ab4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c81abf00 con 0x55f9d4032490 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0d4ab4740 10 client.0 _ll_register_callbacks cb 0x7fd0b800b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0ccadd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d44151c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0ccadd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d44151c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51484/0 (socket says 172.21.15.148:51484) 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.689+0000 7fd0ccadd640 1 -- 172.21.15.148:0/2306289257 learned_addr learned my addr 172.21.15.148:0/2306289257 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d4032490 0x55f9d441a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0c77fe640 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d403a670 0x55f9d441a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0ccadd640 1 -- 172.21.15.148:0/2306289257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d4032490 msgr2=0x55f9d441a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0ccadd640 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d4032490 0x55f9d441a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0ccadd640 1 -- 172.21.15.148:0/2306289257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d403a670 msgr2=0x55f9d441a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0ccadd640 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d403a670 0x55f9d441a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0ccadd640 1 -- 172.21.15.148:0/2306289257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d4405260 con 0x55f9d405b350 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d4032490 0x55f9d441a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0ccadd640 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d44151c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00ce8c0 tx=0x7fd0c00ce170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc73d4393f189a36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0a77fe640 1 -- 172.21.15.148:0/2306289257 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00ce440 con 0x55f9d405b350 2024-09-21T01:14:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0a77fe640 1 -- 172.21.15.148:0/2306289257 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fd0c0004b40 con 0x55f9d405b350 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/2306289257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0b8027c50 con 0x55f9d405b350 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0a77fe640 1 -- 172.21.15.148:0/2306289257 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd0c00cf030 con 0x55f9d405b350 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0d4ab4740 10 client.15411 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.690+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/2306289257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f9d448f430 con 0x55f9d405b350 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0a77fe640 1 -- 172.21.15.148:0/2306289257 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b8027c50 con 0x55f9d405b350 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0a77fe640 1 -- 172.21.15.148:0/2306289257 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd0c00e4ae0 con 0x55f9d405b350 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0d4ab4740 10 client.15411 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0d4ab4740 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0d4ab4740 20 client.15411 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f9d3fef080 0x55f9d4491ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0d4ab4740 4 client.15411 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/2306289257 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f9d4376860 con 0x55f9d3fef080 2024-09-21T01:14:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f9d3fef080 0x55f9d4491ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0c7fff640 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f9d3fef080 0x55f9d4491ba0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=829e26dbaf9bdf79 server_cookie=76aa54dcf6ab60d9 in_seq=0 out_seq=0 2024-09-21T01:14:02.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.691+0000 7fd0a77fe640 10 client.15411 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:02.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.693+0000 7fd0a77fe640 1 -- 172.21.15.148:0/2306289257 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f9d4376860 con 0x55f9d3fef080 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.693+0000 7fd0a77fe640 10 client.15411 handle_command_reply: tid=0 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.693+0000 7fd0d4ab4740 1 client.15411 shutdown 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.693+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/2306289257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 msgr2=0x55f9d44151c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.693+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d44151c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00ce8c0 tx=0x7fd0c00ce170 comp rx=0 tx=0).stop 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.693+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/2306289257 shutdown_connections 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.693+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f9d3fef080 0x55f9d4491ba0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f9d405b350 0x55f9d44151c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9d403a670 0x55f9d441a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0a77fe640 0 client.15411 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0d4ab4740 1 --2- 172.21.15.148:0/2306289257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f9d4032490 0x55f9d441a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/2306289257 >> 172.21.15.148:0/2306289257 conn(0x55f9d404f740 msgr2=0x55f9d4403460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:02.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/2306289257 shutdown_connections 2024-09-21T01:14:02.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0d4ab4740 1 -- 172.21.15.148:0/2306289257 wait complete. 2024-09-21T01:14:02.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0d4ab4740 20 client.15411 trim_cache size 0 max 16384 2024-09-21T01:14:02.699 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:14:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "return_code": 0, 2024-09-21T01:14:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_tag": "7bf59ed6-eedb-4a06-a813-d8af8d9118b7", 2024-09-21T01:14:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": "asynchronous" 2024-09-21T01:14:02.699 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0ce540640 1 -- 172.21.15.148:0/1557082430 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd0b00b6620 msgr2=0x7fd0b00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0ce540640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd0b00b6620 0x7fd0b00b8b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8005fd0 tx=0x7fd0b8005c50 comp rx=0 tx=0).stop 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0ce540640 1 -- 172.21.15.148:0/1557082430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0c8108cf0 msgr2=0x7fd0c819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0ce540640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0c8108cf0 0x7fd0c819bd70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0005cc0 tx=0x7fd0c002f380 comp rx=0 tx=0).stop 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0ce540640 1 -- 172.21.15.148:0/1557082430 shutdown_connections 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0ce540640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fd0b00b6620 0x7fd0b00b8b30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0ce540640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0c8108cf0 0x7fd0c819bd70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0ce540640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0c81083a0 0x7fd0c819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0ce540640 1 --2- 172.21.15.148:0/1557082430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0c8102a60 0x7fd0c819b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.694+0000 7fd0ce540640 1 -- 172.21.15.148:0/1557082430 >> 172.21.15.148:0/1557082430 conn(0x7fd0c8079730 msgr2=0x7fd0c8104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.695+0000 7fd0ce540640 1 -- 172.21.15.148:0/1557082430 shutdown_connections 2024-09-21T01:14:02.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:02.695+0000 7fd0ce540640 1 -- 172.21.15.148:0/1557082430 wait complete. 2024-09-21T01:14:03.468 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:14:03.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:03 smithi181 ceph-mon[34811]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T01:14:03.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:03 smithi181 ceph-mon[34811]: scrub queued for path: / 2024-09-21T01:14:03.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:03 smithi181 ceph-mon[34811]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:03.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:03 smithi181 ceph-mon[34811]: scrub summary: active paths [/] 2024-09-21T01:14:03.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:03 smithi181 ceph-mon[34811]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:03.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:03 smithi157 ceph-mon[34140]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T01:14:03.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:03 smithi157 ceph-mon[34140]: scrub queued for path: / 2024-09-21T01:14:03.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:03 smithi157 ceph-mon[34140]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:03.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:03 smithi157 ceph-mon[34140]: scrub summary: active paths [/] 2024-09-21T01:14:03.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:03 smithi157 ceph-mon[34140]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:03.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:03 smithi148 ceph-mon[31000]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T01:14:03.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:03 smithi148 ceph-mon[31000]: scrub queued for path: / 2024-09-21T01:14:03.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:03 smithi148 ceph-mon[31000]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:03.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:03 smithi148 ceph-mon[31000]: scrub summary: active paths [/] 2024-09-21T01:14:03.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:03 smithi148 ceph-mon[31000]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.243+0000 7f57232a1640 1 -- 172.21.15.148:0/4290479175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571c102080 msgr2=0x7f571c102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.243+0000 7f57232a1640 1 --2- 172.21.15.148:0/4290479175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571c102080 0x7f571c102490 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5718009900 tx=0x7f571802a410 comp rx=0 tx=0).stop 2024-09-21T01:14:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.243+0000 7f57232a1640 1 -- 172.21.15.148:0/4290479175 shutdown_connections 2024-09-21T01:14:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.243+0000 7f57232a1640 1 --2- 172.21.15.148:0/4290479175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571c109eb0 0x7f571c1106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.243+0000 7f57232a1640 1 --2- 172.21.15.148:0/4290479175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f571c109560 0x7f571c109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.243+0000 7f57232a1640 1 --2- 172.21.15.148:0/4290479175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571c102080 0x7f571c102490 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.243+0000 7f57232a1640 1 -- 172.21.15.148:0/4290479175 >> 172.21.15.148:0/4290479175 conn(0x7f571c079ec0 msgr2=0x7f571c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.244+0000 7f57232a1640 1 -- 172.21.15.148:0/4290479175 shutdown_connections 2024-09-21T01:14:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.244+0000 7f57232a1640 1 -- 172.21.15.148:0/4290479175 wait complete. 2024-09-21T01:14:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.244+0000 7f57232a1640 1 Processor -- start 2024-09-21T01:14:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.244+0000 7f57232a1640 1 -- start start 2024-09-21T01:14:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f57232a1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571c102080 0x7f571c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f57232a1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571c109560 0x7f571c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f57232a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f571c109eb0 0x7f571c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f57232a1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f571c113b70 con 0x7f571c102080 2024-09-21T01:14:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f57232a1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1139f0 con 0x7f571c109560 2024-09-21T01:14:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f57232a1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f571c113cf0 con 0x7f571c109eb0 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572103d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571c102080 0x7f571c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572103d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571c102080 0x7f571c19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51500/0 (socket says 172.21.15.148:51500) 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572103d640 1 -- 172.21.15.148:0/279472206 learned_addr learned my addr 172.21.15.148:0/279472206 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572083c640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571c109560 0x7f571c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572183e640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f571c109eb0 0x7f571c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572103d640 1 -- 172.21.15.148:0/279472206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f571c109eb0 msgr2=0x7f571c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572103d640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f571c109eb0 0x7f571c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572103d640 1 -- 172.21.15.148:0/279472206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571c109560 msgr2=0x7f571c19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572103d640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571c109560 0x7f571c19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572103d640 1 -- 172.21.15.148:0/279472206 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c1a0410 con 0x7f571c102080 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572183e640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f571c109eb0 0x7f571c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572083c640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571c109560 0x7f571c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f572103d640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571c102080 0x7f571c19a560 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5718006010 tx=0x7f57180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:04.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f57127fc640 1 -- 172.21.15.148:0/279472206 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571803f030 con 0x7f571c102080 2024-09-21T01:14:04.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f57232a1640 1 -- 172.21.15.148:0/279472206 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c1a06a0 con 0x7f571c102080 2024-09-21T01:14:04.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f57232a1640 1 -- 172.21.15.148:0/279472206 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c1a0bd0 con 0x7f571c102080 2024-09-21T01:14:04.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.245+0000 7f57127fc640 1 -- 172.21.15.148:0/279472206 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5718003800 con 0x7f571c102080 2024-09-21T01:14:04.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.246+0000 7f57127fc640 1 -- 172.21.15.148:0/279472206 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718035070 con 0x7f571c102080 2024-09-21T01:14:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f5729815740 1 Processor -- start 2024-09-21T01:14:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f5729815740 1 -- start start 2024-09-21T01:14:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f5729815740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f62073d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f57127fc640 1 -- 172.21.15.148:0/279472206 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f5718003cb0 con 0x7f571c102080 2024-09-21T01:14:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f5729815740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f62036d1b0 0x55f62073db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f5729815740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620375390 0x55f62073e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f5729815740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f6206b3e50 con 0x55f620396070 2024-09-21T01:14:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f5729815740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55f6206a3280 con 0x55f620375390 2024-09-21T01:14:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f5729815740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f6206a7090 con 0x55f62036d1b0 2024-09-21T01:14:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f572183e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f62073d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f572183e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f62073d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51504/0 (socket says 172.21.15.148:51504) 2024-09-21T01:14:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.249+0000 7f572183e640 1 -- 172.21.15.148:0/3022843215 learned_addr learned my addr 172.21.15.148:0/3022843215 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f572083c640 1 --2- 172.21.15.148:0/3022843215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620375390 0x55f62073e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f572103d640 1 --2- 172.21.15.148:0/3022843215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f62036d1b0 0x55f62073db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f572183e640 1 -- 172.21.15.148:0/3022843215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f62036d1b0 msgr2=0x55f62073db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f572183e640 1 --2- 172.21.15.148:0/3022843215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f62036d1b0 0x55f62073db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f572183e640 1 -- 172.21.15.148:0/3022843215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620375390 msgr2=0x55f62073e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f572183e640 1 --2- 172.21.15.148:0/3022843215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620375390 0x55f62073e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f572183e640 1 -- 172.21.15.148:0/3022843215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f620401650 con 0x55f620396070 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f572183e640 1 --2- 172.21.15.148:0/3022843215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f62073d650 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5714008dd0 tx=0x7f571400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e563e38cec54ab31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f57127fc640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57080b6650 0x7f57080b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f57077fe640 1 -- 172.21.15.148:0/3022843215 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714018680 con 0x55f620396070 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f57077fe640 1 -- 172.21.15.148:0/3022843215 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5714018cd0 con 0x55f620396070 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f57077fe640 1 -- 172.21.15.148:0/3022843215 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571400fd20 con 0x55f620396070 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f572103d640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57080b6650 0x7f57080b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.250+0000 7f57127fc640 1 -- 172.21.15.148:0/279472206 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f5718107eb0 con 0x7f571c102080 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.251+0000 7f5729815740 1 -- 172.21.15.148:0/3022843215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 msgr2=0x55f62073d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.251+0000 7f572103d640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57080b6650 0x7f57080b8b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55f62073c2d0 tx=0x7f5718031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:04.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.251+0000 7f5729815740 1 --2- 172.21.15.148:0/3022843215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f62073d650 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5714008dd0 tx=0x7f571400d710 comp rx=0 tx=0).stop 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.251+0000 7f5729815740 1 -- 172.21.15.148:0/3022843215 shutdown_connections 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.251+0000 7f5729815740 1 --2- 172.21.15.148:0/3022843215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620375390 0x55f62073e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.251+0000 7f5729815740 1 --2- 172.21.15.148:0/3022843215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f62036d1b0 0x55f62073db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.251+0000 7f5729815740 1 --2- 172.21.15.148:0/3022843215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f62073d650 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.251+0000 7f5729815740 1 -- 172.21.15.148:0/3022843215 >> 172.21.15.148:0/3022843215 conn(0x55f62038a460 msgr2=0x55f62073b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.251+0000 7f5729815740 1 -- 172.21.15.148:0/3022843215 shutdown_connections 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.251+0000 7f5729815740 1 -- 172.21.15.148:0/3022843215 wait complete. 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f5729815740 1 -- start start 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f5729815740 1 Processor -- start 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f5729815740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f62036d1b0 0x55f62074d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f5729815740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 0x55f62074d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f5729815740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620396070 0x55f62074db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f5729815740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f620504700 con 0x55f62036d1b0 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f5729815740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55f62063e110 con 0x55f620396070 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f5729815740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f620750190 con 0x55f620375390 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f5729815740 10 client.0 _ll_register_callbacks cb 0x55f620657990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f572183e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f62036d1b0 0x55f62074d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f572183e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f62036d1b0 0x55f62074d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51514/0 (socket says 172.21.15.148:51514) 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.252+0000 7f572183e640 1 -- 172.21.15.148:0/747069265 learned_addr learned my addr 172.21.15.148:0/747069265 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f572083c640 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 0x55f62074d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f572183e640 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620396070 0x55f62074db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f572183e640 1 -- 172.21.15.148:0/747069265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 msgr2=0x55f62074d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f572183e640 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 0x55f62074d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f572183e640 1 -- 172.21.15.148:0/747069265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620396070 msgr2=0x55f62074db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f572183e640 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620396070 0x55f62074db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f572183e640 1 -- 172.21.15.148:0/747069265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f62066bc40 con 0x55f62036d1b0 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f572183e640 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f62036d1b0 0x55f62074d0c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5714004af0 tx=0x7f5714004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537dadfcf25e1e5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f5704ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f5704ff9640 1 -- 172.21.15.148:0/747069265 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714018890 con 0x55f62036d1b0 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f5704ff9640 1 -- 172.21.15.148:0/747069265 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f5714018a30 con 0x55f62036d1b0 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f5729815740 1 -- 172.21.15.148:0/747069265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5714018cd0 con 0x55f62036d1b0 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f5704ff9640 1 -- 172.21.15.148:0/747069265 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5714028420 con 0x55f62036d1b0 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f5729815740 10 client.15423 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.253+0000 7f5729815740 1 -- 172.21.15.148:0/747069265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f62075bea0 con 0x55f62036d1b0 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.254+0000 7f5704ff9640 1 -- 172.21.15.148:0/747069265 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5714018cd0 con 0x55f62036d1b0 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.254+0000 7f5704ff9640 1 -- 172.21.15.148:0/747069265 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5714033650 con 0x55f62036d1b0 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.254+0000 7f5729815740 10 client.15423 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.254+0000 7f5729815740 10 client.15423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.254+0000 7f5729815740 20 client.15423 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.254+0000 7f5729815740 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f6203549f0 0x55f62075f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.254+0000 7f5729815740 4 client.15423 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.254+0000 7f5729815740 1 -- 172.21.15.148:0/747069265 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6206b5da0 con 0x55f6203549f0 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.254+0000 7f572083c640 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f6203549f0 0x55f62075f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.255+0000 7f5704ff9640 10 client.15423 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.255+0000 7f572083c640 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f6203549f0 0x55f62075f310 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b3f9d39cddbc37 server_cookie=1cd6a2de2b634f0d in_seq=0 out_seq=0 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5704ff9640 1 -- 172.21.15.148:0/747069265 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f6206b5da0 con 0x55f6203549f0 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5704ff9640 10 client.15423 handle_command_reply: tid=0 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 client.15423 shutdown 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 -- 172.21.15.148:0/747069265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f62036d1b0 msgr2=0x55f62074d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f62036d1b0 0x55f62074d0c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5714004af0 tx=0x7f5714004a40 comp rx=0 tx=0).stop 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 -- 172.21.15.148:0/747069265 shutdown_connections 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f6203549f0 0x55f62075f310 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620396070 0x55f62074db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 0x55f62074d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5704ff9640 0 client.15423 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 --2- 172.21.15.148:0/747069265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f62036d1b0 0x55f62074d0c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 -- 172.21.15.148:0/747069265 >> 172.21.15.148:0/747069265 conn(0x55f62038a460 msgr2=0x55f620739b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 -- 172.21.15.148:0/747069265 shutdown_connections 2024-09-21T01:14:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 1 -- 172.21.15.148:0/747069265 wait complete. 2024-09-21T01:14:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.256+0000 7f5729815740 20 client.15423 trim_cache size 0 max 16384 2024-09-21T01:14:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.273+0000 7f5729815740 1 Processor -- start 2024-09-21T01:14:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.273+0000 7f5729815740 1 -- start start 2024-09-21T01:14:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.273+0000 7f5729815740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f62036d1b0 0x55f62074ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.273+0000 7f5729815740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620375390 0x55f62074a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.273+0000 7f5729815740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620396070 0x55f62074a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.273+0000 7f5729815740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1afa10 con 0x55f620375390 2024-09-21T01:14:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.273+0000 7f5729815740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1ad2e0 con 0x55f620396070 2024-09-21T01:14:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.273+0000 7f5729815740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1ab130 con 0x55f62036d1b0 2024-09-21T01:14:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f572083c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620375390 0x55f62074a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f572083c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620375390 0x55f62074a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51526/0 (socket says 172.21.15.148:51526) 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f572083c640 1 -- 172.21.15.148:0/271180886 learned_addr learned my addr 172.21.15.148:0/271180886 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f572083c640 1 -- 172.21.15.148:0/271180886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f62036d1b0 msgr2=0x55f62074ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f572083c640 1 --2- 172.21.15.148:0/271180886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f62036d1b0 0x55f62074ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f572083c640 1 -- 172.21.15.148:0/271180886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620396070 msgr2=0x55f62074a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f572083c640 1 --2- 172.21.15.148:0/271180886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620396070 0x55f62074a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f572083c640 1 -- 172.21.15.148:0/271180886 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f620740480 con 0x55f620375390 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f572083c640 1 --2- 172.21.15.148:0/271180886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620375390 0x55f62074a2b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f570c009b20 tx=0x7f570c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee6d2dc2ca03b00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f5706ffd640 1 -- 172.21.15.148:0/271180886 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0120d0 con 0x55f620375390 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f5706ffd640 1 -- 172.21.15.148:0/271180886 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f570c012270 con 0x55f620375390 2024-09-21T01:14:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.274+0000 7f5706ffd640 1 -- 172.21.15.148:0/271180886 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c01b700 con 0x55f620375390 2024-09-21T01:14:04.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 -- 172.21.15.148:0/271180886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620375390 msgr2=0x55f62074a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 --2- 172.21.15.148:0/271180886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620375390 0x55f62074a2b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f570c009b20 tx=0x7f570c012820 comp rx=0 tx=0).stop 2024-09-21T01:14:04.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 -- 172.21.15.148:0/271180886 shutdown_connections 2024-09-21T01:14:04.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 --2- 172.21.15.148:0/271180886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620375390 0x55f62074a2b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 --2- 172.21.15.148:0/271180886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f620396070 0x55f62074a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 --2- 172.21.15.148:0/271180886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f62036d1b0 0x55f62074ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 -- 172.21.15.148:0/271180886 >> 172.21.15.148:0/271180886 conn(0x55f62038a460 msgr2=0x55f62074e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 -- 172.21.15.148:0/271180886 shutdown_connections 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 -- 172.21.15.148:0/271180886 wait complete. 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 -- start start 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.275+0000 7f5729815740 1 Processor -- start 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f5729815740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f62036d1b0 0x55f620762350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f5729815740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 0x55f620762930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f5729815740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f6207bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f5729815740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1ab7a0 con 0x55f620396070 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f5729815740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1acc10 con 0x55f62036d1b0 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f5729815740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1abe70 con 0x55f620375390 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f5729815740 10 client.0 _ll_register_callbacks cb 0x7f5714008c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572183e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f6207bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572183e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f6207bee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51540/0 (socket says 172.21.15.148:51540) 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572183e640 1 -- 172.21.15.148:0/593996073 learned_addr learned my addr 172.21.15.148:0/593996073 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572183e640 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f62036d1b0 0x55f620762350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572083c640 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 0x55f620762930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572183e640 1 -- 172.21.15.148:0/593996073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 msgr2=0x55f620762930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572183e640 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 0x55f620762930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572183e640 1 -- 172.21.15.148:0/593996073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f62036d1b0 msgr2=0x55f620762350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572183e640 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f62036d1b0 0x55f620762350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572183e640 1 -- 172.21.15.148:0/593996073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6207bf490 con 0x55f620396070 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.276+0000 7f572083c640 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 0x55f620762930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f572183e640 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f6207bee20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5714004a80 tx=0x7f57140021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99970474acf1505 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5704ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:04.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5704ff9640 1 -- 172.21.15.148:0/593996073 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57140335f0 con 0x55f620396070 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5704ff9640 1 -- 172.21.15.148:0/593996073 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f5714033790 con 0x55f620396070 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5729815740 1 -- 172.21.15.148:0/593996073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f570c012270 con 0x55f620396070 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5704ff9640 1 -- 172.21.15.148:0/593996073 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5714018690 con 0x55f620396070 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5729815740 10 client.15429 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5729815740 1 -- 172.21.15.148:0/593996073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f6207c9ad0 con 0x55f620396070 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5704ff9640 1 -- 172.21.15.148:0/593996073 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f570c012270 con 0x55f620396070 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5704ff9640 1 -- 172.21.15.148:0/593996073 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5714028960 con 0x55f620396070 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5729815740 10 client.15429 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5729815740 10 client.15429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5729815740 20 client.15429 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5729815740 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f620329da0 0x55f6207cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.277+0000 7f5729815740 4 client.15429 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:14:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.278+0000 7f5729815740 1 -- 172.21.15.148:0/593996073 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f6206b1850 con 0x55f620329da0 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.278+0000 7f572083c640 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f620329da0 0x55f6207cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.278+0000 7f5704ff9640 10 client.15429 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.278+0000 7f572083c640 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f620329da0 0x55f6207cbf50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56c0a4cf28073211 server_cookie=8a913ef7e137755e in_seq=0 out_seq=0 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.278+0000 7f5704ff9640 1 -- 172.21.15.148:0/593996073 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55f6206b1850 con 0x55f620329da0 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.278+0000 7f5704ff9640 10 client.15429 handle_command_reply: tid=0 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.278+0000 7f5729815740 1 client.15429 shutdown 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.278+0000 7f5729815740 1 -- 172.21.15.148:0/593996073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 msgr2=0x55f6207bee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5729815740 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f6207bee20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5714004a80 tx=0x7f57140021d0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5729815740 1 -- 172.21.15.148:0/593996073 shutdown_connections 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5729815740 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f620329da0 0x55f6207cbf50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5729815740 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f620396070 0x55f6207bee20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5729815740 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f620375390 0x55f620762930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5729815740 1 --2- 172.21.15.148:0/593996073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f62036d1b0 0x55f620762350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5729815740 1 -- 172.21.15.148:0/593996073 >> 172.21.15.148:0/593996073 conn(0x55f62038a460 msgr2=0x55f62073e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5704ff9640 0 client.15429 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5729815740 1 -- 172.21.15.148:0/593996073 shutdown_connections 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5729815740 1 -- 172.21.15.148:0/593996073 wait complete. 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f5729815740 20 client.15429 trim_cache size 0 max 16384 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": { 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stdout: "7bf59ed6-eedb-4a06-a813-d8af8d9118b7": { 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stdout: "tag": "7bf59ed6-eedb-4a06-a813-d8af8d9118b7", 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stdout: "options": "recursive,force" 2024-09-21T01:14:04.285 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_stats": { 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: "7bf59ed6-eedb-4a06-a813-d8af8d9118b7": { 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:14:02.691995+0000", 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:14:04.286 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:14:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f57232a1640 1 -- 172.21.15.148:0/279472206 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57080b6650 msgr2=0x7f57080b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f57232a1640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57080b6650 0x7f57080b8b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55f62073c2d0 tx=0x7f5718031400 comp rx=0 tx=0).stop 2024-09-21T01:14:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f57232a1640 1 -- 172.21.15.148:0/279472206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571c102080 msgr2=0x7f571c19a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.279+0000 7f57232a1640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571c102080 0x7f571c19a560 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5718006010 tx=0x7f57180042f0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.280+0000 7f57232a1640 1 -- 172.21.15.148:0/279472206 shutdown_connections 2024-09-21T01:14:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.280+0000 7f57232a1640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f57080b6650 0x7f57080b8b60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.280+0000 7f57232a1640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f571c109eb0 0x7f571c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.280+0000 7f57232a1640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f571c109560 0x7f571c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.280+0000 7f57232a1640 1 --2- 172.21.15.148:0/279472206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f571c102080 0x7f571c19a560 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.280+0000 7f57232a1640 1 -- 172.21.15.148:0/279472206 >> 172.21.15.148:0/279472206 conn(0x7f571c079ec0 msgr2=0x7f571c107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:04.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.280+0000 7f57232a1640 1 -- 172.21.15.148:0/279472206 shutdown_connections 2024-09-21T01:14:04.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:04.280+0000 7f57232a1640 1 -- 172.21.15.148:0/279472206 wait complete. 2024-09-21T01:14:05.035 INFO:tasks.cephfs.filesystem:scrub status for tag:7bf59ed6-eedb-4a06-a813-d8af8d9118b7 - {'path': '/', 'tag': '7bf59ed6-eedb-4a06-a813-d8af8d9118b7', 'options': 'recursive,force'} 2024-09-21T01:14:05.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:05 smithi181 ceph-mon[34811]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T01:14:05.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:05 smithi157 ceph-mon[34140]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T01:14:05.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:05 smithi148 ceph-mon[31000]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T01:14:07.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:07 smithi181 ceph-mon[34811]: pgmap v342: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-09-21T01:14:07.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:07 smithi157 ceph-mon[34140]: pgmap v342: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-09-21T01:14:07.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:07 smithi148 ceph-mon[31000]: pgmap v342: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-09-21T01:14:09.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:09 smithi181 ceph-mon[34811]: pgmap v343: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:14:09.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:09 smithi157 ceph-mon[34140]: pgmap v343: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:14:09.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:09 smithi148 ceph-mon[31000]: pgmap v343: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:14:11.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:11 smithi181 ceph-mon[34811]: pgmap v344: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:14:11.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:11 smithi157 ceph-mon[34140]: pgmap v344: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:14:11.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:11 smithi148 ceph-mon[31000]: pgmap v344: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T01:14:13.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:13 smithi181 ceph-mon[34811]: pgmap v345: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-21T01:14:13.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:13 smithi157 ceph-mon[34140]: pgmap v345: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-21T01:14:13.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:13 smithi148 ceph-mon[31000]: pgmap v345: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-21T01:14:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.033+0000 7f101278b640 1 -- 172.21.15.148:0/1607940826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f100c103fe0 msgr2=0x7f100c10a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.033+0000 7f101278b640 1 --2- 172.21.15.148:0/1607940826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f100c103fe0 0x7f100c10a980 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1004009ca0 tx=0x7f100402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.033+0000 7f101278b640 1 -- 172.21.15.148:0/1607940826 shutdown_connections 2024-09-21T01:14:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.033+0000 7f101278b640 1 --2- 172.21.15.148:0/1607940826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f100c103fe0 0x7f100c10a980 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.033+0000 7f101278b640 1 --2- 172.21.15.148:0/1607940826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f100c103640 0x7f100c103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.033+0000 7f101278b640 1 --2- 172.21.15.148:0/1607940826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100c1025c0 0x7f100c102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.033+0000 7f101278b640 1 -- 172.21.15.148:0/1607940826 >> 172.21.15.148:0/1607940826 conn(0x7f100c0fdf00 msgr2=0x7f100c1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.034+0000 7f101278b640 1 -- 172.21.15.148:0/1607940826 shutdown_connections 2024-09-21T01:14:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.034+0000 7f101278b640 1 -- 172.21.15.148:0/1607940826 wait complete. 2024-09-21T01:14:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.034+0000 7f101278b640 1 Processor -- start 2024-09-21T01:14:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.034+0000 7f101278b640 1 -- start start 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f101278b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100c1025c0 0x7f100c199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f101278b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f100c103640 0x7f100c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f101278b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f100c103fe0 0x7f100c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f101278b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f100c10f3b0 con 0x7f100c103640 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f101278b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f100c10f230 con 0x7f100c103fe0 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f101278b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f100c10f530 con 0x7f100c1025c0 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f100b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f100c103640 0x7f100c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f100b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f100c103640 0x7f100c19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39198/0 (socket says 172.21.15.148:39198) 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f100b7fe640 1 -- 172.21.15.148:0/787366147 learned_addr learned my addr 172.21.15.148:0/787366147 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f100bfff640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100c1025c0 0x7f100c199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f1010d28640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f100c103fe0 0x7f100c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f100b7fe640 1 -- 172.21.15.148:0/787366147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100c1025c0 msgr2=0x7f100c199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f100b7fe640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100c1025c0 0x7f100c199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f100b7fe640 1 -- 172.21.15.148:0/787366147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f100c103fe0 msgr2=0x7f100c19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f100b7fe640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f100c103fe0 0x7f100c19b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f100b7fe640 1 -- 172.21.15.148:0/787366147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c19b9c0 con 0x7f100c103640 2024-09-21T01:14:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f100b7fe640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f100c103640 0x7f100c19a5f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f100000d950 tx=0x7f100000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f10097fa640 1 -- 172.21.15.148:0/787366147 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000017070 con 0x7f100c103640 2024-09-21T01:14:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f10097fa640 1 -- 172.21.15.148:0/787366147 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1000009c30 con 0x7f100c103640 2024-09-21T01:14:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f101278b640 1 -- 172.21.15.148:0/787366147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100c19bcb0 con 0x7f100c103640 2024-09-21T01:14:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f10097fa640 1 -- 172.21.15.148:0/787366147 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100000f620 con 0x7f100c103640 2024-09-21T01:14:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.035+0000 7f101278b640 1 -- 172.21.15.148:0/787366147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100c1a23a0 con 0x7f100c103640 2024-09-21T01:14:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.038+0000 7f10197d5740 1 Processor -- start 2024-09-21T01:14:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.038+0000 7f10097fa640 1 -- 172.21.15.148:0/787366147 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f1000010460 con 0x7f100c103640 2024-09-21T01:14:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.038+0000 7f10197d5740 1 -- start start 2024-09-21T01:14:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f10197d5740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb30f1b0 0x558cbb6b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f10197d5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f10197d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2ee4d0 0x558cbb6b8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f10197d5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558cbb6296f0 con 0x558cbb2e62f0 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f10197d5740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x558cbb618b20 con 0x558cbb30f1b0 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f10197d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558cbb61c930 con 0x558cbb2ee4d0 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f100bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f100bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6b74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39200/0 (socket says 172.21.15.148:39200) 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f100bfff640 1 -- 172.21.15.148:0/1125017972 learned_addr learned my addr 172.21.15.148:0/1125017972 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f100b7fe640 1 --2- 172.21.15.148:0/1125017972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2ee4d0 0x558cbb6b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f1010d28640 1 --2- 172.21.15.148:0/1125017972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb30f1b0 0x558cbb6b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f100bfff640 1 -- 172.21.15.148:0/1125017972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2ee4d0 msgr2=0x558cbb6b8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f100bfff640 1 --2- 172.21.15.148:0/1125017972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2ee4d0 0x558cbb6b8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f100bfff640 1 -- 172.21.15.148:0/1125017972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb30f1b0 msgr2=0x558cbb6b6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f100bfff640 1 --2- 172.21.15.148:0/1125017972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb30f1b0 0x558cbb6b6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f100bfff640 1 -- 172.21.15.148:0/1125017972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cbb5de530 con 0x558cbb2e62f0 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f1010d28640 1 --2- 172.21.15.148:0/1125017972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb30f1b0 0x558cbb6b6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f10097fa640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ff40b65a0 0x7f0ff40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f1010d28640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ff40b65a0 0x7f0ff40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f100bfff640 1 --2- 172.21.15.148:0/1125017972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6b74c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00ac10 tx=0x7f0ffc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcec240772bd861 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.039+0000 7f10097fa640 1 -- 172.21.15.148:0/787366147 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f10000e6fd0 con 0x7f100c103640 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f0ff27fc640 1 -- 172.21.15.148:0/1125017972 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc01d070 con 0x558cbb2e62f0 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f0ff27fc640 1 -- 172.21.15.148:0/1125017972 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc018af0 con 0x558cbb2e62f0 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f0ff27fc640 1 -- 172.21.15.148:0/1125017972 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc010a90 con 0x558cbb2e62f0 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f10197d5740 1 -- 172.21.15.148:0/1125017972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 msgr2=0x558cbb6b74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f1010d28640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ff40b65a0 0x7f0ff40b8ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1004005e30 tx=0x7f1004031af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f10197d5740 1 --2- 172.21.15.148:0/1125017972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6b74c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00ac10 tx=0x7f0ffc00f790 comp rx=0 tx=0).stop 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f10197d5740 1 -- 172.21.15.148:0/1125017972 shutdown_connections 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f10197d5740 1 --2- 172.21.15.148:0/1125017972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6b74c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f10197d5740 1 --2- 172.21.15.148:0/1125017972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2ee4d0 0x558cbb6b8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f10197d5740 1 --2- 172.21.15.148:0/1125017972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb30f1b0 0x558cbb6b6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.040+0000 7f10197d5740 1 -- 172.21.15.148:0/1125017972 >> 172.21.15.148:0/1125017972 conn(0x558cbb303300 msgr2=0x558cbb6b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 1 -- 172.21.15.148:0/1125017972 shutdown_connections 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 1 -- 172.21.15.148:0/1125017972 wait complete. 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 1 -- start start 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 1 Processor -- start 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2ee4d0 0x558cbb6c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb30f1b0 0x558cbb6c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558cbb550ab0 con 0x558cbb2e62f0 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x558cbb5be730 con 0x558cbb2ee4d0 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558cbb6b8b30 con 0x558cbb30f1b0 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.041+0000 7f10197d5740 10 client.0 _ll_register_callbacks cb 0x558cbb6126b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39212/0 (socket says 172.21.15.148:39212) 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100bfff640 1 -- 172.21.15.148:0/4024777434 learned_addr learned my addr 172.21.15.148:0/4024777434 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f1010d28640 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb30f1b0 0x558cbb6c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100b7fe640 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2ee4d0 0x558cbb6c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100bfff640 1 -- 172.21.15.148:0/4024777434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb30f1b0 msgr2=0x558cbb6c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100bfff640 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb30f1b0 0x558cbb6c1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100bfff640 1 -- 172.21.15.148:0/4024777434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2ee4d0 msgr2=0x558cbb6c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100bfff640 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2ee4d0 0x558cbb6c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100bfff640 1 -- 172.21.15.148:0/4024777434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cbb37a790 con 0x558cbb2e62f0 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100b7fe640 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2ee4d0 0x558cbb6c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f100bfff640 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6c05d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0058c0 tx=0x7f0ffc010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a1cea6cd88ff5e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f0feb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f0feb7fe640 1 -- 172.21.15.148:0/4024777434 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc027020 con 0x558cbb2e62f0 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f0feb7fe640 1 -- 172.21.15.148:0/4024777434 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f0ffc005040 con 0x558cbb2e62f0 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f10197d5740 1 -- 172.21.15.148:0/4024777434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ffc018af0 con 0x558cbb2e62f0 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f0feb7fe640 1 -- 172.21.15.148:0/4024777434 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0ffc01d040 con 0x558cbb2e62f0 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f10197d5740 10 client.15441 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.042+0000 7f10197d5740 1 -- 172.21.15.148:0/4024777434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558cbb3f3620 con 0x558cbb2e62f0 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.043+0000 7f0feb7fe640 1 -- 172.21.15.148:0/4024777434 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc018af0 con 0x558cbb2e62f0 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.043+0000 7f0feb7fe640 1 -- 172.21.15.148:0/4024777434 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0ffc0046c0 con 0x558cbb2e62f0 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.043+0000 7f10197d5740 10 client.15441 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.043+0000 7f10197d5740 10 client.15441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.043+0000 7f10197d5740 20 client.15441 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.043+0000 7f10197d5740 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558cbb2cdd80 0x558cbb6cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.043+0000 7f10197d5740 4 client.15441 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.043+0000 7f10197d5740 1 -- 172.21.15.148:0/4024777434 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cbb62b640 con 0x558cbb2cdd80 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.043+0000 7f100b7fe640 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558cbb2cdd80 0x558cbb6cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.044+0000 7f0feb7fe640 10 client.15441 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.044+0000 7f100b7fe640 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558cbb2cdd80 0x558cbb6cda40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a13e885d9bf7dca server_cookie=9eba33272a04fed in_seq=0 out_seq=0 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.044+0000 7f0feb7fe640 1 -- 172.21.15.148:0/4024777434 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558cbb62b640 con 0x558cbb2cdd80 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.044+0000 7f0feb7fe640 10 client.15441 handle_command_reply: tid=0 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.044+0000 7f10197d5740 1 client.15441 shutdown 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 1 -- 172.21.15.148:0/4024777434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 msgr2=0x558cbb6c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6c05d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0058c0 tx=0x7f0ffc010430 comp rx=0 tx=0).stop 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 1 -- 172.21.15.148:0/4024777434 shutdown_connections 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558cbb2cdd80 0x558cbb6cda40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb30f1b0 0x558cbb6c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2ee4d0 0x558cbb6c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f0feb7fe640 0 client.15441 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 1 --2- 172.21.15.148:0/4024777434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2e62f0 0x558cbb6c05d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 1 -- 172.21.15.148:0/4024777434 >> 172.21.15.148:0/4024777434 conn(0x558cbb303300 msgr2=0x558cbb6b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 1 -- 172.21.15.148:0/4024777434 shutdown_connections 2024-09-21T01:14:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 1 -- 172.21.15.148:0/4024777434 wait complete. 2024-09-21T01:14:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.045+0000 7f10197d5740 20 client.15441 trim_cache size 0 max 16384 2024-09-21T01:14:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.059+0000 7f10197d5740 1 Processor -- start 2024-09-21T01:14:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.059+0000 7f10197d5740 1 -- start start 2024-09-21T01:14:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f10197d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2cdd80 0x558cbb6b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f10197d5740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 0x558cbb6c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f10197d5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2ee4d0 0x558cbb6b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f10197d5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1ad740 con 0x558cbb2ee4d0 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f10197d5740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1ab010 con 0x558cbb2e62f0 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f10197d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1a8e60 con 0x558cbb2cdd80 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f1010d28640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2ee4d0 0x558cbb6b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f1010d28640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2ee4d0 0x558cbb6b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39226/0 (socket says 172.21.15.148:39226) 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f1010d28640 1 -- 172.21.15.148:0/3155105606 learned_addr learned my addr 172.21.15.148:0/3155105606 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f100b7fe640 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 0x558cbb6c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f100bfff640 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2cdd80 0x558cbb6b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f1010d28640 1 -- 172.21.15.148:0/3155105606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2cdd80 msgr2=0x558cbb6b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f1010d28640 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2cdd80 0x558cbb6b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f1010d28640 1 -- 172.21.15.148:0/3155105606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 msgr2=0x558cbb6c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f1010d28640 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 0x558cbb6c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f1010d28640 1 -- 172.21.15.148:0/3155105606 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cbb6c1b70 con 0x558cbb2ee4d0 2024-09-21T01:14:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f100bfff640 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2cdd80 0x558cbb6b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f100b7fe640 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 0x558cbb6c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f1010d28640 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2ee4d0 0x558cbb6b1610 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1004035000 tx=0x7f1004041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69bd3bf0669c14e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f0ff1ffb640 1 -- 172.21.15.148:0/3155105606 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004004040 con 0x558cbb2ee4d0 2024-09-21T01:14:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f0ff1ffb640 1 -- 172.21.15.148:0/3155105606 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1004036050 con 0x558cbb2ee4d0 2024-09-21T01:14:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.060+0000 7f0ff1ffb640 1 -- 172.21.15.148:0/3155105606 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100402fb00 con 0x558cbb2ee4d0 2024-09-21T01:14:15.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.061+0000 7f10197d5740 1 -- 172.21.15.148:0/3155105606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2ee4d0 msgr2=0x558cbb6b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.061+0000 7f10197d5740 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2ee4d0 0x558cbb6b1610 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1004035000 tx=0x7f1004041000 comp rx=0 tx=0).stop 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.061+0000 7f10197d5740 1 -- 172.21.15.148:0/3155105606 shutdown_connections 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.061+0000 7f10197d5740 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2ee4d0 0x558cbb6b1610 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.061+0000 7f10197d5740 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 0x558cbb6c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.061+0000 7f10197d5740 1 --2- 172.21.15.148:0/3155105606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2cdd80 0x558cbb6b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.061+0000 7f10197d5740 1 -- 172.21.15.148:0/3155105606 >> 172.21.15.148:0/3155105606 conn(0x558cbb303300 msgr2=0x558cbb6ad5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.061+0000 7f10197d5740 1 -- 172.21.15.148:0/3155105606 shutdown_connections 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.061+0000 7f10197d5740 1 -- 172.21.15.148:0/3155105606 wait complete. 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.061+0000 7f10197d5740 1 -- start start 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f10197d5740 1 Processor -- start 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f10197d5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2cdd80 0x558cbb6c5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f10197d5740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 0x558cbb6c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f10197d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2ee4d0 0x558cbb6c6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f10197d5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1a94d0 con 0x558cbb2cdd80 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f10197d5740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1aa940 con 0x558cbb2e62f0 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f10197d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1a9ba0 con 0x558cbb2ee4d0 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f10197d5740 10 client.0 _ll_register_callbacks cb 0x7f0ffc01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f100bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2cdd80 0x558cbb6c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f100bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2cdd80 0x558cbb6c5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39236/0 (socket says 172.21.15.148:39236) 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f100bfff640 1 -- 172.21.15.148:0/935597113 learned_addr learned my addr 172.21.15.148:0/935597113 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f1010d28640 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2ee4d0 0x558cbb6c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f100b7fe640 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 0x558cbb6c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f100bfff640 1 -- 172.21.15.148:0/935597113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2ee4d0 msgr2=0x558cbb6c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f100bfff640 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2ee4d0 0x558cbb6c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f100bfff640 1 -- 172.21.15.148:0/935597113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 msgr2=0x558cbb6c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f100bfff640 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 0x558cbb6c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f100bfff640 1 -- 172.21.15.148:0/935597113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cbb6c70b0 con 0x558cbb2cdd80 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.062+0000 7f100b7fe640 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 0x558cbb6c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f100bfff640 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2cdd80 0x558cbb6c5720 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc005af0 tx=0x7f0ffc00aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3be866513dffbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f0feb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f0feb7fe640 1 -- 172.21.15.148:0/935597113 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc027070 con 0x558cbb2cdd80 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f0feb7fe640 1 -- 172.21.15.148:0/935597113 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f0ffc0104a0 con 0x558cbb2cdd80 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f10197d5740 1 -- 172.21.15.148:0/935597113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1004036050 con 0x558cbb2cdd80 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f0feb7fe640 1 -- 172.21.15.148:0/935597113 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0ffc0106a0 con 0x558cbb2cdd80 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f10197d5740 10 client.15447 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f10197d5740 1 -- 172.21.15.148:0/935597113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558cbb6c8340 con 0x558cbb2cdd80 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f0feb7fe640 1 -- 172.21.15.148:0/935597113 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1004036050 con 0x558cbb2cdd80 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f0feb7fe640 1 -- 172.21.15.148:0/935597113 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0ffc005450 con 0x558cbb2cdd80 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f10197d5740 10 client.15447 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f10197d5740 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f10197d5740 20 client.15447 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f10197d5740 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558cbb30f1b0 0x558cbb73a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f10197d5740 4 client.15447 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:14:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.063+0000 7f10197d5740 1 -- 172.21.15.148:0/935597113 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558cbb6270f0 con 0x558cbb30f1b0 2024-09-21T01:14:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.064+0000 7f100b7fe640 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558cbb30f1b0 0x558cbb73a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.064+0000 7f0feb7fe640 10 client.15447 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.064+0000 7f100b7fe640 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558cbb30f1b0 0x558cbb73a520 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44d677ce254e58c1 server_cookie=4b5790e79677ad4c in_seq=0 out_seq=0 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.075+0000 7f0feb7fe640 1 -- 172.21.15.148:0/935597113 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558cbb6270f0 con 0x558cbb30f1b0 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.075+0000 7f0feb7fe640 10 client.15447 handle_command_reply: tid=0 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.075+0000 7f10197d5740 1 client.15447 shutdown 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 1 -- 172.21.15.148:0/935597113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2cdd80 msgr2=0x558cbb6c5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2cdd80 0x558cbb6c5720 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc005af0 tx=0x7f0ffc00aaf0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 1 -- 172.21.15.148:0/935597113 shutdown_connections 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x558cbb30f1b0 0x558cbb73a520 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558cbb2ee4d0 0x558cbb6c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558cbb2e62f0 0x558cbb6c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f0feb7fe640 0 client.15447 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 1 --2- 172.21.15.148:0/935597113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cbb2cdd80 0x558cbb6c5720 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 1 -- 172.21.15.148:0/935597113 >> 172.21.15.148:0/935597113 conn(0x558cbb303300 msgr2=0x558cbb6b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 1 -- 172.21.15.148:0/935597113 shutdown_connections 2024-09-21T01:14:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 1 -- 172.21.15.148:0/935597113 wait complete. 2024-09-21T01:14:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f10197d5740 20 client.15447 trim_cache size 0 max 16384 2024-09-21T01:14:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-21T01:14:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-21T01:14:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-21T01:14:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-21T01:14:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f101278b640 1 -- 172.21.15.148:0/787366147 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ff40b65a0 msgr2=0x7f0ff40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f101278b640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ff40b65a0 0x7f0ff40b8ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1004005e30 tx=0x7f1004031af0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f101278b640 1 -- 172.21.15.148:0/787366147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f100c103640 msgr2=0x7f100c19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.076+0000 7f101278b640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f100c103640 0x7f100c19a5f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f100000d950 tx=0x7f100000de10 comp rx=0 tx=0).stop 2024-09-21T01:14:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.077+0000 7f101278b640 1 -- 172.21.15.148:0/787366147 shutdown_connections 2024-09-21T01:14:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.077+0000 7f101278b640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ff40b65a0 0x7f0ff40b8ab0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.077+0000 7f101278b640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f100c103640 0x7f100c19a5f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.077+0000 7f101278b640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f100c103fe0 0x7f100c19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.077+0000 7f101278b640 1 --2- 172.21.15.148:0/787366147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f100c1025c0 0x7f100c199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.077+0000 7f101278b640 1 -- 172.21.15.148:0/787366147 >> 172.21.15.148:0/787366147 conn(0x7f100c0fdf00 msgr2=0x7f100c106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:15.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.077+0000 7f101278b640 1 -- 172.21.15.148:0/787366147 shutdown_connections 2024-09-21T01:14:15.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:15.077+0000 7f101278b640 1 -- 172.21.15.148:0/787366147 wait complete. 2024-09-21T01:14:15.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:15 smithi181 ceph-mon[34811]: pgmap v346: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T01:14:15.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:15 smithi157 ceph-mon[34140]: pgmap v346: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T01:14:15.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:15 smithi148 ceph-mon[31000]: pgmap v346: 97 pgs: 97 active+clean; 660 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T01:14:16.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:16 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:14:16.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:16 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:14:16.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:16 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:14:17.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:17 smithi157 ceph-mon[34140]: pgmap v347: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T01:14:17.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:17 smithi157 ceph-mon[34140]: scrub summary: idle 2024-09-21T01:14:17.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:17 smithi181 ceph-mon[34811]: pgmap v347: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T01:14:17.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:17 smithi181 ceph-mon[34811]: scrub summary: idle 2024-09-21T01:14:17.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:17 smithi148 ceph-mon[31000]: pgmap v347: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T01:14:17.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:17 smithi148 ceph-mon[31000]: scrub summary: idle 2024-09-21T01:14:18.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:18 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:18 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:18 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:18 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:18 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:18 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:18 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:14:18.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:18 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:14:18.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:18 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:18 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:18 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:18 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:18 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:18 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:18 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:18.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:18 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:14:18.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:18 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:14:18.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:18 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:19.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:14:19.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:14:19.114 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:14:20.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:20 smithi181 ceph-mon[34811]: pgmap v348: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T01:14:20.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:20 smithi157 ceph-mon[34140]: pgmap v348: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T01:14:20.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:20 smithi148 ceph-mon[31000]: pgmap v348: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T01:14:22.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:22 smithi181 ceph-mon[34811]: pgmap v349: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T01:14:22.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:22 smithi157 ceph-mon[34140]: pgmap v349: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T01:14:22.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:22 smithi148 ceph-mon[31000]: pgmap v349: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T01:14:24.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:24 smithi181 ceph-mon[34811]: pgmap v350: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T01:14:24.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:24 smithi157 ceph-mon[34140]: pgmap v350: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T01:14:24.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:24 smithi148 ceph-mon[31000]: pgmap v350: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T01:14:26.414 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:26 smithi148 ceph-mon[31000]: pgmap v351: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T01:14:26.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:26 smithi181 ceph-mon[34811]: pgmap v351: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T01:14:26.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:26 smithi157 ceph-mon[34140]: pgmap v351: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T01:14:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.178+0000 7fe0bde4a640 1 -- 172.21.15.148:0/1735473368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8106880 msgr2=0x7fe0b8108cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.178+0000 7fe0bde4a640 1 --2- 172.21.15.148:0/1735473368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8106880 0x7fe0b8108cc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009900 tx=0x7fe0ac02e820 comp rx=0 tx=0).stop 2024-09-21T01:14:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.178+0000 7fe0bde4a640 1 -- 172.21.15.148:0/1735473368 shutdown_connections 2024-09-21T01:14:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.178+0000 7fe0bde4a640 1 --2- 172.21.15.148:0/1735473368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8106880 0x7fe0b8108cc0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.178+0000 7fe0bde4a640 1 --2- 172.21.15.148:0/1735473368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0b8109400 0x7fe0b810b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.178+0000 7fe0bde4a640 1 --2- 172.21.15.148:0/1735473368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b806c490 0x7fe0b8106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.178+0000 7fe0bde4a640 1 -- 172.21.15.148:0/1735473368 >> 172.21.15.148:0/1735473368 conn(0x7fe0b80fdf00 msgr2=0x7fe0b81003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.178+0000 7fe0bde4a640 1 -- 172.21.15.148:0/1735473368 shutdown_connections 2024-09-21T01:14:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.178+0000 7fe0bde4a640 1 -- 172.21.15.148:0/1735473368 wait complete. 2024-09-21T01:14:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.179+0000 7fe0bde4a640 1 Processor -- start 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.179+0000 7fe0bde4a640 1 -- start start 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.179+0000 7fe0bde4a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b806c490 0x7fe0b8197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.179+0000 7fe0bde4a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0b8106880 0x7fe0b81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.179+0000 7fe0bde4a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8109400 0x7fe0b8198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.179+0000 7fe0bde4a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b810d150 con 0x7fe0b8109400 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.179+0000 7fe0bde4a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b810cfd0 con 0x7fe0b806c490 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.179+0000 7fe0bde4a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b810d2d0 con 0x7fe0b8106880 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8109400 0x7fe0b8198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8109400 0x7fe0b8198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52732/0 (socket says 172.21.15.148:52732) 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b7fff640 1 -- 172.21.15.148:0/116951189 learned_addr learned my addr 172.21.15.148:0/116951189 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0b8106880 0x7fe0b81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b806c490 0x7fe0b8197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b7fff640 1 -- 172.21.15.148:0/116951189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0b8106880 msgr2=0x7fe0b81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b7fff640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0b8106880 0x7fe0b81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b7fff640 1 -- 172.21.15.148:0/116951189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b806c490 msgr2=0x7fe0b8197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b7fff640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b806c490 0x7fe0b8197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b7fff640 1 -- 172.21.15.148:0/116951189 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b81997c0 con 0x7fe0b8109400 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b7fff640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8109400 0x7fe0b8198fa0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000eaa0 tx=0x7fe0b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b4ff9640 1 -- 172.21.15.148:0/116951189 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000cdb0 con 0x7fe0b8109400 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0bde4a640 1 -- 172.21.15.148:0/116951189 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b8199ab0 con 0x7fe0b8109400 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b4ff9640 1 -- 172.21.15.148:0/116951189 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b0005020 con 0x7fe0b8109400 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0b4ff9640 1 -- 172.21.15.148:0/116951189 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00116d0 con 0x7fe0b8109400 2024-09-21T01:14:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.180+0000 7fe0bde4a640 1 -- 172.21.15.148:0/116951189 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b81a01a0 con 0x7fe0b8109400 2024-09-21T01:14:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.183+0000 7fe0c4e8f740 1 Processor -- start 2024-09-21T01:14:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.183+0000 7fe0b4ff9640 1 -- 172.21.15.148:0/116951189 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7fe0b0011870 con 0x7fe0b8109400 2024-09-21T01:14:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.183+0000 7fe0c4e8f740 1 -- start start 2024-09-21T01:14:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c501b1b0 0x5584c53c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ff22f0 0x5584c53c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ffa4d0 0x5584c53c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5584c53356f0 con 0x5584c501b1b0 2024-09-21T01:14:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5584c5324b20 con 0x5584c4ff22f0 2024-09-21T01:14:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5584c5328930 con 0x5584c4ffa4d0 2024-09-21T01:14:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c501b1b0 0x5584c53c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b77fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ff22f0 0x5584c53c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c501b1b0 0x5584c53c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52748/0 (socket says 172.21.15.148:52748) 2024-09-21T01:14:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b6ffd640 1 -- 172.21.15.148:0/2083555848 learned_addr learned my addr 172.21.15.148:0/2083555848 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b4ff9640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a00b65a0 0x7fe0a00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b77fe640 1 -- 172.21.15.148:0/2083555848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ffa4d0 msgr2=0x5584c53c4010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/2083555848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ffa4d0 0x5584c53c4010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b77fe640 1 -- 172.21.15.148:0/2083555848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c501b1b0 msgr2=0x5584c53c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b4ff9640 1 -- 172.21.15.148:0/116951189 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fe0b00e7660 con 0x7fe0b8109400 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b7fff640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a00b65a0 0x7fe0a00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.184+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/2083555848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c501b1b0 0x5584c53c2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.185+0000 7fe0b77fe640 1 -- 172.21.15.148:0/2083555848 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c52ea530 con 0x5584c4ff22f0 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.185+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/2083555848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c501b1b0 0x5584c53c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.185+0000 7fe0b7fff640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a00b65a0 0x7fe0a00b8ab0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00e5050 tx=0x7fe0b0005890 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.185+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/2083555848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ff22f0 0x5584c53c34c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009c20 tx=0x7fe0a8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b3c881379230661 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.185+0000 7fe09dffb640 1 -- 172.21.15.148:0/2083555848 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8004050 con 0x5584c4ff22f0 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.185+0000 7fe09dffb640 1 -- 172.21.15.148:0/2083555848 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a80054d0 con 0x5584c4ff22f0 2024-09-21T01:14:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.185+0000 7fe09dffb640 1 -- 172.21.15.148:0/2083555848 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8004bf0 con 0x5584c4ff22f0 2024-09-21T01:14:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.186+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2083555848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ff22f0 msgr2=0x5584c53c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.186+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/2083555848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ff22f0 0x5584c53c34c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009c20 tx=0x7fe0a8011810 comp rx=0 tx=0).stop 2024-09-21T01:14:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.186+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2083555848 shutdown_connections 2024-09-21T01:14:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.186+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/2083555848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ffa4d0 0x5584c53c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.186+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/2083555848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ff22f0 0x5584c53c34c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.186+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/2083555848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c501b1b0 0x5584c53c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.186+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2083555848 >> 172.21.15.148:0/2083555848 conn(0x5584c500f300 msgr2=0x5584c53be8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.186+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2083555848 shutdown_connections 2024-09-21T01:14:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.186+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2083555848 wait complete. 2024-09-21T01:14:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0c4e8f740 1 -- start start 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0c4e8f740 1 Processor -- start 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ffa4d0 0x5584c53ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c501b1b0 0x5584c53cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5584c525cab0 con 0x5584c4ff22f0 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5584c52ca730 con 0x5584c4ffa4d0 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5584c53c4b30 con 0x5584c501b1b0 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0c4e8f740 10 client.0 _ll_register_callbacks cb 0x5584c531e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0b6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0b6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52752/0 (socket says 172.21.15.148:52752) 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.187+0000 7fe0b6ffd640 1 -- 172.21.15.148:0/2707786112 learned_addr learned my addr 172.21.15.148:0/2707786112 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ffa4d0 0x5584c53ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c501b1b0 0x5584c53cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe0b6ffd640 1 -- 172.21.15.148:0/2707786112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c501b1b0 msgr2=0x5584c53cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c501b1b0 0x5584c53cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe0b6ffd640 1 -- 172.21.15.148:0/2707786112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ffa4d0 msgr2=0x5584c53ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ffa4d0 0x5584c53ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe0b6ffd640 1 -- 172.21.15.148:0/2707786112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c5086790 con 0x5584c4ff22f0 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53cc5e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac038040 tx=0x7fe0ac009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985a1bfaa65fef60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe096ffd640 1 -- 172.21.15.148:0/2707786112 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac004410 con 0x5584c4ff22f0 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe096ffd640 1 -- 172.21.15.148:0/2707786112 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fe0ac033040 con 0x5584c4ff22f0 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2707786112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a80054d0 con 0x5584c4ff22f0 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe096ffd640 1 -- 172.21.15.148:0/2707786112 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe0ac057050 con 0x5584c4ff22f0 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.188+0000 7fe0c4e8f740 10 client.15459 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.189+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2707786112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5584c50ff620 con 0x5584c4ff22f0 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.189+0000 7fe096ffd640 1 -- 172.21.15.148:0/2707786112 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a80054d0 con 0x5584c4ff22f0 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.189+0000 7fe096ffd640 1 -- 172.21.15.148:0/2707786112 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe0ac045650 con 0x5584c4ff22f0 2024-09-21T01:14:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.189+0000 7fe0c4e8f740 10 client.15459 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.189+0000 7fe0c4e8f740 10 client.15459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.189+0000 7fe0c4e8f740 20 client.15459 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.189+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5584c4fd9d80 0x5584c53d9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.189+0000 7fe0c4e8f740 4 client.15459 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.189+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2707786112 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584c5337640 con 0x5584c4fd9d80 2024-09-21T01:14:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.189+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5584c4fd9d80 0x5584c53d9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.190+0000 7fe096ffd640 10 client.15459 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.190+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5584c4fd9d80 0x5584c53d9c90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=432c09137360e5a3 server_cookie=126f018b21e0e7bd in_seq=0 out_seq=0 2024-09-21T01:14:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe096ffd640 1 -- 172.21.15.148:0/2707786112 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584c5337640 con 0x5584c4fd9d80 2024-09-21T01:14:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe096ffd640 10 client.15459 handle_command_reply: tid=0 2024-09-21T01:14:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 client.15459 shutdown 2024-09-21T01:14:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2707786112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 msgr2=0x5584c53cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53cc5e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac038040 tx=0x7fe0ac009630 comp rx=0 tx=0).stop 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2707786112 shutdown_connections 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5584c4fd9d80 0x5584c53d9c90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe096ffd640 0 client.15459 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c501b1b0 0x5584c53cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ffa4d0 0x5584c53ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/2707786112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53cc5e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2707786112 >> 172.21.15.148:0/2707786112 conn(0x5584c500f300 msgr2=0x5584c53bcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2707786112 shutdown_connections 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/2707786112 wait complete. 2024-09-21T01:14:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.191+0000 7fe0c4e8f740 20 client.15459 trim_cache size 0 max 16384 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0c4e8f740 1 Processor -- start 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0c4e8f740 1 -- start start 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4fd9d80 0x5584c53c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ffa4d0 0x5584c53cb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81ab5a0 con 0x5584c4ff22f0 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81a8e70 con 0x5584c4fd9d80 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81a6cc0 con 0x5584c4ffa4d0 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52764/0 (socket says 172.21.15.148:52764) 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b77fe640 1 -- 172.21.15.148:0/175633428 learned_addr learned my addr 172.21.15.148:0/175633428 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/175633428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ffa4d0 0x5584c53cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/175633428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4fd9d80 0x5584c53c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b77fe640 1 -- 172.21.15.148:0/175633428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ffa4d0 msgr2=0x5584c53cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/175633428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ffa4d0 0x5584c53cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b77fe640 1 -- 172.21.15.148:0/175633428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4fd9d80 msgr2=0x5584c53c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/175633428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4fd9d80 0x5584c53c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b77fe640 1 -- 172.21.15.148:0/175633428 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c53bdfd0 con 0x5584c4ff22f0 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.219+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/175633428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4fd9d80 0x5584c53c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.220+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/175633428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53caaf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009730 tx=0x7fe0a8005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d959a2a2322599e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.220+0000 7fe09d7fa640 1 -- 172.21.15.148:0/175633428 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80042c0 con 0x5584c4ff22f0 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.220+0000 7fe09d7fa640 1 -- 172.21.15.148:0/175633428 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a8032020 con 0x5584c4ff22f0 2024-09-21T01:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.220+0000 7fe09d7fa640 1 -- 172.21.15.148:0/175633428 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a802e680 con 0x5584c4ff22f0 2024-09-21T01:14:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/175633428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 msgr2=0x5584c53caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/175633428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53caaf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009730 tx=0x7fe0a8005d30 comp rx=0 tx=0).stop 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/175633428 shutdown_connections 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/175633428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4ff22f0 0x5584c53caaf0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/175633428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ffa4d0 0x5584c53cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/175633428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4fd9d80 0x5584c53c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/175633428 >> 172.21.15.148:0/175633428 conn(0x5584c500f300 msgr2=0x5584c53be290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/175633428 shutdown_connections 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/175633428 wait complete. 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 -- start start 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.221+0000 7fe0c4e8f740 1 Processor -- start 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4fd9d80 0x5584c53d42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ff22f0 0x5584c53d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0c4e8f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ffa4d0 0x5584c53d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81a7330 con 0x5584c4fd9d80 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81a87a0 con 0x5584c4ffa4d0 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0c4e8f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81a7a00 con 0x5584c4ff22f0 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0c4e8f740 10 client.0 _ll_register_callbacks cb 0x7fe0ac009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4fd9d80 0x5584c53d42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4fd9d80 0x5584c53d42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52768/0 (socket says 172.21.15.148:52768) 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b6ffd640 1 -- 172.21.15.148:0/850628913 learned_addr learned my addr 172.21.15.148:0/850628913 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ffa4d0 0x5584c53d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ff22f0 0x5584c53d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b6ffd640 1 -- 172.21.15.148:0/850628913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ff22f0 msgr2=0x5584c53d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ff22f0 0x5584c53d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b6ffd640 1 -- 172.21.15.148:0/850628913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ffa4d0 msgr2=0x5584c53d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:28.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ffa4d0 0x5584c53d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b6ffd640 1 -- 172.21.15.148:0/850628913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c53d3b60 con 0x5584c4fd9d80 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ff22f0 0x5584c53d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe0b6ffd640 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4fd9d80 0x5584c53d42a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0096c0 tx=0x7fe0ac009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec1ef024161255 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.222+0000 7fe096ffd640 1 -- 172.21.15.148:0/850628913 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac045650 con 0x5584c4fd9d80 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe096ffd640 1 -- 172.21.15.148:0/850628913 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fe0ac0035f0 con 0x5584c4fd9d80 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/850628913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a8032020 con 0x5584c4fd9d80 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe096ffd640 1 -- 172.21.15.148:0/850628913 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe0ac0457f0 con 0x5584c4fd9d80 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe0c4e8f740 10 client.15465 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/850628913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5584c5444620 con 0x5584c4fd9d80 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe096ffd640 1 -- 172.21.15.148:0/850628913 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a8032020 con 0x5584c4fd9d80 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe096ffd640 1 -- 172.21.15.148:0/850628913 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe0ac041910 con 0x5584c4fd9d80 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe0c4e8f740 10 client.15465 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe0c4e8f740 10 client.15465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:28.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe0c4e8f740 20 client.15465 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5584c501b1b0 0x5584c5446ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe0c4e8f740 4 client.15465 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:14:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.223+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/850628913 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584c53330f0 con 0x5584c501b1b0 2024-09-21T01:14:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.224+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5584c501b1b0 0x5584c5446ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.224+0000 7fe096ffd640 10 client.15465 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:28.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.224+0000 7fe0b77fe640 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5584c501b1b0 0x5584c5446ea0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f5fc06ef14d35d server_cookie=2dc83dffb39c5c9d in_seq=0 out_seq=0 2024-09-21T01:14:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe096ffd640 1 -- 172.21.15.148:0/850628913 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584c53330f0 con 0x5584c501b1b0 2024-09-21T01:14:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe096ffd640 10 client.15465 handle_command_reply: tid=0 2024-09-21T01:14:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 client.15465 shutdown 2024-09-21T01:14:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/850628913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4fd9d80 msgr2=0x5584c53d42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4fd9d80 0x5584c53d42a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0096c0 tx=0x7fe0ac009630 comp rx=0 tx=0).stop 2024-09-21T01:14:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/850628913 shutdown_connections 2024-09-21T01:14:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5584c501b1b0 0x5584c5446ea0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5584c4ffa4d0 0x5584c53d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c4ff22f0 0x5584c53d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe096ffd640 0 client.15465 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 --2- 172.21.15.148:0/850628913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5584c4fd9d80 0x5584c53d42a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/850628913 >> 172.21.15.148:0/850628913 conn(0x5584c500f300 msgr2=0x5584c53c3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/850628913 shutdown_connections 2024-09-21T01:14:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 1 -- 172.21.15.148:0/850628913 wait complete. 2024-09-21T01:14:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.230+0000 7fe0c4e8f740 20 client.15465 trim_cache size 0 max 16384 2024-09-21T01:14:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-21T01:14:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-21T01:14:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-21T01:14:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-21T01:14:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 -- 172.21.15.148:0/116951189 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a00b65a0 msgr2=0x7fe0a00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a00b65a0 0x7fe0a00b8ab0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00e5050 tx=0x7fe0b0005890 comp rx=0 tx=0).stop 2024-09-21T01:14:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 -- 172.21.15.148:0/116951189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8109400 msgr2=0x7fe0b8198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8109400 0x7fe0b8198fa0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000eaa0 tx=0x7fe0b000ef60 comp rx=0 tx=0).stop 2024-09-21T01:14:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 -- 172.21.15.148:0/116951189 shutdown_connections 2024-09-21T01:14:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe0a00b65a0 0x7fe0a00b8ab0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8109400 0x7fe0b8198fa0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0b8106880 0x7fe0b81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 --2- 172.21.15.148:0/116951189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b806c490 0x7fe0b8197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 -- 172.21.15.148:0/116951189 >> 172.21.15.148:0/116951189 conn(0x7fe0b80fdf00 msgr2=0x7fe0b8104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:28.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 -- 172.21.15.148:0/116951189 shutdown_connections 2024-09-21T01:14:28.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:28.231+0000 7fe0bde4a640 1 -- 172.21.15.148:0/116951189 wait complete. 2024-09-21T01:14:28.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:28 smithi181 ceph-mon[34811]: pgmap v352: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T01:14:28.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:28 smithi157 ceph-mon[34140]: pgmap v352: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T01:14:28.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:28 smithi148 ceph-mon[31000]: pgmap v352: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T01:14:30.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:30 smithi181 ceph-mon[34811]: pgmap v353: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:14:30.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:30 smithi157 ceph-mon[34140]: pgmap v353: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:14:30.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:30 smithi148 ceph-mon[31000]: pgmap v353: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T01:14:32.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:32 smithi181 ceph-mon[34811]: pgmap v354: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:14:32.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:32 smithi157 ceph-mon[34140]: pgmap v354: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:14:32.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:32 smithi148 ceph-mon[31000]: pgmap v354: 97 pgs: 97 active+clean; 661 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:14:34.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:34 smithi181 ceph-mon[34811]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T01:14:34.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:34 smithi157 ceph-mon[34140]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T01:14:34.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:34 smithi148 ceph-mon[31000]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T01:14:35.036 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:14:35.365 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.861+0000 7f8f32566640 1 -- 172.21.15.148:0/1710906968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c102a60 msgr2=0x7f8f2c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.861+0000 7f8f32566640 1 --2- 172.21.15.148:0/1710906968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c102a60 0x7f8f2c102e70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009900 tx=0x7f8f1c02a410 comp rx=0 tx=0).stop 2024-09-21T01:14:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.861+0000 7f8f32566640 1 -- 172.21.15.148:0/1710906968 shutdown_connections 2024-09-21T01:14:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.861+0000 7f8f32566640 1 --2- 172.21.15.148:0/1710906968 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.861+0000 7f8f32566640 1 --2- 172.21.15.148:0/1710906968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.861+0000 7f8f32566640 1 --2- 172.21.15.148:0/1710906968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c102a60 0x7f8f2c102e70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.861+0000 7f8f32566640 1 -- 172.21.15.148:0/1710906968 >> 172.21.15.148:0/1710906968 conn(0x7f8f2c079730 msgr2=0x7f8f2c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.861+0000 7f8f32566640 1 -- 172.21.15.148:0/1710906968 shutdown_connections 2024-09-21T01:14:35.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.861+0000 7f8f32566640 1 -- 172.21.15.148:0/1710906968 wait complete. 2024-09-21T01:14:35.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.862+0000 7f8f32566640 1 Processor -- start 2024-09-21T01:14:35.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.862+0000 7f8f32566640 1 -- start start 2024-09-21T01:14:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f32566640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c102a60 0x7f8f2c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f32566640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f32566640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f32566640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c112960 con 0x7f8f2c1083a0 2024-09-21T01:14:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f32566640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1127e0 con 0x7f8f2c108cf0 2024-09-21T01:14:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f32566640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c112ae0 con 0x7f8f2c102a60 2024-09-21T01:14:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c102a60 0x7f8f2c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c102a60 0x7f8f2c19a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:44728/0 (socket says 172.21.15.148:44728) 2024-09-21T01:14:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f2bfff640 1 -- 172.21.15.148:0/2903074238 learned_addr learned my addr 172.21.15.148:0/2903074238 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f30b03640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f2bfff640 1 -- 172.21.15.148:0/2903074238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f2c108cf0 msgr2=0x7f8f2c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f2bfff640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f2bfff640 1 -- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c1083a0 msgr2=0x7f8f2c19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f2bfff640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f2bfff640 1 -- 172.21.15.148:0/2903074238 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c1a0390 con 0x7f8f2c102a60 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.863+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.864+0000 7f8f2bfff640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c102a60 0x7f8f2c19a420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c005940 tx=0x7f8f1c0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.864+0000 7f8f297fa640 1 -- 172.21.15.148:0/2903074238 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c03f030 con 0x7f8f2c102a60 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.864+0000 7f8f32566640 1 -- 172.21.15.148:0/2903074238 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2c1a0620 con 0x7f8f2c102a60 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.864+0000 7f8f32566640 1 -- 172.21.15.148:0/2903074238 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2c1a6de0 con 0x7f8f2c102a60 2024-09-21T01:14:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.864+0000 7f8f297fa640 1 -- 172.21.15.148:0/2903074238 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f1c0044c0 con 0x7f8f2c102a60 2024-09-21T01:14:35.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.864+0000 7f8f297fa640 1 -- 172.21.15.148:0/2903074238 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c049060 con 0x7f8f2c102a60 2024-09-21T01:14:35.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.867+0000 7f8f38ada740 1 Processor -- start 2024-09-21T01:14:35.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f38ada740 1 -- start start 2024-09-21T01:14:35.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbd0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed8001b0 0x55f4edbd0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbd10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f38ada740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f4edb46e50 con 0x55f4ed808390 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f38ada740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55f4edb36280 con 0x55f4ed829070 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f38ada740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f4edb3a090 con 0x55f4ed8001b0 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f297fa640 1 -- 172.21.15.148:0/2903074238 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f8f1c042030 con 0x7f8f2c102a60 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbd10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbd10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52798/0 (socket says 172.21.15.148:52798) 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f2b7fe640 1 -- 172.21.15.148:0/3231594368 learned_addr learned my addr 172.21.15.148:0/3231594368 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f2bfff640 1 --2- 172.21.15.148:0/3231594368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed8001b0 0x55f4edbd0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.868+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3231594368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbd0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f30b03640 1 -- 172.21.15.148:0/3231594368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed8001b0 msgr2=0x55f4edbd0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3231594368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed8001b0 0x55f4edbd0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f30b03640 1 -- 172.21.15.148:0/3231594368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 msgr2=0x55f4edbd10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:35.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3231594368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbd10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f30b03640 1 -- 172.21.15.148:0/3231594368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ed894650 con 0x55f4ed829070 2024-09-21T01:14:35.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/3231594368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbd10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:35.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f297fa640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8f140b65a0 0x7f8f140b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3231594368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbd0650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009f00 tx=0x7f8f24011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afd4a941a61832fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:35.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f2bfff640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8f140b65a0 0x7f8f140b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f297fa640 1 -- 172.21.15.148:0/2903074238 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f8f1c107310 con 0x7f8f2c102a60 2024-09-21T01:14:35.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.869+0000 7f8f127fc640 1 -- 172.21.15.148:0/3231594368 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24004d20 con 0x55f4ed829070 2024-09-21T01:14:35.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.870+0000 7f8f127fc640 1 -- 172.21.15.148:0/3231594368 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f24004030 con 0x55f4ed829070 2024-09-21T01:14:35.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.870+0000 7f8f127fc640 1 -- 172.21.15.148:0/3231594368 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24005280 con 0x55f4ed829070 2024-09-21T01:14:35.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f38ada740 1 -- 172.21.15.148:0/3231594368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 msgr2=0x55f4edbd0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f2bfff640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8f140b65a0 0x7f8f140b8ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55f4edbcf2d0 tx=0x7f8f1c02a410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:35.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3231594368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbd0650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009f00 tx=0x7f8f24011810 comp rx=0 tx=0).stop 2024-09-21T01:14:35.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f38ada740 1 -- 172.21.15.148:0/3231594368 shutdown_connections 2024-09-21T01:14:35.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3231594368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbd10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3231594368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed8001b0 0x55f4edbd0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3231594368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbd0650 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f38ada740 1 -- 172.21.15.148:0/3231594368 >> 172.21.15.148:0/3231594368 conn(0x55f4ed81d460 msgr2=0x55f4edbce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:35.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f38ada740 1 -- 172.21.15.148:0/3231594368 shutdown_connections 2024-09-21T01:14:35.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f38ada740 1 -- 172.21.15.148:0/3231594368 wait complete. 2024-09-21T01:14:35.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.871+0000 7f8f38ada740 1 -- start start 2024-09-21T01:14:35.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.872+0000 7f8f38ada740 1 Processor -- start 2024-09-21T01:14:35.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.872+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbe0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.872+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 0x55f4edbe0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.872+0000 7f8f30b03640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbe0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.872+0000 7f8f30b03640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbe0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52812/0 (socket says 172.21.15.148:52812) 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.872+0000 7f8f30b03640 1 -- 172.21.15.148:0/2892784010 learned_addr learned my addr 172.21.15.148:0/2892784010 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.872+0000 7f8f38ada740 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbec550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.872+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f4ed997700 con 0x55f4ed8001b0 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.872+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55f4edad1110 con 0x55f4ed829070 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.872+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f4edbe3190 con 0x55f4ed808390 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 0x55f4edbe0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f30b03640 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f30b03640 1 -- 172.21.15.148:0/2892784010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 msgr2=0x55f4edbe0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f30b03640 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 0x55f4edbe0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f30b03640 1 -- 172.21.15.148:0/2892784010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 msgr2=0x55f4edbec550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:35.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f30b03640 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbec550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f30b03640 1 -- 172.21.15.148:0/2892784010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4edafec40 con 0x55f4ed8001b0 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 0x55f4edbe0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f38ada740 10 client.0 _ll_register_callbacks cb 0x55f4edaea990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f30b03640 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbe0150 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009270 tx=0x7f8f24005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6a5cd2d83f80e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.873+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f24004030 con 0x55f4ed8001b0 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.874+0000 7f8f0b7fe640 1 -- 172.21.15.148:0/2892784010 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2402d060 con 0x55f4ed8001b0 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.874+0000 7f8f0b7fe640 1 -- 172.21.15.148:0/2892784010 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f8f24003d00 con 0x55f4ed8001b0 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.874+0000 7f8f0b7fe640 1 -- 172.21.15.148:0/2892784010 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8f24005040 con 0x55f4ed8001b0 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.874+0000 7f8f38ada740 10 client.15477 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.874+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55f4edbeee40 con 0x55f4ed8001b0 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.874+0000 7f8f0b7fe640 1 -- 172.21.15.148:0/2892784010 <== mon.0 v2:172.21.15.148:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8f24021070 con 0x55f4ed8001b0 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.874+0000 7f8f38ada740 10 client.15477 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.874+0000 7f8f38ada740 10 client.15477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.874+0000 7f8f38ada740 20 client.15477 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.875+0000 7f8f38ada740 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f4ed7e79f0 0x55f4edbf21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.875+0000 7f8f38ada740 4 client.15477 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.875+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8f24004030 con 0x55f4ed7e79f0 2024-09-21T01:14:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.875+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f4ed7e79f0 0x55f4edbf21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.875+0000 7f8f0b7fe640 10 client.15477 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.875+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f4ed7e79f0 0x55f4edbf21a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d719cd8f61a9471c server_cookie=bd584502e6d74b47 in_seq=0 out_seq=0 2024-09-21T01:14:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.876+0000 7f8f0b7fe640 1 -- 172.21.15.148:0/2892784010 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8f24004030 con 0x55f4ed7e79f0 2024-09-21T01:14:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.876+0000 7f8f0b7fe640 10 client.15477 handle_command_reply: tid=0 2024-09-21T01:14:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.876+0000 7f8f38ada740 1 client.15477 shutdown 2024-09-21T01:14:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.876+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 msgr2=0x55f4edbe0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.876+0000 7f8f38ada740 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbe0150 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009270 tx=0x7f8f24005bd0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.877+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 shutdown_connections 2024-09-21T01:14:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.877+0000 7f8f38ada740 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f4ed7e79f0 0x55f4edbf21a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.877+0000 7f8f38ada740 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbec550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.877+0000 7f8f38ada740 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 0x55f4edbe0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.877+0000 7f8f38ada740 1 --2- 172.21.15.148:0/2892784010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbe0150 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.877+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 >> 172.21.15.148:0/2892784010 conn(0x55f4ed81d460 msgr2=0x55f4edbd2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:35.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.877+0000 7f8f0b7fe640 0 client.15477 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:35.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.877+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 shutdown_connections 2024-09-21T01:14:35.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.877+0000 7f8f38ada740 1 -- 172.21.15.148:0/2892784010 wait complete. 2024-09-21T01:14:35.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.877+0000 7f8f38ada740 20 client.15477 trim_cache size 0 max 16384 2024-09-21T01:14:35.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f38ada740 1 Processor -- start 2024-09-21T01:14:35.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f38ada740 1 -- start start 2024-09-21T01:14:35.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbdf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 0x55f4edbce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbec450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f38ada740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f18010da0 con 0x55f4ed8001b0 2024-09-21T01:14:35.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f38ada740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1800e670 con 0x55f4ed829070 2024-09-21T01:14:35.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f38ada740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1800c4c0 con 0x55f4ed808390 2024-09-21T01:14:35.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f30b03640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbdf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f30b03640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbdf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52820/0 (socket says 172.21.15.148:52820) 2024-09-21T01:14:35.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f30b03640 1 -- 172.21.15.148:0/3923463513 learned_addr learned my addr 172.21.15.148:0/3923463513 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:35.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.910+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/3923463513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 0x55f4edbce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.911+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3923463513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbec450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.911+0000 7f8f30b03640 1 -- 172.21.15.148:0/3923463513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 msgr2=0x55f4edbce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:35.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.911+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3923463513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 0x55f4edbce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.911+0000 7f8f30b03640 1 -- 172.21.15.148:0/3923463513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 msgr2=0x55f4edbec450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:35.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.911+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3923463513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbec450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.911+0000 7f8f30b03640 1 -- 172.21.15.148:0/3923463513 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4edbd2da0 con 0x55f4ed8001b0 2024-09-21T01:14:35.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.911+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3923463513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbdf040 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8f24004a10 tx=0x7f8f24022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a4dce316b3bc35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:35.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.911+0000 7f8f11ffb640 1 -- 172.21.15.148:0/3923463513 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24003f90 con 0x55f4ed8001b0 2024-09-21T01:14:35.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.911+0000 7f8f11ffb640 1 -- 172.21.15.148:0/3923463513 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f24005850 con 0x55f4ed8001b0 2024-09-21T01:14:35.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.911+0000 7f8f11ffb640 1 -- 172.21.15.148:0/3923463513 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400f8f0 con 0x55f4ed8001b0 2024-09-21T01:14:35.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.912+0000 7f8f38ada740 1 -- 172.21.15.148:0/3923463513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 msgr2=0x55f4edbdf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.913+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3923463513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbdf040 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8f24004a10 tx=0x7f8f24022000 comp rx=0 tx=0).stop 2024-09-21T01:14:35.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.913+0000 7f8f38ada740 1 -- 172.21.15.148:0/3923463513 shutdown_connections 2024-09-21T01:14:35.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.913+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3923463513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed829070 0x55f4edbec450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.913+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3923463513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed808390 0x55f4edbce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.913+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3923463513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed8001b0 0x55f4edbdf040 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.913+0000 7f8f38ada740 1 -- 172.21.15.148:0/3923463513 >> 172.21.15.148:0/3923463513 conn(0x55f4ed81d460 msgr2=0x55f4edbcdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:35.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.913+0000 7f8f38ada740 1 -- 172.21.15.148:0/3923463513 shutdown_connections 2024-09-21T01:14:35.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.913+0000 7f8f38ada740 1 -- 172.21.15.148:0/3923463513 wait complete. 2024-09-21T01:14:35.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.913+0000 7f8f38ada740 1 -- start start 2024-09-21T01:14:35.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.913+0000 7f8f38ada740 1 Processor -- start 2024-09-21T01:14:35.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed8001b0 0x55f4edbe8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbe4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f38ada740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed829070 0x55f4edbe4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f38ada740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1800cb30 con 0x55f4ed808390 2024-09-21T01:14:35.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbe4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f38ada740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1800dfa0 con 0x55f4ed8001b0 2024-09-21T01:14:35.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbe4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52826/0 (socket says 172.21.15.148:52826) 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f30b03640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed8001b0 0x55f4edbe8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f2b7fe640 1 -- 172.21.15.148:0/3326803055 learned_addr learned my addr 172.21.15.148:0/3326803055 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f38ada740 1 -- 172.21.15.148:0/3326803055 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1800d200 con 0x55f4ed829070 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.914+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed829070 0x55f4edbe4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f30b03640 1 -- 172.21.15.148:0/3326803055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed829070 msgr2=0x55f4edbe4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed829070 0x55f4edbe4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f30b03640 1 -- 172.21.15.148:0/3326803055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 msgr2=0x55f4edbe4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbe4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f30b03640 1 -- 172.21.15.148:0/3326803055 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4edbe4dd0 con 0x55f4ed8001b0 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbe4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f30b03640 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed8001b0 0x55f4edbe8c70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009270 tx=0x7f8f24013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b01127ee2c671696 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-09-21T01:14:35.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f38ada740 10 client.0 _ll_register_callbacks cb 0x7f8f20009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f38ada740 1 -- 172.21.15.148:0/3326803055 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f24005850 con 0x55f4ed8001b0 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.915+0000 7f8f0b7fe640 1 -- 172.21.15.148:0/3326803055 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2402d070 con 0x55f4ed8001b0 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f0b7fe640 1 -- 172.21.15.148:0/3326803055 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f8f240053a0 con 0x55f4ed8001b0 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f0b7fe640 1 -- 172.21.15.148:0/3326803055 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8f240046c0 con 0x55f4ed8001b0 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f38ada740 10 client.25124 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f38ada740 1 -- 172.21.15.148:0/3326803055 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55f4edbd73f0 con 0x55f4ed8001b0 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f0b7fe640 1 -- 172.21.15.148:0/3326803055 <== mon.2 v2:172.21.15.157:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8f24021040 con 0x55f4ed8001b0 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f38ada740 10 client.25124 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f38ada740 10 client.25124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f38ada740 20 client.25124 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f4ed7bcda0 0x55f4edbd99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f38ada740 4 client.25124 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.916+0000 7f8f38ada740 1 -- 172.21.15.148:0/3326803055 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f8f24005850 con 0x55f4ed7bcda0 2024-09-21T01:14:35.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.917+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f4ed7bcda0 0x55f4edbd99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.917+0000 7f8f0b7fe640 10 client.25124 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.917+0000 7f8f2b7fe640 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f4ed7bcda0 0x55f4edbd99c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e19291dfb507429f server_cookie=f7627e71e930b2d8 in_seq=0 out_seq=0 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.917+0000 7f8f0b7fe640 1 -- 172.21.15.148:0/3326803055 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7f8f24005850 con 0x55f4ed7bcda0 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.917+0000 7f8f0b7fe640 10 client.25124 handle_command_reply: tid=0 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.917+0000 7f8f38ada740 1 client.25124 shutdown 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 1 -- 172.21.15.148:0/3326803055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed8001b0 msgr2=0x55f4edbe8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed8001b0 0x55f4edbe8c70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009270 tx=0x7f8f24013040 comp rx=0 tx=0).stop 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 1 -- 172.21.15.148:0/3326803055 shutdown_connections 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55f4ed7bcda0 0x55f4edbd99c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4ed808390 0x55f4edbe4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f0b7fe640 0 client.25124 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4ed829070 0x55f4edbe4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 1 --2- 172.21.15.148:0/3326803055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f4ed8001b0 0x55f4edbe8c70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 1 -- 172.21.15.148:0/3326803055 >> 172.21.15.148:0/3326803055 conn(0x55f4ed81d460 msgr2=0x55f4edbe1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:35.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 1 -- 172.21.15.148:0/3326803055 shutdown_connections 2024-09-21T01:14:35.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 1 -- 172.21.15.148:0/3326803055 wait complete. 2024-09-21T01:14:35.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.918+0000 7f8f38ada740 20 client.25124 trim_cache size 0 max 16384 2024-09-21T01:14:35.922 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:14:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "no active scrubs running", 2024-09-21T01:14:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": {}, 2024-09-21T01:14:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_stats": { 2024-09-21T01:14:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "7bf59ed6-eedb-4a06-a813-d8af8d9118b7": { 2024-09-21T01:14:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:14:02.691995+0000", 2024-09-21T01:14:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:14:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:14:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:14:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:14:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:14:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:14:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:14:35.923 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:14:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 -- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8f140b65a0 msgr2=0x7f8f140b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8f140b65a0 0x7f8f140b8ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55f4edbcf2d0 tx=0x7f8f1c02a410 comp rx=0 tx=0).stop 2024-09-21T01:14:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 -- 172.21.15.148:0/2903074238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c102a60 msgr2=0x7f8f2c19a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c102a60 0x7f8f2c19a420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c005940 tx=0x7f8f1c0040c0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 -- 172.21.15.148:0/2903074238 shutdown_connections 2024-09-21T01:14:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8f140b65a0 0x7f8f140b8ab0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f2c1083a0 0x7f8f2c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f2c108cf0 0x7f8f2c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 --2- 172.21.15.148:0/2903074238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f2c102a60 0x7f8f2c19a420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 -- 172.21.15.148:0/2903074238 >> 172.21.15.148:0/2903074238 conn(0x7f8f2c079730 msgr2=0x7f8f2c101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:35.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 -- 172.21.15.148:0/2903074238 shutdown_connections 2024-09-21T01:14:35.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:35.919+0000 7f8f32566640 1 -- 172.21.15.148:0/2903074238 wait complete. 2024-09-21T01:14:36.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:36 smithi181 ceph-mon[34811]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:14:36.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:36 smithi157 ceph-mon[34140]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:14:36.492 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:36 smithi148 ceph-mon[31000]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:14:36.691 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:14:36.691 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:14:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:37.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.528+0000 7ff254143640 1 -- 172.21.15.148:0/3314716427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff24c103100 msgr2=0x7ff24c103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:37.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.528+0000 7ff254143640 1 --2- 172.21.15.148:0/3314716427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff24c103100 0x7ff24c103510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff248009900 tx=0x7ff24802a410 comp rx=0 tx=0).stop 2024-09-21T01:14:37.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.528+0000 7ff254143640 1 -- 172.21.15.148:0/3314716427 shutdown_connections 2024-09-21T01:14:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.528+0000 7ff254143640 1 --2- 172.21.15.148:0/3314716427 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff24c105ad0 0x7ff24c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.528+0000 7ff254143640 1 --2- 172.21.15.148:0/3314716427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff24c105180 0x7ff24c105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.528+0000 7ff254143640 1 --2- 172.21.15.148:0/3314716427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff24c103100 0x7ff24c103510 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.528+0000 7ff254143640 1 -- 172.21.15.148:0/3314716427 >> 172.21.15.148:0/3314716427 conn(0x7ff24c077c60 msgr2=0x7ff24c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.528+0000 7ff254143640 1 -- 172.21.15.148:0/3314716427 shutdown_connections 2024-09-21T01:14:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.529+0000 7ff254143640 1 -- 172.21.15.148:0/3314716427 wait complete. 2024-09-21T01:14:37.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.530+0000 7ff254143640 1 Processor -- start 2024-09-21T01:14:37.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.530+0000 7ff254143640 1 -- start start 2024-09-21T01:14:37.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.530+0000 7ff254143640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff24c103100 0x7ff24c19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:37.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.530+0000 7ff254143640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff24c105180 0x7ff24c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:37.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.530+0000 7ff254143640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff24c105ad0 0x7ff24c1a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:37.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.530+0000 7ff254143640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c1129a0 con 0x7ff24c105ad0 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.530+0000 7ff254143640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c112820 con 0x7ff24c105180 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.530+0000 7ff254143640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c112b20 con 0x7ff24c103100 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff251edf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff24c103100 0x7ff24c19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff251edf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff24c103100 0x7ff24c19c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:33686/0 (socket says 172.21.15.148:33686) 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff251edf640 1 -- 172.21.15.148:0/3491846478 learned_addr learned my addr 172.21.15.148:0/3491846478 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff2516de640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff24c105180 0x7ff24c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff2526e0640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff24c105ad0 0x7ff24c1a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff2526e0640 1 -- 172.21.15.148:0/3491846478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff24c103100 msgr2=0x7ff24c19c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff2526e0640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff24c103100 0x7ff24c19c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff2526e0640 1 -- 172.21.15.148:0/3491846478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff24c105180 msgr2=0x7ff24c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff2526e0640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff24c105180 0x7ff24c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff2526e0640 1 -- 172.21.15.148:0/3491846478 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24c1a2650 con 0x7ff24c105ad0 2024-09-21T01:14:37.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff2516de640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff24c105180 0x7ff24c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:37.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.531+0000 7ff2526e0640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff24c105ad0 0x7ff24c1a1f20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff24400e940 tx=0x7ff24400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:37.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.532+0000 7ff242ffd640 1 -- 172.21.15.148:0/3491846478 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244004d20 con 0x7ff24c105ad0 2024-09-21T01:14:37.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.532+0000 7ff242ffd640 1 -- 172.21.15.148:0/3491846478 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff244005020 con 0x7ff24c105ad0 2024-09-21T01:14:37.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.532+0000 7ff254143640 1 -- 172.21.15.148:0/3491846478 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24c1a2940 con 0x7ff24c105ad0 2024-09-21T01:14:37.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.532+0000 7ff254143640 1 -- 172.21.15.148:0/3491846478 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24c1a90a0 con 0x7ff24c105ad0 2024-09-21T01:14:37.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.532+0000 7ff242ffd640 1 -- 172.21.15.148:0/3491846478 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2440116d0 con 0x7ff24c105ad0 2024-09-21T01:14:37.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.533+0000 7ff254143640 1 -- 172.21.15.148:0/3491846478 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff24c103510 con 0x7ff24c105ad0 2024-09-21T01:14:37.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.536+0000 7ff242ffd640 1 -- 172.21.15.148:0/3491846478 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7ff244005460 con 0x7ff24c105ad0 2024-09-21T01:14:37.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.537+0000 7ff242ffd640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2380b66a0 0x7ff2380b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:37.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.537+0000 7ff242ffd640 1 -- 172.21.15.148:0/3491846478 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7ff2440e7840 con 0x7ff24c105ad0 2024-09-21T01:14:37.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.538+0000 7ff251edf640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2380b66a0 0x7ff2380b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:37.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.538+0000 7ff251edf640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2380b66a0 0x7ff2380b8bb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff2480096c0 tx=0x7ff2480058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:37.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.539+0000 7ff242ffd640 1 -- 172.21.15.148:0/3491846478 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff244016030 con 0x7ff24c105ad0 2024-09-21T01:14:37.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.764+0000 7ff254143640 1 -- 172.21.15.148:0/3491846478 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff24c1a93e0 con 0x7ff24c105ad0 2024-09-21T01:14:37.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.765+0000 7ff242ffd640 1 -- 172.21.15.148:0/3491846478 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11926 (secure 0 0 0) 0x7ff2440b2380 con 0x7ff24c105ad0 2024-09-21T01:14:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:14:37.767 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"btime":"2024-09-21T01:13:54:310474+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:13:54.159441+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24631,24646,24665]},"id":1}]} 2024-09-21T01:14:37.767 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-09-21T01:14:37.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.768+0000 7ff254143640 1 -- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2380b66a0 msgr2=0x7ff2380b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:37.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.768+0000 7ff254143640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2380b66a0 0x7ff2380b8bb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff2480096c0 tx=0x7ff2480058d0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.768+0000 7ff254143640 1 -- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff24c105ad0 msgr2=0x7ff24c1a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:37.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.768+0000 7ff254143640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff24c105ad0 0x7ff24c1a1f20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff24400e940 tx=0x7ff24400ee00 comp rx=0 tx=0).stop 2024-09-21T01:14:37.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.768+0000 7ff254143640 1 -- 172.21.15.148:0/3491846478 shutdown_connections 2024-09-21T01:14:37.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.768+0000 7ff254143640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7ff2380b66a0 0x7ff2380b8bb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.768+0000 7ff254143640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff24c105ad0 0x7ff24c1a1f20 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.768+0000 7ff254143640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff24c105180 0x7ff24c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.768+0000 7ff254143640 1 --2- 172.21.15.148:0/3491846478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff24c103100 0x7ff24c19c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.768+0000 7ff254143640 1 -- 172.21.15.148:0/3491846478 >> 172.21.15.148:0/3491846478 conn(0x7ff24c077c60 msgr2=0x7ff24c106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:37.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.769+0000 7ff254143640 1 -- 172.21.15.148:0/3491846478 shutdown_connections 2024-09-21T01:14:37.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:37.769+0000 7ff254143640 1 -- 172.21.15.148:0/3491846478 wait complete. 2024-09-21T01:14:38.405 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:38 smithi148 ceph-mon[31000]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T01:14:38.405 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:38 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3491846478' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:14:38.446 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:14:38.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:38 smithi181 ceph-mon[34811]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T01:14:38.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:38 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3491846478' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:14:38.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:38 smithi157 ceph-mon[34140]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T01:14:38.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:38 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3491846478' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:14:38.808 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:39.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.350+0000 7efc7f940640 1 -- 172.21.15.148:0/2743580196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc78103bc0 msgr2=0x7efc78103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.350+0000 7efc7f940640 1 --2- 172.21.15.148:0/2743580196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc78103bc0 0x7efc78103fd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efc74009900 tx=0x7efc7402a410 comp rx=0 tx=0).stop 2024-09-21T01:14:39.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.350+0000 7efc7f940640 1 -- 172.21.15.148:0/2743580196 shutdown_connections 2024-09-21T01:14:39.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.350+0000 7efc7f940640 1 --2- 172.21.15.148:0/2743580196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc78109e00 0x7efc78110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.350+0000 7efc7f940640 1 --2- 172.21.15.148:0/2743580196 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc781094b0 0x7efc781098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.350+0000 7efc7f940640 1 --2- 172.21.15.148:0/2743580196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc78103bc0 0x7efc78103fd0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.350+0000 7efc7f940640 1 -- 172.21.15.148:0/2743580196 >> 172.21.15.148:0/2743580196 conn(0x7efc7807b910 msgr2=0x7efc7807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:39.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.350+0000 7efc7f940640 1 -- 172.21.15.148:0/2743580196 shutdown_connections 2024-09-21T01:14:39.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.351+0000 7efc7f940640 1 -- 172.21.15.148:0/2743580196 wait complete. 2024-09-21T01:14:39.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.352+0000 7efc7f940640 1 Processor -- start 2024-09-21T01:14:39.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.352+0000 7efc7f940640 1 -- start start 2024-09-21T01:14:39.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.353+0000 7efc7f940640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc78103bc0 0x7efc7819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.353+0000 7efc7f940640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc781094b0 0x7efc7819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.353+0000 7efc7d6dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc78103bc0 0x7efc7819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.353+0000 7efc7d6dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc78103bc0 0x7efc7819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57418/0 (socket says 172.21.15.148:57418) 2024-09-21T01:14:39.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.353+0000 7efc7d6dc640 1 -- 172.21.15.148:0/3553728677 learned_addr learned my addr 172.21.15.148:0/3553728677 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:39.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.353+0000 7efc7f940640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc78109e00 0x7efc7819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.353+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efc78113b10 con 0x7efc78103bc0 2024-09-21T01:14:39.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.353+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efc78113990 con 0x7efc781094b0 2024-09-21T01:14:39.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.353+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efc78113c90 con 0x7efc78109e00 2024-09-21T01:14:39.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.353+0000 7efc7cedb640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc781094b0 0x7efc7819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc7dedd640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc78109e00 0x7efc7819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc7cedb640 1 -- 172.21.15.148:0/3553728677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc78109e00 msgr2=0x7efc7819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc7cedb640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc78109e00 0x7efc7819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc7cedb640 1 -- 172.21.15.148:0/3553728677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc78103bc0 msgr2=0x7efc7819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc7cedb640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc78103bc0 0x7efc7819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc7cedb640 1 -- 172.21.15.148:0/3553728677 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc781a0490 con 0x7efc781094b0 2024-09-21T01:14:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc78103bc0 0x7efc7819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc7cedb640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc781094b0 0x7efc7819aac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc68005fd0 tx=0x7efc6800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc6e7fc640 1 -- 172.21.15.148:0/3553728677 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68009c00 con 0x7efc781094b0 2024-09-21T01:14:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc6e7fc640 1 -- 172.21.15.148:0/3553728677 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc68009da0 con 0x7efc781094b0 2024-09-21T01:14:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.354+0000 7efc6e7fc640 1 -- 172.21.15.148:0/3553728677 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68003e20 con 0x7efc781094b0 2024-09-21T01:14:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.355+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc781a0780 con 0x7efc781094b0 2024-09-21T01:14:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.355+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc780755f0 con 0x7efc781094b0 2024-09-21T01:14:39.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.358+0000 7efc6e7fc640 1 -- 172.21.15.148:0/3553728677 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7efc680035f0 con 0x7efc781094b0 2024-09-21T01:14:39.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.359+0000 7efc6e7fc640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efc640baa30 0x7efc640bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.359+0000 7efc85eb4740 1 Processor -- start 2024-09-21T01:14:39.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.359+0000 7efc6e7fc640 1 -- 172.21.15.148:0/3553728677 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7efc680e6df0 con 0x7efc781094b0 2024-09-21T01:14:39.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.360+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efc640baa30 0x7efc640bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.359+0000 7efc85eb4740 1 -- start start 2024-09-21T01:14:39.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.360+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856afb7070 0x55856b35e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.360+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856af8e1b0 0x55856b35ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.360+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b35f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.360+0000 7efc85eb4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55856b2d4ea0 con 0x55856af96390 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.360+0000 7efc85eb4740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55856b2c42d0 con 0x55856af8e1b0 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.360+0000 7efc85eb4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55856b2c80e0 con 0x55856afb7070 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7dedd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b35f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7dedd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b35f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57428/0 (socket says 172.21.15.148:57428) 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7dedd640 1 -- 172.21.15.148:0/507384575 learned_addr learned my addr 172.21.15.148:0/507384575 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7cedb640 1 --2- 172.21.15.148:0/507384575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856af8e1b0 0x55856b35ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efc640baa30 0x7efc640bcf40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efc740096c0 tx=0x7efc74005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/507384575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856afb7070 0x55856b35e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7dedd640 1 -- 172.21.15.148:0/507384575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856afb7070 msgr2=0x55856b35e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7dedd640 1 --2- 172.21.15.148:0/507384575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856afb7070 0x55856b35e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7dedd640 1 -- 172.21.15.148:0/507384575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856af8e1b0 msgr2=0x55856b35ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:39.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7dedd640 1 --2- 172.21.15.148:0/507384575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856af8e1b0 0x55856b35ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7dedd640 1 -- 172.21.15.148:0/507384575 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856b022650 con 0x55856af96390 2024-09-21T01:14:39.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7cedb640 1 --2- 172.21.15.148:0/507384575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856af8e1b0 0x55856b35ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:39.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.361+0000 7efc7dedd640 1 --2- 172.21.15.148:0/507384575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b35f120 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efc70009fa0 tx=0x7efc70010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93dcb638af3700d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:39.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.362+0000 7efc637fe640 1 -- 172.21.15.148:0/507384575 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70016070 con 0x55856af96390 2024-09-21T01:14:39.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.362+0000 7efc637fe640 1 -- 172.21.15.148:0/507384575 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc70004d20 con 0x55856af96390 2024-09-21T01:14:39.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.362+0000 7efc637fe640 1 -- 172.21.15.148:0/507384575 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70012850 con 0x55856af96390 2024-09-21T01:14:39.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.363+0000 7efc85eb4740 1 -- 172.21.15.148:0/507384575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 msgr2=0x55856b35f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.363+0000 7efc85eb4740 1 --2- 172.21.15.148:0/507384575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b35f120 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efc70009fa0 tx=0x7efc70010800 comp rx=0 tx=0).stop 2024-09-21T01:14:39.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.363+0000 7efc85eb4740 1 -- 172.21.15.148:0/507384575 shutdown_connections 2024-09-21T01:14:39.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.363+0000 7efc85eb4740 1 --2- 172.21.15.148:0/507384575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b35f120 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.363+0000 7efc85eb4740 1 --2- 172.21.15.148:0/507384575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856af8e1b0 0x55856b35ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.363+0000 7efc85eb4740 1 --2- 172.21.15.148:0/507384575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856afb7070 0x55856b35e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.363+0000 7efc85eb4740 1 -- 172.21.15.148:0/507384575 >> 172.21.15.148:0/507384575 conn(0x55856afab460 msgr2=0x55856b35c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:39.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.363+0000 7efc85eb4740 1 -- 172.21.15.148:0/507384575 shutdown_connections 2024-09-21T01:14:39.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.363+0000 7efc85eb4740 1 -- 172.21.15.148:0/507384575 wait complete. 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.364+0000 7efc85eb4740 1 -- start start 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.364+0000 7efc85eb4740 1 Processor -- start 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.364+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af8e1b0 0x55856b372530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.364+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b372a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 0x55856b37e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc85eb4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55856b125700 con 0x55856af96390 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc85eb4740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55856b25f160 con 0x55856afb7070 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc85eb4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55856b3755b0 con 0x55856af8e1b0 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc85eb4740 10 client.0 _ll_register_callbacks cb 0x55856b2789e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7dedd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 0x55856b37e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7dedd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 0x55856b37e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:53626/0 (socket says 172.21.15.148:53626) 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7dedd640 1 -- 172.21.15.148:0/3679953284 learned_addr learned my addr 172.21.15.148:0/3679953284 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:39.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af8e1b0 0x55856b372530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7cedb640 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b372a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7cedb640 1 -- 172.21.15.148:0/3679953284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af8e1b0 msgr2=0x55856b372530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7cedb640 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af8e1b0 0x55856b372530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7cedb640 1 -- 172.21.15.148:0/3679953284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 msgr2=0x55856b37e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7cedb640 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 0x55856b37e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7cedb640 1 -- 172.21.15.148:0/3679953284 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55856b28cc90 con 0x55856af96390 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.365+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af8e1b0 0x55856b372530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.366+0000 7efc7dedd640 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 0x55856b37e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.366+0000 7efc7cedb640 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b372a70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efc680e4790 tx=0x7efc680ac760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4fba725975e4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.366+0000 7efc60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.366+0000 7efc60ff9640 1 -- 172.21.15.148:0/3679953284 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68020040 con 0x55856af96390 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.366+0000 7efc60ff9640 1 -- 172.21.15.148:0/3679953284 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7efc680a8810 con 0x55856af96390 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.366+0000 7efc85eb4740 1 -- 172.21.15.148:0/3679953284 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc70004d20 con 0x55856af96390 2024-09-21T01:14:39.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.366+0000 7efc60ff9640 1 -- 172.21.15.148:0/3679953284 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc680b6830 con 0x55856af96390 2024-09-21T01:14:39.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.366+0000 7efc85eb4740 10 client.15501 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:39.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.366+0000 7efc85eb4740 1 -- 172.21.15.148:0/3679953284 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55856b3812c0 con 0x55856af96390 2024-09-21T01:14:39.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.366+0000 7efc60ff9640 1 -- 172.21.15.148:0/3679953284 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc70004d20 con 0x55856af96390 2024-09-21T01:14:39.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.367+0000 7efc60ff9640 1 -- 172.21.15.148:0/3679953284 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efc68092ce0 con 0x55856af96390 2024-09-21T01:14:39.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.367+0000 7efc85eb4740 10 client.15501 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:39.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.367+0000 7efc85eb4740 10 client.15501 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:14:39.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.367+0000 7efc85eb4740 20 client.15501 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:39.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.367+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55856af759f0 0x55856b3847e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.367+0000 7efc85eb4740 4 client.15501 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:39.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.367+0000 7efc85eb4740 1 -- 172.21.15.148:0/3679953284 --> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55856b2d6df0 con 0x55856af759f0 2024-09-21T01:14:39.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.367+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55856af759f0 0x55856b3847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.368+0000 7efc60ff9640 10 client.15501 ms_handle_connect on v2:172.21.15.181:6836/3446561094 2024-09-21T01:14:39.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.368+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55856af759f0 0x55856b3847e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5505aea3fc03c537 server_cookie=25b5ca46ed0f779 in_seq=0 out_seq=0 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc60ff9640 1 -- 172.21.15.148:0/3679953284 <== mds.2 v2:172.21.15.181:6836/3446561094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55856b2d6df0 con 0x55856af759f0 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc60ff9640 10 client.15501 handle_command_reply: tid=0 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc85eb4740 1 client.15501 shutdown 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc85eb4740 1 -- 172.21.15.148:0/3679953284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 msgr2=0x55856b372a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b372a70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efc680e4790 tx=0x7efc680ac760 comp rx=0 tx=0).stop 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc85eb4740 1 -- 172.21.15.148:0/3679953284 shutdown_connections 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55856af759f0 0x55856b3847e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af96390 0x55856b372a70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 0x55856b37e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3679953284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af8e1b0 0x55856b372530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc60ff9640 0 client.15501 ms_handle_reset on v2:172.21.15.181:6836/3446561094 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.369+0000 7efc85eb4740 1 -- 172.21.15.148:0/3679953284 >> 172.21.15.148:0/3679953284 conn(0x55856afab460 msgr2=0x55856b361830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.370+0000 7efc85eb4740 1 -- 172.21.15.148:0/3679953284 shutdown_connections 2024-09-21T01:14:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.370+0000 7efc85eb4740 1 -- 172.21.15.148:0/3679953284 wait complete. 2024-09-21T01:14:39.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.370+0000 7efc85eb4740 20 client.15501 trim_cache size 0 max 16384 2024-09-21T01:14:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.395+0000 7efc85eb4740 1 Processor -- start 2024-09-21T01:14:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.395+0000 7efc85eb4740 1 -- start start 2024-09-21T01:14:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.395+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af759f0 0x55856b374410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.395+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af8e1b0 0x55856b35fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856af96390 0x55856b37e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc7cedb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af8e1b0 0x55856b35fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc7cedb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af8e1b0 0x55856b35fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57446/0 (socket says 172.21.15.148:57446) 2024-09-21T01:14:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc7cedb640 1 -- 172.21.15.148:0/133316163 learned_addr learned my addr 172.21.15.148:0/133316163 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc85eb4740 1 -- 172.21.15.148:0/133316163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efc781afad0 con 0x55856af8e1b0 2024-09-21T01:14:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc85eb4740 1 -- 172.21.15.148:0/133316163 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efc781ad3a0 con 0x55856af96390 2024-09-21T01:14:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc85eb4740 1 -- 172.21.15.148:0/133316163 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efc781ab1f0 con 0x55856af759f0 2024-09-21T01:14:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc7cedb640 1 -- 172.21.15.148:0/133316163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af759f0 msgr2=0x55856b374410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/133316163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af759f0 0x55856b374410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc7cedb640 1 --2- 172.21.15.148:0/133316163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af759f0 0x55856b374410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc7cedb640 1 -- 172.21.15.148:0/133316163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856af96390 msgr2=0x55856b37e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc7cedb640 1 --2- 172.21.15.148:0/133316163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856af96390 0x55856b37e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc7cedb640 1 -- 172.21.15.148:0/133316163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856b372db0 con 0x55856af8e1b0 2024-09-21T01:14:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.396+0000 7efc7cedb640 1 --2- 172.21.15.148:0/133316163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af8e1b0 0x55856b35fde0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efc680b69f0 tx=0x7efc680b1a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93b571b88bd5dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.397+0000 7efc62ffd640 1 -- 172.21.15.148:0/133316163 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68020070 con 0x55856af8e1b0 2024-09-21T01:14:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.397+0000 7efc62ffd640 1 -- 172.21.15.148:0/133316163 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc68098280 con 0x55856af8e1b0 2024-09-21T01:14:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.397+0000 7efc62ffd640 1 -- 172.21.15.148:0/133316163 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc680b2dd0 con 0x55856af8e1b0 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.398+0000 7efc85eb4740 1 -- 172.21.15.148:0/133316163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af8e1b0 msgr2=0x55856b35fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.398+0000 7efc85eb4740 1 --2- 172.21.15.148:0/133316163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af8e1b0 0x55856b35fde0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efc680b69f0 tx=0x7efc680b1a70 comp rx=0 tx=0).stop 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.398+0000 7efc85eb4740 1 -- 172.21.15.148:0/133316163 shutdown_connections 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.398+0000 7efc85eb4740 1 --2- 172.21.15.148:0/133316163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af8e1b0 0x55856b35fde0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.398+0000 7efc85eb4740 1 --2- 172.21.15.148:0/133316163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856af96390 0x55856b37e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.398+0000 7efc85eb4740 1 --2- 172.21.15.148:0/133316163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af759f0 0x55856b374410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.398+0000 7efc85eb4740 1 -- 172.21.15.148:0/133316163 >> 172.21.15.148:0/133316163 conn(0x55856afab460 msgr2=0x55856b35f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.398+0000 7efc85eb4740 1 -- 172.21.15.148:0/133316163 shutdown_connections 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.398+0000 7efc85eb4740 1 -- 172.21.15.148:0/133316163 wait complete. 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.399+0000 7efc85eb4740 1 -- start start 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.399+0000 7efc85eb4740 1 Processor -- start 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.399+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af759f0 0x55856b3768f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.399+0000 7efc85eb4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af96390 0x55856b376e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc7d6dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af759f0 0x55856b3768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc7d6dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af759f0 0x55856b3768f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57452/0 (socket says 172.21.15.148:57452) 2024-09-21T01:14:39.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc7d6dc640 1 -- 172.21.15.148:0/3787707265 learned_addr learned my addr 172.21.15.148:0/3787707265 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:39.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 0x55856b377370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efc781ab860 con 0x55856af759f0 2024-09-21T01:14:39.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efc781accd0 con 0x55856afb7070 2024-09-21T01:14:39.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efc781abf30 con 0x55856af96390 2024-09-21T01:14:39.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc85eb4740 10 client.0 _ll_register_callbacks cb 0x7efc680acc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:39.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc7dedd640 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 0x55856b377370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc7d6dc640 1 -- 172.21.15.148:0/3787707265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af96390 msgr2=0x55856b376e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:39.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af96390 0x55856b376e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc7d6dc640 1 -- 172.21.15.148:0/3787707265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 msgr2=0x55856b377370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:39.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 0x55856b377370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.400+0000 7efc7d6dc640 1 -- 172.21.15.148:0/3787707265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55856b3ee270 con 0x55856af759f0 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.401+0000 7efc7d6dc640 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af759f0 0x55856b3768f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efc7402aa00 tx=0x7efc74009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45405a6d72e179c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.401+0000 7efc60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.401+0000 7efc60ff9640 1 -- 172.21.15.148:0/3787707265 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74035040 con 0x55856af759f0 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.401+0000 7efc60ff9640 1 -- 172.21.15.148:0/3787707265 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7efc74031770 con 0x55856af759f0 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.401+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55856b36e0e0 con 0x55856af759f0 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.401+0000 7efc60ff9640 1 -- 172.21.15.148:0/3787707265 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc74031970 con 0x55856af759f0 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.401+0000 7efc85eb4740 10 client.15507 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.401+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55856b3ef530 con 0x55856af759f0 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.402+0000 7efc60ff9640 1 -- 172.21.15.148:0/3787707265 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc74062030 con 0x55856af759f0 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.402+0000 7efc60ff9640 1 -- 172.21.15.148:0/3787707265 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efc7403cbd0 con 0x55856af759f0 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.402+0000 7efc85eb4740 10 client.15507 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.402+0000 7efc85eb4740 10 client.15507 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:14:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.402+0000 7efc85eb4740 20 client.15507 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.402+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55856af4ada0 0x55856b3f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.402+0000 7efc85eb4740 4 client.15507 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:14:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.402+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 --> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55856b36e0e0 con 0x55856af4ada0 2024-09-21T01:14:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.402+0000 7efc7cedb640 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55856af4ada0 0x55856b3f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc60ff9640 10 client.15507 ms_handle_connect on v2:172.21.15.181:6836/3446561094 2024-09-21T01:14:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc7cedb640 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55856af4ada0 0x55856b3f1cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a51c39dbabc6c280 server_cookie=8d0f74b4af3275e9 in_seq=0 out_seq=0 2024-09-21T01:14:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc60ff9640 1 -- 172.21.15.148:0/3787707265 <== mds.2 v2:172.21.15.181:6836/3446561094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55856b36e0e0 con 0x55856af4ada0 2024-09-21T01:14:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc60ff9640 10 client.15507 handle_command_reply: tid=0 2024-09-21T01:14:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc85eb4740 1 client.15507 shutdown 2024-09-21T01:14:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af759f0 msgr2=0x55856b3768f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af759f0 0x55856b3768f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efc7402aa00 tx=0x7efc74009260 comp rx=0 tx=0).stop 2024-09-21T01:14:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 shutdown_connections 2024-09-21T01:14:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x55856af4ada0 0x55856b3f1cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc60ff9640 0 client.15507 ms_handle_reset on v2:172.21.15.181:6836/3446561094 2024-09-21T01:14:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55856afb7070 0x55856b377370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55856af96390 0x55856b376e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc85eb4740 1 --2- 172.21.15.148:0/3787707265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55856af759f0 0x55856b3768f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.403+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 >> 172.21.15.148:0/3787707265 conn(0x55856afab460 msgr2=0x55856b35fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 shutdown_connections 2024-09-21T01:14:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc85eb4740 1 -- 172.21.15.148:0/3787707265 wait complete. 2024-09-21T01:14:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc85eb4740 20 client.15507 trim_cache size 0 max 16384 2024-09-21T01:14:39.407 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-21T01:14:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efc640baa30 msgr2=0x7efc640bcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efc640baa30 0x7efc640bcf40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efc740096c0 tx=0x7efc74005a20 comp rx=0 tx=0).stop 2024-09-21T01:14:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc781094b0 msgr2=0x7efc7819aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc781094b0 0x7efc7819aac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc68005fd0 tx=0x7efc6800dde0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 shutdown_connections 2024-09-21T01:14:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efc640baa30 0x7efc640bcf40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc78109e00 0x7efc7819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc781094b0 0x7efc7819aac0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 --2- 172.21.15.148:0/3553728677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc78103bc0 0x7efc7819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 >> 172.21.15.148:0/3553728677 conn(0x7efc7807b910 msgr2=0x7efc78107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.404+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 shutdown_connections 2024-09-21T01:14:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:39.405+0000 7efc7f940640 1 -- 172.21.15.148:0/3553728677 wait complete. 2024-09-21T01:14:40.078 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:14:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:40.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:40 smithi148 ceph-mon[31000]: pgmap v358: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:14:40.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:40 smithi181 ceph-mon[34811]: pgmap v358: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:14:40.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:40 smithi157 ceph-mon[34140]: pgmap v358: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:14:40.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.855+0000 7fed3e18c640 1 -- 172.21.15.148:0/76148555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed381049b0 msgr2=0x7fed38104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.855+0000 7fed3e18c640 1 --2- 172.21.15.148:0/76148555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed381049b0 0x7fed38104dc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fed28009900 tx=0x7fed2802a410 comp rx=0 tx=0).stop 2024-09-21T01:14:40.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.855+0000 7fed3e18c640 1 -- 172.21.15.148:0/76148555 shutdown_connections 2024-09-21T01:14:40.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.855+0000 7fed3e18c640 1 --2- 172.21.15.148:0/76148555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed3810de10 0x7fed38110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.855+0000 7fed3e18c640 1 --2- 172.21.15.148:0/76148555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed38105300 0x7fed3810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.855+0000 7fed3e18c640 1 --2- 172.21.15.148:0/76148555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed381049b0 0x7fed38104dc0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.855+0000 7fed3e18c640 1 -- 172.21.15.148:0/76148555 >> 172.21.15.148:0/76148555 conn(0x7fed38079730 msgr2=0x7fed38079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:40.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.855+0000 7fed3e18c640 1 -- 172.21.15.148:0/76148555 shutdown_connections 2024-09-21T01:14:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.855+0000 7fed3e18c640 1 -- 172.21.15.148:0/76148555 wait complete. 2024-09-21T01:14:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.856+0000 7fed3e18c640 1 Processor -- start 2024-09-21T01:14:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed3e18c640 1 -- start start 2024-09-21T01:14:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed3e18c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed381049b0 0x7fed3819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed3e18c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed38105300 0x7fed3819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed3e18c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed3810de10 0x7fed3819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed3e18c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fed38113a70 con 0x7fed381049b0 2024-09-21T01:14:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed3e18c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fed381138f0 con 0x7fed38105300 2024-09-21T01:14:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed3e18c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed38113bf0 con 0x7fed3810de10 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed37fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed3810de10 0x7fed3819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed37fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed3810de10 0x7fed3819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:33752/0 (socket says 172.21.15.148:33752) 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed37fff640 1 -- 172.21.15.148:0/4084147275 learned_addr learned my addr 172.21.15.148:0/4084147275 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed36ffd640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed38105300 0x7fed3819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.857+0000 7fed377fe640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed381049b0 0x7fed3819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.858+0000 7fed37fff640 1 -- 172.21.15.148:0/4084147275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed38105300 msgr2=0x7fed3819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.858+0000 7fed37fff640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed38105300 0x7fed3819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.858+0000 7fed37fff640 1 -- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed381049b0 msgr2=0x7fed3819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.858+0000 7fed37fff640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed381049b0 0x7fed3819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.858+0000 7fed37fff640 1 -- 172.21.15.148:0/4084147275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed381a04b0 con 0x7fed3810de10 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.858+0000 7fed377fe640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed381049b0 0x7fed3819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.858+0000 7fed37fff640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed3810de10 0x7fed3819fd80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed3000eb10 tx=0x7fed3000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.858+0000 7fed34ff9640 1 -- 172.21.15.148:0/4084147275 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30004b20 con 0x7fed3810de10 2024-09-21T01:14:40.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.858+0000 7fed3e18c640 1 -- 172.21.15.148:0/4084147275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed381a07a0 con 0x7fed3810de10 2024-09-21T01:14:40.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.858+0000 7fed3e18c640 1 -- 172.21.15.148:0/4084147275 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed381a6f00 con 0x7fed3810de10 2024-09-21T01:14:40.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.859+0000 7fed34ff9640 1 -- 172.21.15.148:0/4084147275 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed30004cc0 con 0x7fed3810de10 2024-09-21T01:14:40.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.859+0000 7fed34ff9640 1 -- 172.21.15.148:0/4084147275 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30010670 con 0x7fed3810de10 2024-09-21T01:14:40.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.861+0000 7fed44700740 1 Processor -- start 2024-09-21T01:14:40.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.862+0000 7fed34ff9640 1 -- 172.21.15.148:0/4084147275 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7fed30005020 con 0x7fed3810de10 2024-09-21T01:14:40.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.862+0000 7fed44700740 1 -- start start 2024-09-21T01:14:40.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed44700740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a4334e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed44700740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f7e1b0 0x556a4334ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed44700740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f86390 0x556a4334f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed44700740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556a432c4ea0 con 0x556a42fa7070 2024-09-21T01:14:40.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed44700740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x556a432b42d0 con 0x556a42f7e1b0 2024-09-21T01:14:40.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed44700740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556a432b80e0 con 0x556a42f86390 2024-09-21T01:14:40.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed36ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a4334e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed36ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a4334e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57486/0 (socket says 172.21.15.148:57486) 2024-09-21T01:14:40.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed36ffd640 1 -- 172.21.15.148:0/831234854 learned_addr learned my addr 172.21.15.148:0/831234854 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:40.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed34ff9640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed200b6620 0x7fed200b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed377fe640 1 --2- 172.21.15.148:0/831234854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f7e1b0 0x556a4334ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed34ff9640 1 -- 172.21.15.148:0/4084147275 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fed300e78a0 con 0x7fed3810de10 2024-09-21T01:14:40.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed36ffd640 1 -- 172.21.15.148:0/831234854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f86390 msgr2=0x556a4334f120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:14:40.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.863+0000 7fed36ffd640 1 --2- 172.21.15.148:0/831234854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f86390 0x556a4334f120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.864+0000 7fed36ffd640 1 -- 172.21.15.148:0/831234854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f7e1b0 msgr2=0x556a4334ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:40.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.864+0000 7fed36ffd640 1 --2- 172.21.15.148:0/831234854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f7e1b0 0x556a4334ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.864+0000 7fed36ffd640 1 -- 172.21.15.148:0/831234854 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a43012650 con 0x556a42fa7070 2024-09-21T01:14:40.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.864+0000 7fed377fe640 1 --2- 172.21.15.148:0/831234854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f7e1b0 0x556a4334ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:40.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.864+0000 7fed36ffd640 1 --2- 172.21.15.148:0/831234854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a4334e6a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00bc00 tx=0x7fed2c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facb0cf3e6566deb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:40.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.864+0000 7fed37fff640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed200b6620 0x7fed200b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.864+0000 7fed1dffb640 1 -- 172.21.15.148:0/831234854 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c004020 con 0x556a42fa7070 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.864+0000 7fed1dffb640 1 -- 172.21.15.148:0/831234854 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed2c0041c0 con 0x556a42fa7070 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.864+0000 7fed1dffb640 1 -- 172.21.15.148:0/831234854 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c011680 con 0x556a42fa7070 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed37fff640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed200b6620 0x7fed200b8b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fed300049d0 tx=0x7fed30009200 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed44700740 1 -- 172.21.15.148:0/831234854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 msgr2=0x556a4334e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed44700740 1 --2- 172.21.15.148:0/831234854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a4334e6a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00bc00 tx=0x7fed2c0107a0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed44700740 1 -- 172.21.15.148:0/831234854 shutdown_connections 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed44700740 1 --2- 172.21.15.148:0/831234854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f86390 0x556a4334f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed44700740 1 --2- 172.21.15.148:0/831234854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f7e1b0 0x556a4334ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed44700740 1 --2- 172.21.15.148:0/831234854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a4334e6a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed44700740 1 -- 172.21.15.148:0/831234854 >> 172.21.15.148:0/831234854 conn(0x556a42f9b460 msgr2=0x556a4334c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed44700740 1 -- 172.21.15.148:0/831234854 shutdown_connections 2024-09-21T01:14:40.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed44700740 1 -- 172.21.15.148:0/831234854 wait complete. 2024-09-21T01:14:40.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.866+0000 7fed44700740 1 -- start start 2024-09-21T01:14:40.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed44700740 1 Processor -- start 2024-09-21T01:14:40.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed44700740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f7e1b0 0x556a43362eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed44700740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f86390 0x556a43363490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed44700740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a433684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed44700740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556a43115700 con 0x556a42fa7070 2024-09-21T01:14:40.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed44700740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x556a4324f160 con 0x556a42f86390 2024-09-21T01:14:40.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed44700740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556a43361290 con 0x556a42f7e1b0 2024-09-21T01:14:40.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed36ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a433684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed36ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a433684b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57500/0 (socket says 172.21.15.148:57500) 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed36ffd640 1 -- 172.21.15.148:0/879599505 learned_addr learned my addr 172.21.15.148:0/879599505 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.867+0000 7fed44700740 10 client.0 _ll_register_callbacks cb 0x556a432689e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed377fe640 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f86390 0x556a43363490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed36ffd640 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f7e1b0 0x556a43362eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed36ffd640 1 -- 172.21.15.148:0/879599505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f7e1b0 msgr2=0x556a43362eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed36ffd640 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f7e1b0 0x556a43362eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed36ffd640 1 -- 172.21.15.148:0/879599505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f86390 msgr2=0x556a43363490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed36ffd640 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f86390 0x556a43363490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed36ffd640 1 -- 172.21.15.148:0/879599505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a4327cc90 con 0x556a42fa7070 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed36ffd640 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a433684b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00ba40 tx=0x7fed2c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267172f02a9cb41b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed16ffd640 1 -- 172.21.15.148:0/879599505 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0035f0 con 0x556a42fa7070 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed16ffd640 1 -- 172.21.15.148:0/879599505 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fed2c003790 con 0x556a42fa7070 2024-09-21T01:14:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.868+0000 7fed44700740 1 -- 172.21.15.148:0/879599505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed2c0041c0 con 0x556a42fa7070 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed16ffd640 1 -- 172.21.15.148:0/879599505 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fed2c003990 con 0x556a42fa7070 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed44700740 10 client.15519 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed44700740 1 -- 172.21.15.148:0/879599505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556a43371400 con 0x556a42fa7070 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed16ffd640 1 -- 172.21.15.148:0/879599505 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed2c0054e0 con 0x556a42fa7070 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed16ffd640 1 -- 172.21.15.148:0/879599505 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fed2c026070 con 0x556a42fa7070 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed44700740 10 client.15519 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed44700740 10 client.15519 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed44700740 20 client.15519 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed44700740 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x556a42f659f0 0x556a433747c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed44700740 4 client.15519 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.869+0000 7fed44700740 1 -- 172.21.15.148:0/879599505 --> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fed2c0041c0 con 0x556a42f659f0 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.870+0000 7fed377fe640 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x556a42f659f0 0x556a433747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.870+0000 7fed16ffd640 10 client.15519 ms_handle_connect on v2:172.21.15.181:6838/2036386246 2024-09-21T01:14:40.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.871+0000 7fed377fe640 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x556a42f659f0 0x556a433747c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f5f83d83217ffe server_cookie=afcc4ab45b4ab731 in_seq=0 out_seq=0 2024-09-21T01:14:40.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed16ffd640 1 -- 172.21.15.148:0/879599505 <== mds.1 v2:172.21.15.181:6838/2036386246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fed2c0041c0 con 0x556a42f659f0 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed16ffd640 10 client.15519 handle_command_reply: tid=0 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 client.15519 shutdown 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 -- 172.21.15.148:0/879599505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 msgr2=0x556a433684b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a433684b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00ba40 tx=0x7fed2c013040 comp rx=0 tx=0).stop 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 -- 172.21.15.148:0/879599505 shutdown_connections 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x556a42f659f0 0x556a433747c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42fa7070 0x556a433684b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f86390 0x556a43363490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed16ffd640 0 client.15519 ms_handle_reset on v2:172.21.15.181:6838/2036386246 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 --2- 172.21.15.148:0/879599505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f7e1b0 0x556a43362eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 -- 172.21.15.148:0/879599505 >> 172.21.15.148:0/879599505 conn(0x556a42f9b460 msgr2=0x556a43351830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 -- 172.21.15.148:0/879599505 shutdown_connections 2024-09-21T01:14:40.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.872+0000 7fed44700740 1 -- 172.21.15.148:0/879599505 wait complete. 2024-09-21T01:14:40.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.873+0000 7fed44700740 20 client.15519 trim_cache size 0 max 16384 2024-09-21T01:14:40.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed44700740 1 Processor -- start 2024-09-21T01:14:40.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed44700740 1 -- start start 2024-09-21T01:14:40.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed44700740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f659f0 0x556a43361c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed44700740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4335f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed44700740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f86390 0x556a4335ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed44700740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fed24010cd0 con 0x556a42f7e1b0 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed44700740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fed2400e5a0 con 0x556a42f86390 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed44700740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed2400c3f0 con 0x556a42f659f0 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed377fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4335f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed377fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4335f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57504/0 (socket says 172.21.15.148:57504) 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.886+0000 7fed377fe640 1 -- 172.21.15.148:0/1336833097 learned_addr learned my addr 172.21.15.148:0/1336833097 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.887+0000 7fed377fe640 1 -- 172.21.15.148:0/1336833097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f659f0 msgr2=0x556a43361c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.887+0000 7fed377fe640 1 --2- 172.21.15.148:0/1336833097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f659f0 0x556a43361c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.887+0000 7fed377fe640 1 -- 172.21.15.148:0/1336833097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f86390 msgr2=0x556a4335ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.887+0000 7fed377fe640 1 --2- 172.21.15.148:0/1336833097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f86390 0x556a4335ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.887+0000 7fed377fe640 1 -- 172.21.15.148:0/1336833097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4335e130 con 0x556a42f7e1b0 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.887+0000 7fed377fe640 1 --2- 172.21.15.148:0/1336833097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4335f9c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fed28009900 tx=0x7fed28009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e0c10709c013d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.887+0000 7fed1d7fa640 1 -- 172.21.15.148:0/1336833097 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28035040 con 0x556a42f7e1b0 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.887+0000 7fed1d7fa640 1 -- 172.21.15.148:0/1336833097 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed28004390 con 0x556a42f7e1b0 2024-09-21T01:14:40.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.887+0000 7fed1d7fa640 1 -- 172.21.15.148:0/1336833097 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28004de0 con 0x556a42f7e1b0 2024-09-21T01:14:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.888+0000 7fed44700740 1 -- 172.21.15.148:0/1336833097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 msgr2=0x556a4335f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.888+0000 7fed44700740 1 --2- 172.21.15.148:0/1336833097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4335f9c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fed28009900 tx=0x7fed28009640 comp rx=0 tx=0).stop 2024-09-21T01:14:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.888+0000 7fed44700740 1 -- 172.21.15.148:0/1336833097 shutdown_connections 2024-09-21T01:14:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.888+0000 7fed44700740 1 --2- 172.21.15.148:0/1336833097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4335f9c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.888+0000 7fed44700740 1 --2- 172.21.15.148:0/1336833097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f86390 0x556a4335ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.888+0000 7fed44700740 1 --2- 172.21.15.148:0/1336833097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f659f0 0x556a43361c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.888+0000 7fed44700740 1 -- 172.21.15.148:0/1336833097 >> 172.21.15.148:0/1336833097 conn(0x556a42f9b460 msgr2=0x556a43361500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.888+0000 7fed44700740 1 -- 172.21.15.148:0/1336833097 shutdown_connections 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.888+0000 7fed44700740 1 -- 172.21.15.148:0/1336833097 wait complete. 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.889+0000 7fed44700740 1 -- start start 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.889+0000 7fed44700740 1 Processor -- start 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.889+0000 7fed44700740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f659f0 0x556a4336a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.889+0000 7fed44700740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4336ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.889+0000 7fed44700740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f86390 0x556a4336b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.889+0000 7fed44700740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fed2400ca60 con 0x556a42f7e1b0 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.889+0000 7fed44700740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fed2400ded0 con 0x556a42f659f0 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.889+0000 7fed44700740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed2400d130 con 0x556a42f86390 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.889+0000 7fed44700740 10 client.0 _ll_register_callbacks cb 0x7fed2c00bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.889+0000 7fed377fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4336ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed377fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4336ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57510/0 (socket says 172.21.15.148:57510) 2024-09-21T01:14:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed377fe640 1 -- 172.21.15.148:0/1482691121 learned_addr learned my addr 172.21.15.148:0/1482691121 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed36ffd640 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f86390 0x556a4336b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed36ffd640 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f659f0 0x556a4336a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed377fe640 1 -- 172.21.15.148:0/1482691121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f86390 msgr2=0x556a4336b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed377fe640 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f86390 0x556a4336b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed377fe640 1 -- 172.21.15.148:0/1482691121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f659f0 msgr2=0x556a4336a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed377fe640 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f659f0 0x556a4336a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed377fe640 1 -- 172.21.15.148:0/1482691121 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a433de120 con 0x556a42f7e1b0 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed377fe640 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4336ae90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fed28031440 tx=0x7fed280050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccd3ed25a7b4623 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed16ffd640 1 -- 172.21.15.148:0/1482691121 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28051070 con 0x556a42f7e1b0 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed16ffd640 1 -- 172.21.15.148:0/1482691121 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fed280055f0 con 0x556a42f7e1b0 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.890+0000 7fed44700740 1 -- 172.21.15.148:0/1482691121 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed28004390 con 0x556a42f7e1b0 2024-09-21T01:14:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed16ffd640 1 -- 172.21.15.148:0/1482691121 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fed28035070 con 0x556a42f7e1b0 2024-09-21T01:14:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed44700740 10 client.15525 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed44700740 1 -- 172.21.15.148:0/1482691121 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556a433df380 con 0x556a42f7e1b0 2024-09-21T01:14:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed16ffd640 1 -- 172.21.15.148:0/1482691121 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed28004390 con 0x556a42f7e1b0 2024-09-21T01:14:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed16ffd640 1 -- 172.21.15.148:0/1482691121 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fed28003ae0 con 0x556a42f7e1b0 2024-09-21T01:14:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed44700740 10 client.15525 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed44700740 10 client.15525 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:14:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed44700740 20 client.15525 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed44700740 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x556a42fa7070 0x556a433e1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed44700740 4 client.15525 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:14:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.891+0000 7fed44700740 1 -- 172.21.15.148:0/1482691121 --> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556a432c6df0 con 0x556a42fa7070 2024-09-21T01:14:40.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.892+0000 7fed36ffd640 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x556a42fa7070 0x556a433e1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.892+0000 7fed16ffd640 10 client.15525 ms_handle_connect on v2:172.21.15.181:6838/2036386246 2024-09-21T01:14:40.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.892+0000 7fed36ffd640 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x556a42fa7070 0x556a433e1ab0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=800f8e687a60b0f6 server_cookie=a51847e225d023dd in_seq=0 out_seq=0 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.892+0000 7fed16ffd640 1 -- 172.21.15.148:0/1482691121 <== mds.1 v2:172.21.15.181:6838/2036386246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a432c6df0 con 0x556a42fa7070 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.892+0000 7fed16ffd640 10 client.15525 handle_command_reply: tid=0 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.892+0000 7fed44700740 1 client.15525 shutdown 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 1 -- 172.21.15.148:0/1482691121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 msgr2=0x556a4336ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4336ae90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fed28031440 tx=0x7fed280050f0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 1 -- 172.21.15.148:0/1482691121 shutdown_connections 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x556a42fa7070 0x556a433e1ab0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed16ffd640 0 client.15525 ms_handle_reset on v2:172.21.15.181:6838/2036386246 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556a42f7e1b0 0x556a4336ae90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a42f86390 0x556a4336b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 1 --2- 172.21.15.148:0/1482691121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556a42f659f0 0x556a4336a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 1 -- 172.21.15.148:0/1482691121 >> 172.21.15.148:0/1482691121 conn(0x556a42f9b460 msgr2=0x556a4335f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:40.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 1 -- 172.21.15.148:0/1482691121 shutdown_connections 2024-09-21T01:14:40.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 1 -- 172.21.15.148:0/1482691121 wait complete. 2024-09-21T01:14:40.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.893+0000 7fed44700740 20 client.15525 trim_cache size 0 max 16384 2024-09-21T01:14:40.898 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 -- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed200b6620 msgr2=0x7fed200b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed200b6620 0x7fed200b8b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fed300049d0 tx=0x7fed30009200 comp rx=0 tx=0).stop 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 -- 172.21.15.148:0/4084147275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed3810de10 msgr2=0x7fed3819fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed3810de10 0x7fed3819fd80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed3000eb10 tx=0x7fed3000c2d0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 -- 172.21.15.148:0/4084147275 shutdown_connections 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed200b6620 0x7fed200b8b30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed3810de10 0x7fed3819fd80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed38105300 0x7fed3819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 --2- 172.21.15.148:0/4084147275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed381049b0 0x7fed3819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 -- 172.21.15.148:0/4084147275 >> 172.21.15.148:0/4084147275 conn(0x7fed38079730 msgr2=0x7fed380ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 -- 172.21.15.148:0/4084147275 shutdown_connections 2024-09-21T01:14:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:40.894+0000 7fed3e18c640 1 -- 172.21.15.148:0/4084147275 wait complete. 2024-09-21T01:14:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.335+0000 7fcb037b0640 1 -- 172.21.15.148:0/2422049081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc101a90 msgr2=0x7fcafc101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.335+0000 7fcb037b0640 1 --2- 172.21.15.148:0/2422049081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc101a90 0x7fcafc101ea0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009900 tx=0x7fcaf802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.335+0000 7fcb037b0640 1 -- 172.21.15.148:0/2422049081 shutdown_connections 2024-09-21T01:14:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.335+0000 7fcb037b0640 1 --2- 172.21.15.148:0/2422049081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc109480 0x7fcafc10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.335+0000 7fcb037b0640 1 --2- 172.21.15.148:0/2422049081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcafc106b20 0x7fcafc108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.335+0000 7fcb037b0640 1 --2- 172.21.15.148:0/2422049081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc101a90 0x7fcafc101ea0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.335+0000 7fcb037b0640 1 -- 172.21.15.148:0/2422049081 >> 172.21.15.148:0/2422049081 conn(0x7fcafc0fd690 msgr2=0x7fcafc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.335+0000 7fcb037b0640 1 -- 172.21.15.148:0/2422049081 shutdown_connections 2024-09-21T01:14:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.335+0000 7fcb037b0640 1 -- 172.21.15.148:0/2422049081 wait complete. 2024-09-21T01:14:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.336+0000 7fcb037b0640 1 Processor -- start 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.336+0000 7fcb037b0640 1 -- start start 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.336+0000 7fcb037b0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc101a90 0x7fcafc104160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.336+0000 7fcb037b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc106b20 0x7fcafc102a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.336+0000 7fcb037b0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcafc109480 0x7fcafc102f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.336+0000 7fcb037b0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc10f310 con 0x7fcafc106b20 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.336+0000 7fcb037b0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc10f190 con 0x7fcafc101a90 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.336+0000 7fcb037b0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc10f490 con 0x7fcafc109480 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.336+0000 7fcb00d4b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc106b20 0x7fcafc102a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.336+0000 7fcb0154c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc101a90 0x7fcafc104160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb0154c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc101a90 0x7fcafc104160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:53732/0 (socket says 172.21.15.148:53732) 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb0154c640 1 -- 172.21.15.148:0/4148835070 learned_addr learned my addr 172.21.15.148:0/4148835070 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcafc109480 0x7fcafc102f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb0154c640 1 -- 172.21.15.148:0/4148835070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcafc109480 msgr2=0x7fcafc102f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb0154c640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcafc109480 0x7fcafc102f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb0154c640 1 -- 172.21.15.148:0/4148835070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc106b20 msgr2=0x7fcafc102a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb0154c640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc106b20 0x7fcafc102a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb0154c640 1 -- 172.21.15.148:0/4148835070 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc103690 con 0x7fcafc101a90 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcafc109480 0x7fcafc102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb0154c640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc101a90 0x7fcafc104160 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8006010 tx=0x7fcaf8031a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcaf27fc640 1 -- 172.21.15.148:0/4148835070 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf803f030 con 0x7fcafc101a90 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcb037b0640 1 -- 172.21.15.148:0/4148835070 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc1a3fe0 con 0x7fcafc101a90 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcaf27fc640 1 -- 172.21.15.148:0/4148835070 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaf8003aa0 con 0x7fcafc101a90 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.337+0000 7fcaf27fc640 1 -- 172.21.15.148:0/4148835070 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8035070 con 0x7fcafc101a90 2024-09-21T01:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.338+0000 7fcb037b0640 1 -- 172.21.15.148:0/4148835070 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc1a4390 con 0x7fcafc101a90 2024-09-21T01:14:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.340+0000 7fcb0a7f4740 1 Processor -- start 2024-09-21T01:14:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb0a7f4740 1 -- start start 2024-09-21T01:14:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4281b0 0x55bc7c7cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c7426f0 con 0x55bc7c4074d0 2024-09-21T01:14:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c731b20 con 0x55bc7c4281b0 2024-09-21T01:14:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c735930 con 0x55bc7c3ff2f0 2024-09-21T01:14:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb01d4d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4281b0 0x55bc7c7cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb01d4d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4281b0 0x55bc7c7cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:53742/0 (socket says 172.21.15.148:53742) 2024-09-21T01:14:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb01d4d640 1 -- 172.21.15.148:0/2596446162 learned_addr learned my addr 172.21.15.148:0/2596446162 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb00d4b640 1 --2- 172.21.15.148:0/2596446162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb01d4d640 1 -- 172.21.15.148:0/2596446162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 msgr2=0x55bc7c7d04c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:14:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/2596446162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7d04c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb01d4d640 1 -- 172.21.15.148:0/2596446162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 msgr2=0x55bc7c7d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/2596446162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.341+0000 7fcb01d4d640 1 -- 172.21.15.148:0/2596446162 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc7c6f7530 con 0x55bc7c4281b0 2024-09-21T01:14:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.342+0000 7fcaf27fc640 1 -- 172.21.15.148:0/4148835070 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7fcaf8042030 con 0x7fcafc101a90 2024-09-21T01:14:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.342+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/2596446162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4281b0 0x55bc7c7cfe50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009fd0 tx=0x7fcaf40108e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a0ea7e5082920c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.342+0000 7fcae77fe640 1 -- 172.21.15.148:0/2596446162 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011760 con 0x55bc7c4281b0 2024-09-21T01:14:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.342+0000 7fcae77fe640 1 -- 172.21.15.148:0/2596446162 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaf4011db0 con 0x55bc7c4281b0 2024-09-21T01:14:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.342+0000 7fcae77fe640 1 -- 172.21.15.148:0/2596446162 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400e3c0 con 0x55bc7c4281b0 2024-09-21T01:14:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.342+0000 7fcaf27fc640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcae80b65a0 0x7fcae80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.343+0000 7fcb0154c640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcae80b65a0 0x7fcae80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.343+0000 7fcaf27fc640 1 -- 172.21.15.148:0/4148835070 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fcaf8107b10 con 0x7fcafc101a90 2024-09-21T01:14:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.343+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/2596446162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4281b0 msgr2=0x55bc7c7cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.343+0000 7fcb0154c640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcae80b65a0 0x7fcae80b8ab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80cd7f0 tx=0x7fcaf80c23a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.343+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/2596446162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4281b0 0x55bc7c7cfe50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009fd0 tx=0x7fcaf40108e0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.344+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/2596446162 shutdown_connections 2024-09-21T01:14:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.344+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/2596446162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.344+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/2596446162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.344+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/2596446162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4281b0 0x55bc7c7cfe50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.344+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/2596446162 >> 172.21.15.148:0/2596446162 conn(0x55bc7c41c300 msgr2=0x55bc7c7cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.344+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/2596446162 shutdown_connections 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.344+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/2596446162 wait complete. 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.344+0000 7fcb0a7f4740 1 -- start start 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.344+0000 7fcb0a7f4740 1 Processor -- start 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7d9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4074d0 0x55bc7c7d9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4281b0 0x55bc7c7da850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c669ab0 con 0x55bc7c4281b0 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c6d7730 con 0x55bc7c4074d0 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb00d4b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4074d0 0x55bc7c7d9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb00d4b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4074d0 0x55bc7c7d9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:53746/0 (socket says 172.21.15.148:53746) 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb00d4b640 1 -- 172.21.15.148:0/3196333771 learned_addr learned my addr 172.21.15.148:0/3196333771 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/3196333771 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c7d1b30 con 0x55bc7c3ff2f0 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4281b0 0x55bc7c7da850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.345+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7d9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcb0a7f4740 10 client.0 _ll_register_callbacks cb 0x55bc7c72b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcb00d4b640 1 -- 172.21.15.148:0/3196333771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 msgr2=0x55bc7c7d9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcb00d4b640 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7d9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcb00d4b640 1 -- 172.21.15.148:0/3196333771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4281b0 msgr2=0x55bc7c7da850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcb00d4b640 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4281b0 0x55bc7c7da850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcb00d4b640 1 -- 172.21.15.148:0/3196333771 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc7c493790 con 0x55bc7c4074d0 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7d9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcb00d4b640 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4074d0 0x55bc7c7d9d50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00b920 tx=0x7fcaec00bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=900d71a8851080c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcae4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-09-21T01:14:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcae4ff9640 1 -- 172.21.15.148:0/3196333771 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec003ea0 con 0x55bc7c4074d0 2024-09-21T01:14:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcae4ff9640 1 -- 172.21.15.148:0/3196333771 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fcaec01b640 con 0x55bc7c4074d0 2024-09-21T01:14:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.346+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/3196333771 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaf4011db0 con 0x55bc7c4074d0 2024-09-21T01:14:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.347+0000 7fcae4ff9640 1 -- 172.21.15.148:0/3196333771 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcaec01b840 con 0x55bc7c4074d0 2024-09-21T01:14:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.347+0000 7fcb0a7f4740 10 client.25172 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.347+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/3196333771 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bc7c50c620 con 0x55bc7c4074d0 2024-09-21T01:14:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.347+0000 7fcae4ff9640 1 -- 172.21.15.148:0/3196333771 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaec011440 con 0x55bc7c4074d0 2024-09-21T01:14:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.348+0000 7fcae4ff9640 1 -- 172.21.15.148:0/3196333771 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcaec019020 con 0x55bc7c4074d0 2024-09-21T01:14:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.348+0000 7fcb0a7f4740 10 client.25172 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.348+0000 7fcb0a7f4740 10 client.25172 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.348+0000 7fcb0a7f4740 20 client.25172 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.348+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55bc7c3e6d80 0x55bc7c7e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.348+0000 7fcb0a7f4740 4 client.25172 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.348+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/3196333771 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcaf4011db0 con 0x55bc7c3e6d80 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.348+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55bc7c3e6d80 0x55bc7c7e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.349+0000 7fcae4ff9640 10 client.25172 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.349+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55bc7c3e6d80 0x55bc7c7e6dd0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d59d9f59e81e899f server_cookie=11ced9067ed9634c in_seq=0 out_seq=0 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.349+0000 7fcae4ff9640 1 -- 172.21.15.148:0/3196333771 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fcaf4011db0 con 0x55bc7c3e6d80 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.349+0000 7fcae4ff9640 10 client.25172 handle_command_reply: tid=0 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.349+0000 7fcb0a7f4740 1 client.25172 shutdown 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/3196333771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4074d0 msgr2=0x55bc7c7d9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4074d0 0x55bc7c7d9d50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00b920 tx=0x7fcaec00bde0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/3196333771 shutdown_connections 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55bc7c3e6d80 0x55bc7c7e6dd0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcae4ff9640 0 client.25172 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4281b0 0x55bc7c7da850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c4074d0 0x55bc7c7d9d50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/3196333771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7d9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/3196333771 >> 172.21.15.148:0/3196333771 conn(0x55bc7c41c300 msgr2=0x55bc7c7c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/3196333771 shutdown_connections 2024-09-21T01:14:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/3196333771 wait complete. 2024-09-21T01:14:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.350+0000 7fcb0a7f4740 20 client.25172 trim_cache size 0 max 16384 2024-09-21T01:14:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.364+0000 7fcb0a7f4740 1 Processor -- start 2024-09-21T01:14:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb0a7f4740 1 -- start start 2024-09-21T01:14:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 0x55bc7c7d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7da850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7dad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1afa10 con 0x55bc7c4074d0 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1ad2e0 con 0x55bc7c3e6d80 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1ab130 con 0x55bc7c3ff2f0 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb01d4d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 0x55bc7c7d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb01d4d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 0x55bc7c7d0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:53760/0 (socket says 172.21.15.148:53760) 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb01d4d640 1 -- 172.21.15.148:0/2496345632 learned_addr learned my addr 172.21.15.148:0/2496345632 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/2496345632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7dad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb00d4b640 1 --2- 172.21.15.148:0/2496345632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7da850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb01d4d640 1 -- 172.21.15.148:0/2496345632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 msgr2=0x55bc7c7da850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/2496345632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7da850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb01d4d640 1 -- 172.21.15.148:0/2496345632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 msgr2=0x55bc7c7dad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/2496345632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7dad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.365+0000 7fcb01d4d640 1 -- 172.21.15.148:0/2496345632 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc7c7cbe60 con 0x55bc7c3e6d80 2024-09-21T01:14:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.366+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/2496345632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 0x55bc7c7d0c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4006010 tx=0x7fcaf40108e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1acbe60d15a9c58b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.366+0000 7fcae6ffd640 1 -- 172.21.15.148:0/2496345632 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf401b710 con 0x55bc7c3e6d80 2024-09-21T01:14:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.366+0000 7fcae6ffd640 1 -- 172.21.15.148:0/2496345632 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaf401b8b0 con 0x55bc7c3e6d80 2024-09-21T01:14:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.366+0000 7fcae6ffd640 1 -- 172.21.15.148:0/2496345632 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011980 con 0x55bc7c3e6d80 2024-09-21T01:14:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.367+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/2496345632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 msgr2=0x55bc7c7d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.367+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/2496345632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 0x55bc7c7d0c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4006010 tx=0x7fcaf40108e0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.367+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/2496345632 shutdown_connections 2024-09-21T01:14:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.367+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/2496345632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7dad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.367+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/2496345632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7da850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.367+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/2496345632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 0x55bc7c7d0c90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.367+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/2496345632 >> 172.21.15.148:0/2496345632 conn(0x55bc7c41c300 msgr2=0x55bc7c7ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.367+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/2496345632 shutdown_connections 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.367+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/2496345632 wait complete. 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.367+0000 7fcb0a7f4740 1 -- start start 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb0a7f4740 1 Processor -- start 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 0x55bc7c7de400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7deac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb0a7f4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7df550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1ab7a0 con 0x55bc7c4074d0 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1acc10 con 0x55bc7c3e6d80 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb0a7f4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1abe70 con 0x55bc7c3ff2f0 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb0a7f4740 10 client.0 _ll_register_callbacks cb 0x7fcaec004160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb00d4b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb01d4d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7df550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb01d4d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7df550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57568/0 (socket says 172.21.15.148:57568) 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb00d4b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7deac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:33836/0 (socket says 172.21.15.148:33836) 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb01d4d640 1 -- 172.21.15.148:0/4292925779 learned_addr learned my addr 172.21.15.148:0/4292925779 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.368+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 0x55bc7c7de400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcb01d4d640 1 -- 172.21.15.148:0/4292925779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 msgr2=0x55bc7c7deac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7deac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcb01d4d640 1 -- 172.21.15.148:0/4292925779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 msgr2=0x55bc7c7de400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 0x55bc7c7de400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcb01d4d640 1 -- 172.21.15.148:0/4292925779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc7c7dfcb0 con 0x55bc7c4074d0 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcb01d4d640 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7df550 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4010fd0 tx=0x7fcaf4009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5817af349581e3a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcae4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcae4ff9640 1 -- 172.21.15.148:0/4292925779 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf401bc50 con 0x55bc7c4074d0 2024-09-21T01:14:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcae4ff9640 1 -- 172.21.15.148:0/4292925779 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fcaf4023040 con 0x55bc7c4074d0 2024-09-21T01:14:41.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/4292925779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc7c7ca440 con 0x55bc7c4074d0 2024-09-21T01:14:41.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcae4ff9640 1 -- 172.21.15.148:0/4292925779 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcaf40049c0 con 0x55bc7c4074d0 2024-09-21T01:14:41.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcb0a7f4740 10 client.15543 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:41.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.369+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/4292925779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bc7c7e0fa0 con 0x55bc7c4074d0 2024-09-21T01:14:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.370+0000 7fcae4ff9640 1 -- 172.21.15.148:0/4292925779 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bc7c7ca440 con 0x55bc7c4074d0 2024-09-21T01:14:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.370+0000 7fcae4ff9640 1 -- 172.21.15.148:0/4292925779 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcaf4005020 con 0x55bc7c4074d0 2024-09-21T01:14:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.370+0000 7fcb0a7f4740 10 client.15543 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.370+0000 7fcb0a7f4740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.370+0000 7fcb0a7f4740 20 client.15543 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.370+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55bc7c4281b0 0x55bc7c8538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.370+0000 7fcb0a7f4740 4 client.15543 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:14:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.370+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/4292925779 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc7c744640 con 0x55bc7c4281b0 2024-09-21T01:14:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.370+0000 7fcb00d4b640 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55bc7c4281b0 0x55bc7c8538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.371+0000 7fcae4ff9640 10 client.15543 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:41.375 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.371+0000 7fcb00d4b640 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55bc7c4281b0 0x55bc7c8538f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fb5934a34f797 server_cookie=d8020489f8eb5bf3 in_seq=0 out_seq=0 2024-09-21T01:14:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.379+0000 7fcae4ff9640 1 -- 172.21.15.148:0/4292925779 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc7c744640 con 0x55bc7c4281b0 2024-09-21T01:14:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.379+0000 7fcae4ff9640 10 client.15543 handle_command_reply: tid=0 2024-09-21T01:14:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.379+0000 7fcb0a7f4740 1 client.15543 shutdown 2024-09-21T01:14:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.379+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/4292925779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 msgr2=0x55bc7c7df550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.379+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7df550 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4010fd0 tx=0x7fcaf4009280 comp rx=0 tx=0).stop 2024-09-21T01:14:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/4292925779 shutdown_connections 2024-09-21T01:14:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55bc7c4281b0 0x55bc7c8538f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcae4ff9640 0 client.15543 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bc7c4074d0 0x55bc7c7df550 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc7c3ff2f0 0x55bc7c7deac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb0a7f4740 1 --2- 172.21.15.148:0/4292925779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bc7c3e6d80 0x55bc7c7de400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/4292925779 >> 172.21.15.148:0/4292925779 conn(0x55bc7c41c300 msgr2=0x55bc7c7ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/4292925779 shutdown_connections 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb0a7f4740 1 -- 172.21.15.148:0/4292925779 wait complete. 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb0a7f4740 20 client.15543 trim_cache size 0 max 16384 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-21T01:14:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-21T01:14:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-21T01:14:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb037b0640 1 -- 172.21.15.148:0/4148835070 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcae80b65a0 msgr2=0x7fcae80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb037b0640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcae80b65a0 0x7fcae80b8ab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80cd7f0 tx=0x7fcaf80c23a0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb037b0640 1 -- 172.21.15.148:0/4148835070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc101a90 msgr2=0x7fcafc104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.380+0000 7fcb037b0640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc101a90 0x7fcafc104160 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8006010 tx=0x7fcaf8031a50 comp rx=0 tx=0).stop 2024-09-21T01:14:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.381+0000 7fcb037b0640 1 -- 172.21.15.148:0/4148835070 shutdown_connections 2024-09-21T01:14:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.381+0000 7fcb037b0640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcae80b65a0 0x7fcae80b8ab0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.381+0000 7fcb037b0640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc106b20 0x7fcafc102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.381+0000 7fcb037b0640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcafc109480 0x7fcafc102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.381+0000 7fcb037b0640 1 --2- 172.21.15.148:0/4148835070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc101a90 0x7fcafc104160 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.381+0000 7fcb037b0640 1 -- 172.21.15.148:0/4148835070 >> 172.21.15.148:0/4148835070 conn(0x7fcafc0fd690 msgr2=0x7fcafc1079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.381+0000 7fcb037b0640 1 -- 172.21.15.148:0/4148835070 shutdown_connections 2024-09-21T01:14:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:41.381+0000 7fcb037b0640 1 -- 172.21.15.148:0/4148835070 wait complete. 2024-09-21T01:14:41.619 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:14:41.969 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:42.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:42 smithi148 ceph-mon[31000]: pgmap v359: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:14:42.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.461+0000 7f240adf5640 1 -- 172.21.15.148:0/285052472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2404105190 msgr2=0x7f24041055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.461+0000 7f240adf5640 1 --2- 172.21.15.148:0/285052472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2404105190 0x7f24041055a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009900 tx=0x7f23f002a410 comp rx=0 tx=0).stop 2024-09-21T01:14:42.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.461+0000 7f240adf5640 1 -- 172.21.15.148:0/285052472 shutdown_connections 2024-09-21T01:14:42.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.461+0000 7f240adf5640 1 --2- 172.21.15.148:0/285052472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2404105190 0x7f24041055a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.461+0000 7f240adf5640 1 --2- 172.21.15.148:0/285052472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2404105ae0 0x7f240410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.461+0000 7f240adf5640 1 --2- 172.21.15.148:0/285052472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24041031c0 0x7f24041035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.461+0000 7f240adf5640 1 -- 172.21.15.148:0/285052472 >> 172.21.15.148:0/285052472 conn(0x7f2404077c60 msgr2=0x7f24040780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.461+0000 7f240adf5640 1 -- 172.21.15.148:0/285052472 shutdown_connections 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.461+0000 7f240adf5640 1 -- 172.21.15.148:0/285052472 wait complete. 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f240adf5640 1 Processor -- start 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f240adf5640 1 -- start start 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f240adf5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24041031c0 0x7f240419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f240adf5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2404105190 0x7f240419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f240adf5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2404105ae0 0x7f24041a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f240adf5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2404112980 con 0x7f2404105190 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f240adf5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2404112800 con 0x7f2404105ae0 2024-09-21T01:14:42.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f240adf5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2404112b00 con 0x7f24041031c0 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f2403fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2404105190 0x7f240419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f2403fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2404105190 0x7f240419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57574/0 (socket says 172.21.15.148:57574) 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f2403fff640 1 -- 172.21.15.148:0/793658799 learned_addr learned my addr 172.21.15.148:0/793658799 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f2409392640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2404105ae0 0x7f24041a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.462+0000 7f2408b91640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24041031c0 0x7f240419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f2403fff640 1 -- 172.21.15.148:0/793658799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24041031c0 msgr2=0x7f240419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f2403fff640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24041031c0 0x7f240419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f2403fff640 1 -- 172.21.15.148:0/793658799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2404105ae0 msgr2=0x7f24041a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f2403fff640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2404105ae0 0x7f24041a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f2403fff640 1 -- 172.21.15.148:0/793658799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24041a2600 con 0x7f2404105190 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f2408b91640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24041031c0 0x7f240419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f2403fff640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2404105190 0x7f240419cc30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f23f0006010 tx=0x7f23f0004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f2401ffb640 1 -- 172.21.15.148:0/793658799 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f003f030 con 0x7f2404105190 2024-09-21T01:14:42.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f240adf5640 1 -- 172.21.15.148:0/793658799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24041a2890 con 0x7f2404105190 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f2401ffb640 1 -- 172.21.15.148:0/793658799 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f0003aa0 con 0x7f2404105190 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f2401ffb640 1 -- 172.21.15.148:0/793658799 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0035070 con 0x7f2404105190 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.463+0000 7f240adf5640 1 -- 172.21.15.148:0/793658799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24041a9050 con 0x7f2404105190 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.466+0000 7f2401ffb640 1 -- 172.21.15.148:0/793658799 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f23f0042030 con 0x7f2404105190 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.467+0000 7f2401ffb640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f23f40b6620 0x7f23f40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.467+0000 7f2411369740 1 Processor -- start 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.468+0000 7f2401ffb640 1 -- 172.21.15.148:0/793658799 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f23f0107950 con 0x7f2404105190 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.468+0000 7f2408b91640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f23f40b6620 0x7f23f40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.468+0000 7f2411369740 1 -- start start 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.468+0000 7f2411369740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d71035070 0x564d713dc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.468+0000 7f2411369740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d7100c1b0 0x564d713dcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.468+0000 7f2411369740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713dd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.468+0000 7f2411369740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564d71352ea0 con 0x564d71035070 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.468+0000 7f2411369740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x564d713422d0 con 0x564d7100c1b0 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.468+0000 7f2411369740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564d713460e0 con 0x564d71014390 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2403fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d7100c1b0 0x564d713dcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2403fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d7100c1b0 0x564d713dcbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:53802/0 (socket says 172.21.15.148:53802) 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2403fff640 1 -- 172.21.15.148:0/3249052181 learned_addr learned my addr 172.21.15.148:0/3249052181 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2409392640 1 --2- 172.21.15.148:0/3249052181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713dd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2403fff640 1 -- 172.21.15.148:0/3249052181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 msgr2=0x564d713dd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2403fff640 1 --2- 172.21.15.148:0/3249052181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713dd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2403fff640 1 -- 172.21.15.148:0/3249052181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d71035070 msgr2=0x564d713dc6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:14:42.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2403fff640 1 --2- 172.21.15.148:0/3249052181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d71035070 0x564d713dc6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2403fff640 1 -- 172.21.15.148:0/3249052181 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d710a0650 con 0x564d7100c1b0 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2409392640 1 --2- 172.21.15.148:0/3249052181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713dd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2403fff640 1 --2- 172.21.15.148:0/3249052181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d7100c1b0 0x564d713dcbe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23f0000c00 tx=0x7f23f0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0e492b219264017 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f2408b91640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f23f40b6620 0x7f23f40b8b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009b50 tx=0x7f23f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f23eeffd640 1 -- 172.21.15.148:0/3249052181 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00d2020 con 0x564d7100c1b0 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.469+0000 7f23eeffd640 1 -- 172.21.15.148:0/3249052181 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f00cd4a0 con 0x564d7100c1b0 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.470+0000 7f23eeffd640 1 -- 172.21.15.148:0/3249052181 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00c9c00 con 0x564d7100c1b0 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.470+0000 7f2411369740 1 -- 172.21.15.148:0/3249052181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d7100c1b0 msgr2=0x564d713dcbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.470+0000 7f2411369740 1 --2- 172.21.15.148:0/3249052181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d7100c1b0 0x564d713dcbe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23f0000c00 tx=0x7f23f0009260 comp rx=0 tx=0).stop 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.470+0000 7f2411369740 1 -- 172.21.15.148:0/3249052181 shutdown_connections 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.470+0000 7f2411369740 1 --2- 172.21.15.148:0/3249052181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713dd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.470+0000 7f2411369740 1 --2- 172.21.15.148:0/3249052181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d7100c1b0 0x564d713dcbe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.470+0000 7f2411369740 1 --2- 172.21.15.148:0/3249052181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d71035070 0x564d713dc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.470+0000 7f2411369740 1 -- 172.21.15.148:0/3249052181 >> 172.21.15.148:0/3249052181 conn(0x564d71029460 msgr2=0x564d713da590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.470+0000 7f2411369740 1 -- 172.21.15.148:0/3249052181 shutdown_connections 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.470+0000 7f2411369740 1 -- 172.21.15.148:0/3249052181 wait complete. 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.471+0000 7f2411369740 1 -- start start 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.471+0000 7f2411369740 1 Processor -- start 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.471+0000 7f2411369740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 0x564d713e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.471+0000 7f2411369740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 0x564d713e8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.471+0000 7f2411369740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71035070 0x564d713f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2408b91640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 0x564d713e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2408b91640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 0x564d713e7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57578/0 (socket says 172.21.15.148:57578) 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2411369740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564d711a3700 con 0x564d7100c1b0 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2408b91640 1 -- 172.21.15.148:0/1067143020 learned_addr learned my addr 172.21.15.148:0/1067143020 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2411369740 1 -- 172.21.15.148:0/1067143020 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x564d712dd160 con 0x564d71014390 2024-09-21T01:14:42.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2411369740 1 -- 172.21.15.148:0/1067143020 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564d713eac40 con 0x564d71035070 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2411369740 10 client.0 _ll_register_callbacks cb 0x564d712f69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2403fff640 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 0x564d713e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2409392640 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71035070 0x564d713f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2403fff640 1 -- 172.21.15.148:0/1067143020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71035070 msgr2=0x564d713f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2403fff640 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71035070 0x564d713f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2403fff640 1 -- 172.21.15.148:0/1067143020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 msgr2=0x564d713e7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2403fff640 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 0x564d713e7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2403fff640 1 -- 172.21.15.148:0/1067143020 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d7130ac90 con 0x564d71014390 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2409392640 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71035070 0x564d713f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f2403fff640 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 0x564d713e8320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x564d713db320 tx=0x7f23f0009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168113580e35f82c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:42.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f23e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.472+0000 7f23e3fff640 1 -- 172.21.15.148:0/1067143020 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00f1050 con 0x564d71014390 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.473+0000 7f23e3fff640 1 -- 172.21.15.148:0/1067143020 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f23f00d6f20 con 0x564d71014390 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.473+0000 7f2411369740 1 -- 172.21.15.148:0/1067143020 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f00cd4a0 con 0x564d71014390 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.473+0000 7f23e3fff640 1 -- 172.21.15.148:0/1067143020 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f23f00d2470 con 0x564d71014390 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.473+0000 7f2411369740 10 client.25190 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.473+0000 7f2411369740 1 -- 172.21.15.148:0/1067143020 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564d713f6760 con 0x564d71014390 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.473+0000 7f23e3fff640 1 -- 172.21.15.148:0/1067143020 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f00d7120 con 0x564d71014390 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.473+0000 7f23e3fff640 1 -- 172.21.15.148:0/1067143020 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f23f00c93f0 con 0x564d71014390 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.474+0000 7f2411369740 10 client.25190 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.474+0000 7f2411369740 10 client.25190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.474+0000 7f2411369740 20 client.25190 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.474+0000 7f2411369740 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564d70ff39f0 0x564d713f98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.474+0000 7f2411369740 4 client.25190 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:42.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.474+0000 7f2411369740 1 -- 172.21.15.148:0/1067143020 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f23f00cd4a0 con 0x564d70ff39f0 2024-09-21T01:14:42.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.474+0000 7f2408b91640 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564d70ff39f0 0x564d713f98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.474+0000 7f23e3fff640 10 client.25190 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:42.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.474+0000 7f2408b91640 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564d70ff39f0 0x564d713f98f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e95fa953e950afcd server_cookie=fa366b2f2c981d06 in_seq=0 out_seq=0 2024-09-21T01:14:42.484 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:42 smithi181 ceph-mon[34811]: pgmap v359: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:14:42.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f23e3fff640 1 -- 172.21.15.148:0/1067143020 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f23f00cd4a0 con 0x564d70ff39f0 2024-09-21T01:14:42.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f23e3fff640 10 client.25190 handle_command_reply: tid=0 2024-09-21T01:14:42.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f2411369740 1 client.25190 shutdown 2024-09-21T01:14:42.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f2411369740 1 -- 172.21.15.148:0/1067143020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 msgr2=0x564d713e8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f2411369740 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 0x564d713e8320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x564d713db320 tx=0x7f23f0009560 comp rx=0 tx=0).stop 2024-09-21T01:14:42.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f2411369740 1 -- 172.21.15.148:0/1067143020 shutdown_connections 2024-09-21T01:14:42.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f2411369740 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564d70ff39f0 0x564d713f98f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f2411369740 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71035070 0x564d713f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f2411369740 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 0x564d713e8320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f2411369740 1 --2- 172.21.15.148:0/1067143020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 0x564d713e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f2411369740 1 -- 172.21.15.148:0/1067143020 >> 172.21.15.148:0/1067143020 conn(0x564d71029460 msgr2=0x564d713dd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:42.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.475+0000 7f23e3fff640 0 client.25190 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:42.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.476+0000 7f2411369740 1 -- 172.21.15.148:0/1067143020 shutdown_connections 2024-09-21T01:14:42.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.476+0000 7f2411369740 1 -- 172.21.15.148:0/1067143020 wait complete. 2024-09-21T01:14:42.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.476+0000 7f2411369740 20 client.25190 trim_cache size 0 max 16384 2024-09-21T01:14:42.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:42 smithi157 ceph-mon[34140]: pgmap v359: 97 pgs: 97 active+clean; 662 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:14:42.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.501+0000 7f2411369740 1 Processor -- start 2024-09-21T01:14:42.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.501+0000 7f2411369740 1 -- start start 2024-09-21T01:14:42.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.502+0000 7f2411369740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d7100c1b0 0x564d713ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.502+0000 7f2411369740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 0x564d713e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.502+0000 7f2411369740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d71035070 0x564d713e5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.502+0000 7f2403fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 0x564d713e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.502+0000 7f2403fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 0x564d713e4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:53824/0 (socket says 172.21.15.148:53824) 2024-09-21T01:14:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.502+0000 7f2409392640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d71035070 0x564d713e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.502+0000 7f2409392640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d71035070 0x564d713e5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57582/0 (socket says 172.21.15.148:57582) 2024-09-21T01:14:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.502+0000 7f2403fff640 1 -- 172.21.15.148:0/2483161146 learned_addr learned my addr 172.21.15.148:0/2483161146 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.503+0000 7f2408b91640 1 --2- 172.21.15.148:0/2483161146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d7100c1b0 0x564d713ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.503+0000 7f2411369740 1 -- 172.21.15.148:0/2483161146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f24041b3e50 con 0x564d71035070 2024-09-21T01:14:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.503+0000 7f2411369740 1 -- 172.21.15.148:0/2483161146 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f24041b1720 con 0x564d71014390 2024-09-21T01:14:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.503+0000 7f2411369740 1 -- 172.21.15.148:0/2483161146 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f24041af570 con 0x564d7100c1b0 2024-09-21T01:14:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.503+0000 7f2408b91640 1 -- 172.21.15.148:0/2483161146 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 msgr2=0x564d713e4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.503+0000 7f2408b91640 1 --2- 172.21.15.148:0/2483161146 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 0x564d713e4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.503+0000 7f2408b91640 1 -- 172.21.15.148:0/2483161146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d71035070 msgr2=0x564d713e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.503+0000 7f2408b91640 1 --2- 172.21.15.148:0/2483161146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d71035070 0x564d713e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.503+0000 7f2408b91640 1 -- 172.21.15.148:0/2483161146 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d70ff3c20 con 0x564d7100c1b0 2024-09-21T01:14:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.503+0000 7f2408b91640 1 --2- 172.21.15.148:0/2483161146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d7100c1b0 0x564d713ddd90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x564d71346230 tx=0x7f23f8016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e24f153de2d87eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.504+0000 7f23ee7fc640 1 -- 172.21.15.148:0/2483161146 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8004220 con 0x564d7100c1b0 2024-09-21T01:14:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.504+0000 7f23ee7fc640 1 -- 172.21.15.148:0/2483161146 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f80043c0 con 0x564d7100c1b0 2024-09-21T01:14:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.504+0000 7f23ee7fc640 1 -- 172.21.15.148:0/2483161146 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8020820 con 0x564d7100c1b0 2024-09-21T01:14:42.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.505+0000 7f2411369740 1 -- 172.21.15.148:0/2483161146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d7100c1b0 msgr2=0x564d713ddd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.505+0000 7f2411369740 1 --2- 172.21.15.148:0/2483161146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d7100c1b0 0x564d713ddd90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x564d71346230 tx=0x7f23f8016000 comp rx=0 tx=0).stop 2024-09-21T01:14:42.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.505+0000 7f2411369740 1 -- 172.21.15.148:0/2483161146 shutdown_connections 2024-09-21T01:14:42.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.505+0000 7f2411369740 1 --2- 172.21.15.148:0/2483161146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d71035070 0x564d713e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.505+0000 7f2411369740 1 --2- 172.21.15.148:0/2483161146 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71014390 0x564d713e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.505+0000 7f2411369740 1 --2- 172.21.15.148:0/2483161146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d7100c1b0 0x564d713ddd90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.505+0000 7f2411369740 1 -- 172.21.15.148:0/2483161146 >> 172.21.15.148:0/2483161146 conn(0x564d71029460 msgr2=0x564d713dd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.505+0000 7f2411369740 1 -- 172.21.15.148:0/2483161146 shutdown_connections 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.505+0000 7f2411369740 1 -- 172.21.15.148:0/2483161146 wait complete. 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.506+0000 7f2411369740 1 -- start start 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.506+0000 7f2411369740 1 Processor -- start 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.506+0000 7f2411369740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 0x564d713f0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.506+0000 7f2411369740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713eb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.506+0000 7f2411369740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71035070 0x564d713eba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.506+0000 7f2411369740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f24041afbe0 con 0x564d7100c1b0 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.506+0000 7f2411369740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f24041b1050 con 0x564d71035070 2024-09-21T01:14:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.506+0000 7f2411369740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f24041b02b0 con 0x564d71014390 2024-09-21T01:14:42.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2411369740 10 client.0 _ll_register_callbacks cb 0x7f23f00c9830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:42.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2403fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713eb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2403fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713eb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:33890/0 (socket says 172.21.15.148:33890) 2024-09-21T01:14:42.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2403fff640 1 -- 172.21.15.148:0/969455967 learned_addr learned my addr 172.21.15.148:0/969455967 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:42.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2409392640 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71035070 0x564d713eba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2408b91640 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 0x564d713f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2403fff640 1 -- 172.21.15.148:0/969455967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71035070 msgr2=0x564d713eba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:42.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2403fff640 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71035070 0x564d713eba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2403fff640 1 -- 172.21.15.148:0/969455967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 msgr2=0x564d713f0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:42.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2403fff640 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 0x564d713f0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2403fff640 1 -- 172.21.15.148:0/969455967 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d713ebf80 con 0x564d71014390 2024-09-21T01:14:42.513 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-21T01:14:42.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.507+0000 7f2408b91640 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 0x564d713f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:42.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f2403fff640 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713eb500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f23f00c9170 tx=0x7f23f002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2dc6af25e737432 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:42.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f23e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f23e3fff640 1 -- 172.21.15.148:0/969455967 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00cd4a0 con 0x564d71014390 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f23e3fff640 1 -- 172.21.15.148:0/969455967 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f23f00c92e0 con 0x564d71014390 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f2411369740 1 -- 172.21.15.148:0/969455967 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f80043c0 con 0x564d71014390 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f23e3fff640 1 -- 172.21.15.148:0/969455967 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f23f00d73b0 con 0x564d71014390 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f2411369740 10 client.25165 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f2411369740 1 -- 172.21.15.148:0/969455967 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564d71463d90 con 0x564d71014390 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f23e3fff640 1 -- 172.21.15.148:0/969455967 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f00ee030 con 0x564d71014390 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f23e3fff640 1 -- 172.21.15.148:0/969455967 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f23f00cc7e0 con 0x564d71014390 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f2411369740 10 client.25165 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.508+0000 7f2411369740 10 client.25165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.509+0000 7f2411369740 20 client.25165 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.509+0000 7f2411369740 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564d70fc8da0 0x564d714642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.509+0000 7f2411369740 4 client.25165 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.509+0000 7f2411369740 1 -- 172.21.15.148:0/969455967 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f23f80043c0 con 0x564d70fc8da0 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.509+0000 7f2408b91640 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564d70fc8da0 0x564d714642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.509+0000 7f23e3fff640 10 client.25165 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2408b91640 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564d70fc8da0 0x564d714642e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=539ce879f652fda1 server_cookie=e81b57fd95f1e7ff in_seq=0 out_seq=0 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f23e3fff640 1 -- 172.21.15.148:0/969455967 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f23f80043c0 con 0x564d70fc8da0 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f23e3fff640 10 client.25165 handle_command_reply: tid=0 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 client.25165 shutdown 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 -- 172.21.15.148:0/969455967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 msgr2=0x564d713eb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713eb500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f23f00c9170 tx=0x7f23f002a410 comp rx=0 tx=0).stop 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 -- 172.21.15.148:0/969455967 shutdown_connections 2024-09-21T01:14:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564d70fc8da0 0x564d714642e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564d71035070 0x564d713eba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d71014390 0x564d713eb500 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 --2- 172.21.15.148:0/969455967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d7100c1b0 0x564d713f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 -- 172.21.15.148:0/969455967 >> 172.21.15.148:0/969455967 conn(0x564d71029460 msgr2=0x564d713f2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f23e3fff640 0 client.25165 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 -- 172.21.15.148:0/969455967 shutdown_connections 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.510+0000 7f2411369740 1 -- 172.21.15.148:0/969455967 wait complete. 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.511+0000 7f2411369740 20 client.25165 trim_cache size 0 max 16384 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.511+0000 7f240adf5640 1 -- 172.21.15.148:0/793658799 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f23f40b6620 msgr2=0x7f23f40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.511+0000 7f240adf5640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f23f40b6620 0x7f23f40b8b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009b50 tx=0x7f23f8005f90 comp rx=0 tx=0).stop 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.511+0000 7f240adf5640 1 -- 172.21.15.148:0/793658799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2404105190 msgr2=0x7f240419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.511+0000 7f240adf5640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2404105190 0x7f240419cc30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f23f0006010 tx=0x7f23f0004060 comp rx=0 tx=0).stop 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.512+0000 7f240adf5640 1 -- 172.21.15.148:0/793658799 shutdown_connections 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.512+0000 7f240adf5640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f23f40b6620 0x7f23f40b8b30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.512+0000 7f240adf5640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2404105190 0x7f240419cc30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.512+0000 7f240adf5640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2404105ae0 0x7f24041a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.512+0000 7f240adf5640 1 --2- 172.21.15.148:0/793658799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24041031c0 0x7f240419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.512+0000 7f240adf5640 1 -- 172.21.15.148:0/793658799 >> 172.21.15.148:0/793658799 conn(0x7f2404077c60 msgr2=0x7f2404106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:42.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.512+0000 7f240adf5640 1 -- 172.21.15.148:0/793658799 shutdown_connections 2024-09-21T01:14:42.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:42.512+0000 7f240adf5640 1 -- 172.21.15.148:0/793658799 wait complete. 2024-09-21T01:14:44.310 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:14:44.310 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:14:44.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:44 smithi181 ceph-mon[34811]: pgmap v360: 97 pgs: 97 active+clean; 671 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T01:14:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:44 smithi157 ceph-mon[34140]: pgmap v360: 97 pgs: 97 active+clean; 671 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T01:14:44.585 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:44.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:44 smithi148 ceph-mon[31000]: pgmap v360: 97 pgs: 97 active+clean; 671 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T01:14:45.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.136+0000 7fceddff9640 1 -- 172.21.15.148:0/990528888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81083d0 msgr2=0x7fced81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.136+0000 7fceddff9640 1 --2- 172.21.15.148:0/990528888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81083d0 0x7fced81087e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009900 tx=0x7fcecc02a410 comp rx=0 tx=0).stop 2024-09-21T01:14:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.136+0000 7fceddff9640 1 -- 172.21.15.148:0/990528888 shutdown_connections 2024-09-21T01:14:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.136+0000 7fceddff9640 1 --2- 172.21.15.148:0/990528888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81083d0 0x7fced81087e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.136+0000 7fceddff9640 1 --2- 172.21.15.148:0/990528888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fced8108d20 0x7fced810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.136+0000 7fceddff9640 1 --2- 172.21.15.148:0/990528888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8102ae0 0x7fced8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.136+0000 7fceddff9640 1 -- 172.21.15.148:0/990528888 >> 172.21.15.148:0/990528888 conn(0x7fced8079760 msgr2=0x7fced8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.136+0000 7fceddff9640 1 -- 172.21.15.148:0/990528888 shutdown_connections 2024-09-21T01:14:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.136+0000 7fceddff9640 1 -- 172.21.15.148:0/990528888 wait complete. 2024-09-21T01:14:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.137+0000 7fceddff9640 1 Processor -- start 2024-09-21T01:14:45.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.137+0000 7fceddff9640 1 -- start start 2024-09-21T01:14:45.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fceddff9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8102ae0 0x7fced81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fceddff9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81083d0 0x7fced8199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fceddff9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fced8108d20 0x7fced819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fceddff9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fced81129e0 con 0x7fced81083d0 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fceddff9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fced8112860 con 0x7fced8102ae0 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fceddff9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fced8112b60 con 0x7fced8108d20 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced77fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8102ae0 0x7fced81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced77fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8102ae0 0x7fced81993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:53862/0 (socket says 172.21.15.148:53862) 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced77fe640 1 -- 172.21.15.148:0/58188330 learned_addr learned my addr 172.21.15.148:0/58188330 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced7fff640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fced8108d20 0x7fced819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced6ffd640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81083d0 0x7fced8199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced7fff640 1 -- 172.21.15.148:0/58188330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8102ae0 msgr2=0x7fced81993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced7fff640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8102ae0 0x7fced81993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced7fff640 1 -- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81083d0 msgr2=0x7fced8199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced7fff640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81083d0 0x7fced8199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced7fff640 1 -- 172.21.15.148:0/58188330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced819f320 con 0x7fced8108d20 2024-09-21T01:14:45.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.138+0000 7fced6ffd640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81083d0 0x7fced8199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.139+0000 7fced77fe640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8102ae0 0x7fced81993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.139+0000 7fced7fff640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fced8108d20 0x7fced819ebf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fced0009fd0 tx=0x7fced000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.139+0000 7fced4ff9640 1 -- 172.21.15.148:0/58188330 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced000ce20 con 0x7fced8108d20 2024-09-21T01:14:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.139+0000 7fced4ff9640 1 -- 172.21.15.148:0/58188330 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced0005020 con 0x7fced8108d20 2024-09-21T01:14:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.139+0000 7fceddff9640 1 -- 172.21.15.148:0/58188330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced819f610 con 0x7fced8108d20 2024-09-21T01:14:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.140+0000 7fced4ff9640 1 -- 172.21.15.148:0/58188330 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0010690 con 0x7fced8108d20 2024-09-21T01:14:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.140+0000 7fceddff9640 1 -- 172.21.15.148:0/58188330 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced806bae0 con 0x7fced8108d20 2024-09-21T01:14:45.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.144+0000 7fcee456d740 1 Processor -- start 2024-09-21T01:14:45.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.145+0000 7fced4ff9640 1 -- 172.21.15.148:0/58188330 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7fced00054d0 con 0x7fced8108d20 2024-09-21T01:14:45.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.145+0000 7fcee456d740 1 -- start start 2024-09-21T01:14:45.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fcee456d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca05d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fcee456d740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c8d490 0x5558ca05d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fcee456d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c95670 0x5558ca05deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fcee456d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5558c9fd3e60 con 0x5558c9cb6350 2024-09-21T01:14:45.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fcee456d740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5558c9fc3290 con 0x5558c9c8d490 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fcee456d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5558c9fc70a0 con 0x5558c9c95670 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fced6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca05d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fced77fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c8d490 0x5558ca05d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fced6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca05d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57624/0 (socket says 172.21.15.148:57624) 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fced6ffd640 1 -- 172.21.15.148:0/2034218452 learned_addr learned my addr 172.21.15.148:0/2034218452 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fced77fe640 1 -- 172.21.15.148:0/2034218452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c95670 msgr2=0x5558ca05deb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fced77fe640 1 --2- 172.21.15.148:0/2034218452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c95670 0x5558ca05deb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.146+0000 7fced77fe640 1 -- 172.21.15.148:0/2034218452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 msgr2=0x5558ca05d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.147+0000 7fced77fe640 1 --2- 172.21.15.148:0/2034218452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca05d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.147+0000 7fced77fe640 1 -- 172.21.15.148:0/2034218452 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c9d21930 con 0x5558c9c8d490 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.147+0000 7fced6ffd640 1 --2- 172.21.15.148:0/2034218452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca05d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.147+0000 7fced77fe640 1 --2- 172.21.15.148:0/2034218452 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c8d490 0x5558ca05d970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcec80114f0 tx=0x7fcec80119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69d74bfbc41f5e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.147+0000 7fcebdffb640 1 -- 172.21.15.148:0/2034218452 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec801e070 con 0x5558c9c8d490 2024-09-21T01:14:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.147+0000 7fcebdffb640 1 -- 172.21.15.148:0/2034218452 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec80035f0 con 0x5558c9c8d490 2024-09-21T01:14:45.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.147+0000 7fcebdffb640 1 -- 172.21.15.148:0/2034218452 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec800f820 con 0x5558c9c8d490 2024-09-21T01:14:45.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.147+0000 7fced4ff9640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcec00b6620 0x7fcec00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.148+0000 7fced6ffd640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcec00b6620 0x7fcec00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.148+0000 7fced4ff9640 1 -- 172.21.15.148:0/58188330 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fced00e7b70 con 0x7fced8108d20 2024-09-21T01:14:45.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.148+0000 7fced6ffd640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcec00b6620 0x7fcec00b8b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcecc031440 tx=0x7fcecc009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:45.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.148+0000 7fcee456d740 1 -- 172.21.15.148:0/2034218452 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c8d490 msgr2=0x5558ca05d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.148+0000 7fcee456d740 1 --2- 172.21.15.148:0/2034218452 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c8d490 0x5558ca05d970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcec80114f0 tx=0x7fcec80119b0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.148+0000 7fcee456d740 1 -- 172.21.15.148:0/2034218452 shutdown_connections 2024-09-21T01:14:45.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.148+0000 7fcee456d740 1 --2- 172.21.15.148:0/2034218452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c95670 0x5558ca05deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.149+0000 7fcee456d740 1 --2- 172.21.15.148:0/2034218452 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c8d490 0x5558ca05d970 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.149+0000 7fcee456d740 1 --2- 172.21.15.148:0/2034218452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca05d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.149+0000 7fcee456d740 1 -- 172.21.15.148:0/2034218452 >> 172.21.15.148:0/2034218452 conn(0x5558c9caa740 msgr2=0x5558ca05b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:45.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.149+0000 7fcee456d740 1 -- 172.21.15.148:0/2034218452 shutdown_connections 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.149+0000 7fcee456d740 1 -- 172.21.15.148:0/2034218452 wait complete. 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.149+0000 7fcee456d740 1 -- start start 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fcee456d740 1 Processor -- start 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fcee456d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c8d490 0x5558ca068ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fcee456d740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 0x5558ca069530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fcee456d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9cb6350 0x5558ca074f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fcee456d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5558c9e24890 con 0x5558c9c8d490 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fcee456d740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5558c9f5dd40 con 0x5558c9c95670 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fcee456d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5558ca06bc10 con 0x5558c9cb6350 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fced77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c8d490 0x5558ca068ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fcee456d740 10 client.0 _ll_register_callbacks cb 0x5558c9fc1c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fced77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c8d490 0x5558ca068ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57638/0 (socket says 172.21.15.148:57638) 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fced77fe640 1 -- 172.21.15.148:0/2934746111 learned_addr learned my addr 172.21.15.148:0/2934746111 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:45.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.150+0000 7fced6ffd640 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 0x5558ca069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.151+0000 7fced77fe640 1 -- 172.21.15.148:0/2934746111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9cb6350 msgr2=0x5558ca074f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:45.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.151+0000 7fced77fe640 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9cb6350 0x5558ca074f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.151+0000 7fced77fe640 1 -- 172.21.15.148:0/2934746111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 msgr2=0x5558ca069530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:45.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.151+0000 7fced77fe640 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 0x5558ca069530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.151+0000 7fced77fe640 1 -- 172.21.15.148:0/2934746111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558ca0754a0 con 0x5558c9c8d490 2024-09-21T01:14:45.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.151+0000 7fced6ffd640 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 0x5558ca069530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:45.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.151+0000 7fced77fe640 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c8d490 0x5558ca068ff0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcec8005e00 tx=0x7fcec8004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0a6e0a2555ac9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:45.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.151+0000 7fceb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:45.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.151+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2934746111 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8027020 con 0x5558c9c8d490 2024-09-21T01:14:45.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.152+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2934746111 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fcec8005040 con 0x5558c9c8d490 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.152+0000 7fcee456d740 1 -- 172.21.15.148:0/2934746111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec80035f0 con 0x5558c9c8d490 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.152+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2934746111 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcec801e070 con 0x5558c9c8d490 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.152+0000 7fcee456d740 10 client.15567 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.152+0000 7fcee456d740 1 -- 172.21.15.148:0/2934746111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5558ca077dd0 con 0x5558c9c8d490 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.152+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2934746111 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec80035f0 con 0x5558c9c8d490 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.153+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2934746111 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcec800f5c0 con 0x5558c9c8d490 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.153+0000 7fcee456d740 10 client.15567 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.153+0000 7fcee456d740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.153+0000 7fcee456d740 20 client.15567 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.153+0000 7fcee456d740 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5558c9c74cd0 0x5558ca07b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.153+0000 7fcee456d740 4 client.15567 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.153+0000 7fcee456d740 1 -- 172.21.15.148:0/2934746111 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558c9fd5db0 con 0x5558c9c74cd0 2024-09-21T01:14:45.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.153+0000 7fced6ffd640 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5558c9c74cd0 0x5558ca07b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.154+0000 7fceb6ffd640 10 client.15567 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:45.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.154+0000 7fced6ffd640 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5558c9c74cd0 0x5558ca07b5f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2c1a33e22c01c8 server_cookie=57d63111ff07c5e6 in_seq=0 out_seq=0 2024-09-21T01:14:45.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2934746111 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5558c9fd5db0 con 0x5558c9c74cd0 2024-09-21T01:14:45.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fceb6ffd640 10 client.15567 handle_command_reply: tid=0 2024-09-21T01:14:45.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 client.15567 shutdown 2024-09-21T01:14:45.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 -- 172.21.15.148:0/2934746111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c8d490 msgr2=0x5558ca068ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c8d490 0x5558ca068ff0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcec8005e00 tx=0x7fcec8004200 comp rx=0 tx=0).stop 2024-09-21T01:14:45.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 -- 172.21.15.148:0/2934746111 shutdown_connections 2024-09-21T01:14:45.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5558c9c74cd0 0x5558ca07b5f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9cb6350 0x5558ca074f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 0x5558ca069530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 --2- 172.21.15.148:0/2934746111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c8d490 0x5558ca068ff0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 -- 172.21.15.148:0/2934746111 >> 172.21.15.148:0/2934746111 conn(0x5558c9caa740 msgr2=0x5558ca060610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:45.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fceb6ffd640 0 client.15567 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:45.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 -- 172.21.15.148:0/2934746111 shutdown_connections 2024-09-21T01:14:45.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.155+0000 7fcee456d740 1 -- 172.21.15.148:0/2934746111 wait complete. 2024-09-21T01:14:45.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.156+0000 7fcee456d740 20 client.15567 trim_cache size 0 max 16384 2024-09-21T01:14:45.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.189+0000 7fcee456d740 1 Processor -- start 2024-09-21T01:14:45.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fcee456d740 1 -- start start 2024-09-21T01:14:45.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fcee456d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 0x5558ca074e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fcee456d740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 0x5558ca063550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fcee456d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fcee456d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fced81b3f20 con 0x5558c9cb6350 2024-09-21T01:14:45.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fcee456d740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fced81b17f0 con 0x5558c9c95670 2024-09-21T01:14:45.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fcee456d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fced81af640 con 0x5558c9c8d490 2024-09-21T01:14:45.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fced7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fced6ffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 0x5558ca063550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fced7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca065fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57642/0 (socket says 172.21.15.148:57642) 2024-09-21T01:14:45.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.190+0000 7fced7fff640 1 -- 172.21.15.148:0/920617467 learned_addr learned my addr 172.21.15.148:0/920617467 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:45.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.191+0000 7fced77fe640 1 --2- 172.21.15.148:0/920617467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 0x5558ca074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.191+0000 7fced77fe640 1 -- 172.21.15.148:0/920617467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 msgr2=0x5558ca063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:45.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.191+0000 7fced77fe640 1 --2- 172.21.15.148:0/920617467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 0x5558ca063550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.191+0000 7fced77fe640 1 -- 172.21.15.148:0/920617467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 msgr2=0x5558ca065fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:45.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.191+0000 7fced77fe640 1 --2- 172.21.15.148:0/920617467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca065fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.191+0000 7fced77fe640 1 -- 172.21.15.148:0/920617467 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558ca060290 con 0x5558c9c8d490 2024-09-21T01:14:45.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.191+0000 7fced77fe640 1 --2- 172.21.15.148:0/920617467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 0x5558ca074e30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcec800fbd0 tx=0x7fcec80042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8e41e100d559b0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:45.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.192+0000 7fcebd7fa640 1 -- 172.21.15.148:0/920617467 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8027040 con 0x5558c9c8d490 2024-09-21T01:14:45.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.192+0000 7fcebd7fa640 1 -- 172.21.15.148:0/920617467 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec801f040 con 0x5558c9c8d490 2024-09-21T01:14:45.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.192+0000 7fcebd7fa640 1 -- 172.21.15.148:0/920617467 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec800f820 con 0x5558c9c8d490 2024-09-21T01:14:45.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.193+0000 7fcee456d740 1 -- 172.21.15.148:0/920617467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 msgr2=0x5558ca074e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.193+0000 7fcee456d740 1 --2- 172.21.15.148:0/920617467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 0x5558ca074e30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcec800fbd0 tx=0x7fcec80042f0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.193+0000 7fcee456d740 1 -- 172.21.15.148:0/920617467 shutdown_connections 2024-09-21T01:14:45.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.193+0000 7fcee456d740 1 --2- 172.21.15.148:0/920617467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9cb6350 0x5558ca065fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.193+0000 7fcee456d740 1 --2- 172.21.15.148:0/920617467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9c95670 0x5558ca063550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.193+0000 7fcee456d740 1 --2- 172.21.15.148:0/920617467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 0x5558ca074e30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.193+0000 7fcee456d740 1 -- 172.21.15.148:0/920617467 >> 172.21.15.148:0/920617467 conn(0x5558c9caa740 msgr2=0x5558ca067670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:45.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.194+0000 7fcee456d740 1 -- 172.21.15.148:0/920617467 shutdown_connections 2024-09-21T01:14:45.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.194+0000 7fcee456d740 1 -- 172.21.15.148:0/920617467 wait complete. 2024-09-21T01:14:45.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.194+0000 7fcee456d740 1 -- start start 2024-09-21T01:14:45.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.194+0000 7fcee456d740 1 Processor -- start 2024-09-21T01:14:45.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fcee456d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 0x5558ca0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fcee456d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c95670 0x5558ca06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fcee456d740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9cb6350 0x5558ca06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fcee456d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fced81afcb0 con 0x5558c9c95670 2024-09-21T01:14:45.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fcee456d740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fced81b1120 con 0x5558c9cb6350 2024-09-21T01:14:45.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fcee456d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fced81b0380 con 0x5558c9c8d490 2024-09-21T01:14:45.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fcee456d740 10 client.0 _ll_register_callbacks cb 0x7fcec801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:45.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fced6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c95670 0x5558ca06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fced7fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9cb6350 0x5558ca06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fced7fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9cb6350 0x5558ca06cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:53908/0 (socket says 172.21.15.148:53908) 2024-09-21T01:14:45.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.195+0000 7fced7fff640 1 -- 172.21.15.148:0/2705184562 learned_addr learned my addr 172.21.15.148:0/2705184562 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:45.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fced77fe640 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 0x5558ca0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fced7fff640 1 -- 172.21.15.148:0/2705184562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 msgr2=0x5558ca0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fced7fff640 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 0x5558ca0714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fced7fff640 1 -- 172.21.15.148:0/2705184562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c95670 msgr2=0x5558ca06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fced7fff640 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c95670 0x5558ca06c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fced7fff640 1 -- 172.21.15.148:0/2705184562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558ca06d4f0 con 0x5558c9cb6350 2024-09-21T01:14:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fced7fff640 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9cb6350 0x5558ca06cf00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fced0005820 tx=0x7fced00adaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=289d04b916ceb56f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fceb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-09-21T01:14:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2705184562 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced00b2070 con 0x5558c9cb6350 2024-09-21T01:14:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2705184562 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fced00b2410 con 0x5558c9cb6350 2024-09-21T01:14:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.196+0000 7fcee456d740 1 -- 172.21.15.148:0/2705184562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec801f040 con 0x5558c9cb6350 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.197+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2705184562 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fced00c8050 con 0x5558c9cb6350 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.197+0000 7fcee456d740 10 client.25214 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.197+0000 7fcee456d740 1 -- 172.21.15.148:0/2705184562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5558ca0e5df0 con 0x5558c9cb6350 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.197+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2705184562 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec801f040 con 0x5558c9cb6350 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.198+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2705184562 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fced00cfbc0 con 0x5558c9cb6350 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.198+0000 7fcee456d740 10 client.25214 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.198+0000 7fcee456d740 10 client.25214 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.198+0000 7fcee456d740 20 client.25214 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.198+0000 7fcee456d740 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5558c9c4a080 0x5558ca0e8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.198+0000 7fcee456d740 4 client.25214 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.198+0000 7fcee456d740 1 -- 172.21.15.148:0/2705184562 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5558c9fd1860 con 0x5558c9c4a080 2024-09-21T01:14:45.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.198+0000 7fced77fe640 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5558c9c4a080 0x5558ca0e8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.199+0000 7fced77fe640 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5558c9c4a080 0x5558ca0e8520 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed7c5fb04aeec042 server_cookie=3533b998d8edab19 in_seq=0 out_seq=0 2024-09-21T01:14:45.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.199+0000 7fceb6ffd640 10 client.25214 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:45.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.200+0000 7fceb6ffd640 1 -- 172.21.15.148:0/2705184562 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5558c9fd1860 con 0x5558c9c4a080 2024-09-21T01:14:45.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.200+0000 7fceb6ffd640 10 client.25214 handle_command_reply: tid=0 2024-09-21T01:14:45.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.200+0000 7fcee456d740 1 client.25214 shutdown 2024-09-21T01:14:45.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 1 -- 172.21.15.148:0/2705184562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9cb6350 msgr2=0x5558ca06cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9cb6350 0x5558ca06cf00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fced0005820 tx=0x7fced00adaa0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 1 -- 172.21.15.148:0/2705184562 shutdown_connections 2024-09-21T01:14:45.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5558c9c4a080 0x5558ca0e8520 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5558c9c95670 0x5558ca06c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fceb6ffd640 0 client.25214 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:45.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5558c9cb6350 0x5558ca06cf00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 1 --2- 172.21.15.148:0/2705184562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558c9c8d490 0x5558ca0714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 1 -- 172.21.15.148:0/2705184562 >> 172.21.15.148:0/2705184562 conn(0x5558c9caa740 msgr2=0x5558ca067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:45.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 1 -- 172.21.15.148:0/2705184562 shutdown_connections 2024-09-21T01:14:45.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 1 -- 172.21.15.148:0/2705184562 wait complete. 2024-09-21T01:14:45.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.201+0000 7fcee456d740 20 client.25214 trim_cache size 0 max 16384 2024-09-21T01:14:45.203 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:14:45.203 INFO:teuthology.orchestra.run.smithi148.stdout: "return_code": 0, 2024-09-21T01:14:45.203 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_tag": "0705e125-8af9-4cc6-98ec-fca2de415bde", 2024-09-21T01:14:45.203 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": "asynchronous" 2024-09-21T01:14:45.204 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:14:45.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.202+0000 7fceddff9640 1 -- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcec00b6620 msgr2=0x7fcec00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.202+0000 7fceddff9640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcec00b6620 0x7fcec00b8b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcecc031440 tx=0x7fcecc009560 comp rx=0 tx=0).stop 2024-09-21T01:14:45.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.202+0000 7fceddff9640 1 -- 172.21.15.148:0/58188330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fced8108d20 msgr2=0x7fced819ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.202+0000 7fceddff9640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fced8108d20 0x7fced819ebf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fced0009fd0 tx=0x7fced000ef10 comp rx=0 tx=0).stop 2024-09-21T01:14:45.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.202+0000 7fceddff9640 1 -- 172.21.15.148:0/58188330 shutdown_connections 2024-09-21T01:14:45.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.202+0000 7fceddff9640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcec00b6620 0x7fcec00b8b30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.202+0000 7fceddff9640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81083d0 0x7fced8199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.202+0000 7fceddff9640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fced8108d20 0x7fced819ebf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.202+0000 7fceddff9640 1 --2- 172.21.15.148:0/58188330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8102ae0 0x7fced81993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.202+0000 7fceddff9640 1 -- 172.21.15.148:0/58188330 >> 172.21.15.148:0/58188330 conn(0x7fced8079760 msgr2=0x7fced8104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:45.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.203+0000 7fceddff9640 1 -- 172.21.15.148:0/58188330 shutdown_connections 2024-09-21T01:14:45.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:45.203+0000 7fceddff9640 1 -- 172.21.15.148:0/58188330 wait complete. 2024-09-21T01:14:45.884 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:14:46.169 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:46.298 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:46 smithi148 ceph-mon[31000]: pgmap v361: 97 pgs: 97 active+clean; 671 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-21T01:14:46.298 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:46 smithi148 ceph-mon[31000]: scrub queued for path: / 2024-09-21T01:14:46.298 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:46 smithi148 ceph-mon[31000]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:46.298 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:46 smithi148 ceph-mon[31000]: scrub summary: active paths [/] 2024-09-21T01:14:46.298 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:46 smithi148 ceph-mon[31000]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:46 smithi181 ceph-mon[34811]: pgmap v361: 97 pgs: 97 active+clean; 671 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-21T01:14:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:46 smithi181 ceph-mon[34811]: scrub queued for path: / 2024-09-21T01:14:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:46 smithi181 ceph-mon[34811]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:46 smithi181 ceph-mon[34811]: scrub summary: active paths [/] 2024-09-21T01:14:46.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:46 smithi181 ceph-mon[34811]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:46 smithi157 ceph-mon[34140]: pgmap v361: 97 pgs: 97 active+clean; 671 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-21T01:14:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:46 smithi157 ceph-mon[34140]: scrub queued for path: / 2024-09-21T01:14:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:46 smithi157 ceph-mon[34140]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:46.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:46 smithi157 ceph-mon[34140]: scrub summary: active paths [/] 2024-09-21T01:14:46.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:46 smithi157 ceph-mon[34140]: scrub summary: idle+waiting paths [/] 2024-09-21T01:14:46.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.709+0000 7f0be038f640 1 -- 172.21.15.148:0/1537006499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bd8105ae0 msgr2=0x7f0bd810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.709+0000 7f0be038f640 1 --2- 172.21.15.148:0/1537006499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bd8105ae0 0x7f0bd810f530 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009ca0 tx=0x7f0bd002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.709+0000 7f0be038f640 1 -- 172.21.15.148:0/1537006499 shutdown_connections 2024-09-21T01:14:46.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.709+0000 7f0be038f640 1 --2- 172.21.15.148:0/1537006499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bd8105ae0 0x7f0bd810f530 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.709+0000 7f0be038f640 1 --2- 172.21.15.148:0/1537006499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd8105190 0x7f0bd81055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.709+0000 7f0be038f640 1 --2- 172.21.15.148:0/1537006499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bd81031c0 0x7f0bd81035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.709+0000 7f0be038f640 1 -- 172.21.15.148:0/1537006499 >> 172.21.15.148:0/1537006499 conn(0x7f0bd8077c60 msgr2=0x7f0bd80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.709+0000 7f0be038f640 1 -- 172.21.15.148:0/1537006499 shutdown_connections 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.709+0000 7f0be038f640 1 -- 172.21.15.148:0/1537006499 wait complete. 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.710+0000 7f0be038f640 1 Processor -- start 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.710+0000 7f0be038f640 1 -- start start 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0be038f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd81031c0 0x7f0bd819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0be038f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bd8105190 0x7f0bd819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0be038f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bd8105ae0 0x7f0bd819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0bdd92a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bd8105190 0x7f0bd819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0bdd92a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bd8105190 0x7f0bd819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43244/0 (socket says 172.21.15.148:43244) 2024-09-21T01:14:46.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0bdd92a640 1 -- 172.21.15.148:0/2870545257 learned_addr learned my addr 172.21.15.148:0/2870545257 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8113aa0 con 0x7f0bd8105190 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8113920 con 0x7f0bd8105ae0 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8113c20 con 0x7f0bd81031c0 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0bde12b640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd81031c0 0x7f0bd819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.711+0000 7f0bde92c640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bd8105ae0 0x7f0bd819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0bdd92a640 1 -- 172.21.15.148:0/2870545257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd81031c0 msgr2=0x7f0bd819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd81031c0 0x7f0bd819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0bdd92a640 1 -- 172.21.15.148:0/2870545257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bd8105ae0 msgr2=0x7f0bd819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bd8105ae0 0x7f0bd819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0bdd92a640 1 -- 172.21.15.148:0/2870545257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd81a0440 con 0x7f0bd8105190 2024-09-21T01:14:46.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bd8105190 0x7f0bd819aa70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800d740 tx=0x7f0bc800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0bcf7fe640 1 -- 172.21.15.148:0/2870545257 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8017070 con 0x7f0bd8105190 2024-09-21T01:14:46.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0bcf7fe640 1 -- 172.21.15.148:0/2870545257 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bc800de50 con 0x7f0bd8105190 2024-09-21T01:14:46.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0bcf7fe640 1 -- 172.21.15.148:0/2870545257 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8004ce0 con 0x7f0bd8105190 2024-09-21T01:14:46.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd81a0730 con 0x7f0bd8105190 2024-09-21T01:14:46.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.712+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd81a6e90 con 0x7f0bd8105190 2024-09-21T01:14:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.715+0000 7f0bcf7fe640 1 -- 172.21.15.148:0/2870545257 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f0bc8004e80 con 0x7f0bd8105190 2024-09-21T01:14:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.716+0000 7f0be6903740 1 Processor -- start 2024-09-21T01:14:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.716+0000 7f0be6903740 1 -- start start 2024-09-21T01:14:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.716+0000 7f0be6903740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a357c070 0x5583a3923650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0be6903740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a35531b0 0x5583a3923b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0be6903740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39240d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0be6903740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5583a3899e50 con 0x5583a355b390 2024-09-21T01:14:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0be6903740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5583a3889280 con 0x5583a357c070 2024-09-21T01:14:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0be6903740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5583a388d090 con 0x5583a35531b0 2024-09-21T01:14:46.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0bcf7fe640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0bc40b6620 0x7f0bc40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0bcf7fe640 1 -- 172.21.15.148:0/2870545257 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f0bc80e6d20 con 0x7f0bd8105190 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0bde12b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a35531b0 0x5583a3923b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0bde12b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a35531b0 0x5583a3923b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:50398/0 (socket says 172.21.15.148:50398) 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0bde12b640 1 -- 172.21.15.148:0/1244701813 learned_addr learned my addr 172.21.15.148:0/1244701813 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.717+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/1244701813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39240d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.718+0000 7f0bde92c640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0bc40b6620 0x7f0bc40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.718+0000 7f0bdd92a640 1 -- 172.21.15.148:0/1244701813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a35531b0 msgr2=0x5583a3923b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.718+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/1244701813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a35531b0 0x5583a3923b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.718+0000 7f0bdd92a640 1 -- 172.21.15.148:0/1244701813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a357c070 msgr2=0x5583a3923650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.718+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/1244701813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a357c070 0x5583a3923650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.718+0000 7f0bdd92a640 1 -- 172.21.15.148:0/1244701813 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a35e7650 con 0x5583a355b390 2024-09-21T01:14:46.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.718+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/1244701813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39240d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80e4680 tx=0x7f0bc80a9480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0ec9b3e37fd4a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.718+0000 7f0bccd9a640 1 -- 172.21.15.148:0/1244701813 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8020050 con 0x5583a355b390 2024-09-21T01:14:46.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.718+0000 7f0bccd9a640 1 -- 172.21.15.148:0/1244701813 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bc80b2cf0 con 0x5583a355b390 2024-09-21T01:14:46.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.718+0000 7f0bccd9a640 1 -- 172.21.15.148:0/1244701813 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8092bd0 con 0x5583a355b390 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.719+0000 7f0be6903740 1 -- 172.21.15.148:0/1244701813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 msgr2=0x5583a39240d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.719+0000 7f0be6903740 1 --2- 172.21.15.148:0/1244701813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39240d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80e4680 tx=0x7f0bc80a9480 comp rx=0 tx=0).stop 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.719+0000 7f0bde92c640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0bc40b6620 0x7f0bc40b8b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0006010 tx=0x7f0bd00093e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.719+0000 7f0be6903740 1 -- 172.21.15.148:0/1244701813 shutdown_connections 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.720+0000 7f0be6903740 1 --2- 172.21.15.148:0/1244701813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39240d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.720+0000 7f0be6903740 1 --2- 172.21.15.148:0/1244701813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a35531b0 0x5583a3923b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.720+0000 7f0be6903740 1 --2- 172.21.15.148:0/1244701813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a357c070 0x5583a3923650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.720+0000 7f0be6903740 1 -- 172.21.15.148:0/1244701813 >> 172.21.15.148:0/1244701813 conn(0x5583a3570460 msgr2=0x5583a3921540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.720+0000 7f0be6903740 1 -- 172.21.15.148:0/1244701813 shutdown_connections 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.720+0000 7f0be6903740 1 -- 172.21.15.148:0/1244701813 wait complete. 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.720+0000 7f0be6903740 1 -- start start 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.721+0000 7f0be6903740 1 Processor -- start 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.721+0000 7f0be6903740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a35531b0 0x5583a392ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.721+0000 7f0be6903740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a355b390 0x5583a392f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.721+0000 7f0be6903740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a357c070 0x5583a393f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.721+0000 7f0bde92c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a357c070 0x5583a393f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.721+0000 7f0bde92c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a357c070 0x5583a393f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43270/0 (socket says 172.21.15.148:43270) 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.721+0000 7f0bde12b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a35531b0 0x5583a392ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.721+0000 7f0bde12b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a35531b0 0x5583a392ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:59096/0 (socket says 172.21.15.148:59096) 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0bdd92a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a355b390 0x5583a392f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0bde92c640 1 -- 172.21.15.148:0/2980609325 learned_addr learned my addr 172.21.15.148:0/2980609325 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5583a36ea700 con 0x5583a357c070 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5583a3824110 con 0x5583a35531b0 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5583a39361e0 con 0x5583a355b390 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0be6903740 10 client.0 _ll_register_callbacks cb 0x5583a383d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0bde92c640 1 -- 172.21.15.148:0/2980609325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a355b390 msgr2=0x5583a392f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0bde92c640 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a355b390 0x5583a392f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0bde92c640 1 -- 172.21.15.148:0/2980609325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a35531b0 msgr2=0x5583a392ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0bde92c640 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a35531b0 0x5583a392ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0bde92c640 1 -- 172.21.15.148:0/2980609325 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a3851c40 con 0x5583a357c070 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a355b390 0x5583a392f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0bde92c640 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a357c070 0x5583a393f4d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00316d0 tx=0x7f0bd002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5b76fab45346c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.722+0000 7f0bc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.723+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2980609325 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd004e070 con 0x5583a357c070 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.723+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2980609325 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f0bd0004240 con 0x5583a357c070 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.723+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc80b2cf0 con 0x5583a357c070 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.723+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2980609325 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0bd0031910 con 0x5583a357c070 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.723+0000 7f0be6903740 10 client.15585 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.723+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5583a3941e50 con 0x5583a357c070 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.723+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2980609325 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bd002f660 con 0x5583a357c070 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.724+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2980609325 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0bd0043040 con 0x5583a357c070 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.724+0000 7f0be6903740 10 client.15585 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.724+0000 7f0be6903740 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.724+0000 7f0be6903740 20 client.15585 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.724+0000 7f0be6903740 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5583a353a9f0 0x5583a3945320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.724+0000 7f0be6903740 4 client.15585 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:46.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.724+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0bc80b2cf0 con 0x5583a353a9f0 2024-09-21T01:14:46.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.724+0000 7f0bde12b640 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5583a353a9f0 0x5583a3945320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.725+0000 7f0bde12b640 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5583a353a9f0 0x5583a3945320 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec66c9f76f13ccab server_cookie=aed4ee837f9cfd09 in_seq=0 out_seq=0 2024-09-21T01:14:46.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.725+0000 7f0bc1ffb640 10 client.15585 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:46.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.725+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2980609325 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f0bc80b2cf0 con 0x5583a353a9f0 2024-09-21T01:14:46.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.725+0000 7f0bc1ffb640 10 client.15585 handle_command_reply: tid=0 2024-09-21T01:14:46.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.725+0000 7f0be6903740 1 client.15585 shutdown 2024-09-21T01:14:46.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a357c070 msgr2=0x5583a393f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a357c070 0x5583a393f4d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00316d0 tx=0x7f0bd002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 shutdown_connections 2024-09-21T01:14:46.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5583a353a9f0 0x5583a3945320 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a357c070 0x5583a393f4d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a355b390 0x5583a392f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 1 --2- 172.21.15.148:0/2980609325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a35531b0 0x5583a392ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 >> 172.21.15.148:0/2980609325 conn(0x5583a3570460 msgr2=0x5583a3924680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:46.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0bc1ffb640 0 client.15585 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:46.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 shutdown_connections 2024-09-21T01:14:46.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 1 -- 172.21.15.148:0/2980609325 wait complete. 2024-09-21T01:14:46.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.726+0000 7f0be6903740 20 client.15585 trim_cache size 0 max 16384 2024-09-21T01:14:46.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.744+0000 7f0be6903740 1 Processor -- start 2024-09-21T01:14:46.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.744+0000 7f0be6903740 1 -- start start 2024-09-21T01:14:46.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0be6903740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a35531b0 0x5583a39308e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0be6903740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a355b390 0x5583a3920b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0be6903740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 0x5583a39210b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0be6903740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81afab0 con 0x5583a35531b0 2024-09-21T01:14:46.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0be6903740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81ad380 con 0x5583a355b390 2024-09-21T01:14:46.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0be6903740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81ab1d0 con 0x5583a357c070 2024-09-21T01:14:46.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0bde12b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a35531b0 0x5583a39308e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0bde12b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a35531b0 0x5583a39308e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43280/0 (socket says 172.21.15.148:43280) 2024-09-21T01:14:46.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0bde12b640 1 -- 172.21.15.148:0/2200657144 learned_addr learned my addr 172.21.15.148:0/2200657144 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:46.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/2200657144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a355b390 0x5583a3920b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0bde92c640 1 --2- 172.21.15.148:0/2200657144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 0x5583a39210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0bde12b640 1 -- 172.21.15.148:0/2200657144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 msgr2=0x5583a39210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:46.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0bde12b640 1 --2- 172.21.15.148:0/2200657144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 0x5583a39210b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0bde12b640 1 -- 172.21.15.148:0/2200657144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a355b390 msgr2=0x5583a3920b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:46.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0bde12b640 1 --2- 172.21.15.148:0/2200657144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a355b390 0x5583a3920b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.745+0000 7f0bde12b640 1 -- 172.21.15.148:0/2200657144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a3929980 con 0x5583a35531b0 2024-09-21T01:14:46.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.746+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/2200657144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a355b390 0x5583a3920b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:46.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.746+0000 7f0bde12b640 1 --2- 172.21.15.148:0/2200657144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a35531b0 0x5583a39308e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4005fd0 tx=0x7f0bd400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940064b4fba81ead server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.746+0000 7f0bc3fff640 1 -- 172.21.15.148:0/2200657144 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4004220 con 0x5583a35531b0 2024-09-21T01:14:46.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.746+0000 7f0bc3fff640 1 -- 172.21.15.148:0/2200657144 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bd40043c0 con 0x5583a35531b0 2024-09-21T01:14:46.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.746+0000 7f0bc3fff640 1 -- 172.21.15.148:0/2200657144 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd401da60 con 0x5583a35531b0 2024-09-21T01:14:46.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.747+0000 7f0be6903740 1 -- 172.21.15.148:0/2200657144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a35531b0 msgr2=0x5583a39308e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.747+0000 7f0be6903740 1 --2- 172.21.15.148:0/2200657144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a35531b0 0x5583a39308e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4005fd0 tx=0x7f0bd400b410 comp rx=0 tx=0).stop 2024-09-21T01:14:46.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.747+0000 7f0be6903740 1 -- 172.21.15.148:0/2200657144 shutdown_connections 2024-09-21T01:14:46.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.747+0000 7f0be6903740 1 --2- 172.21.15.148:0/2200657144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 0x5583a39210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.747+0000 7f0be6903740 1 --2- 172.21.15.148:0/2200657144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a355b390 0x5583a3920b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.747+0000 7f0be6903740 1 --2- 172.21.15.148:0/2200657144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a35531b0 0x5583a39308e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.747+0000 7f0be6903740 1 -- 172.21.15.148:0/2200657144 >> 172.21.15.148:0/2200657144 conn(0x5583a3570460 msgr2=0x5583a39301d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.747+0000 7f0be6903740 1 -- 172.21.15.148:0/2200657144 shutdown_connections 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.747+0000 7f0be6903740 1 -- 172.21.15.148:0/2200657144 wait complete. 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.748+0000 7f0be6903740 1 -- start start 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.748+0000 7f0be6903740 1 Processor -- start 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0be6903740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39377f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0be6903740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 0x5583a3937d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0be6903740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a350fda0 0x5583a39aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0be6903740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81ab840 con 0x5583a355b390 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bde12b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bde12b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39377f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43288/0 (socket says 172.21.15.148:43288) 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bde12b640 1 -- 172.21.15.148:0/2241295143 learned_addr learned my addr 172.21.15.148:0/2241295143 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0be6903740 1 -- 172.21.15.148:0/2241295143 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81accb0 con 0x5583a350fda0 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0be6903740 1 -- 172.21.15.148:0/2241295143 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81abf10 con 0x5583a357c070 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bde92c640 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a350fda0 0x5583a39aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 0x5583a3937d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0be6903740 10 client.0 _ll_register_callbacks cb 0x7f0bd00098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bdd92a640 1 -- 172.21.15.148:0/2241295143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a350fda0 msgr2=0x5583a39aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a350fda0 0x5583a39aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bdd92a640 1 -- 172.21.15.148:0/2241295143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 msgr2=0x5583a39377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:46.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39377f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bdd92a640 1 -- 172.21.15.148:0/2241295143 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a39af220 con 0x5583a357c070 2024-09-21T01:14:46.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bde92c640 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a350fda0 0x5583a39aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:46.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.749+0000 7f0bde12b640 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:46.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.750+0000 7f0bdd92a640 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 0x5583a3937d50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80e4680 tx=0x7f0bc80a9250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19c7b59c25a9f0d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.750+0000 7f0bc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-21T01:14:46.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.750+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2241295143 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8020040 con 0x5583a357c070 2024-09-21T01:14:46.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.750+0000 7f0be6903740 1 -- 172.21.15.148:0/2241295143 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bd40043c0 con 0x5583a357c070 2024-09-21T01:14:46.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.750+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2241295143 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f0bc80940b0 con 0x5583a357c070 2024-09-21T01:14:46.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.750+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2241295143 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0bc80b2cf0 con 0x5583a357c070 2024-09-21T01:14:46.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.750+0000 7f0be6903740 10 client.25195 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:46.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.750+0000 7f0be6903740 1 -- 172.21.15.148:0/2241295143 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5583a39b0320 con 0x5583a357c070 2024-09-21T01:14:46.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.751+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2241295143 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bd40043c0 con 0x5583a357c070 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.751+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2241295143 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0bc8092c60 con 0x5583a357c070 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.751+0000 7f0be6903740 10 client.25195 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.751+0000 7f0be6903740 10 client.25195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.751+0000 7f0be6903740 20 client.25195 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.751+0000 7f0be6903740 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5583a39b05c0 0x5583a39b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.751+0000 7f0be6903740 4 client.25195 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.751+0000 7f0be6903740 1 -- 172.21.15.148:0/2241295143 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5583a389bda0 con 0x5583a39b05c0 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.751+0000 7f0bde12b640 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5583a39b05c0 0x5583a39b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0bde12b640 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5583a39b05c0 0x5583a39b29e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4720376c0be4fce server_cookie=19b84e44bf544afb in_seq=0 out_seq=0 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0bc1ffb640 10 client.25195 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0bc1ffb640 1 -- 172.21.15.148:0/2241295143 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x5583a389bda0 con 0x5583a39b05c0 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0bc1ffb640 10 client.25195 handle_command_reply: tid=0 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0be6903740 1 client.25195 shutdown 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0be6903740 1 -- 172.21.15.148:0/2241295143 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 msgr2=0x5583a3937d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0be6903740 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 0x5583a3937d50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80e4680 tx=0x7f0bc80a9250 comp rx=0 tx=0).stop 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0be6903740 1 -- 172.21.15.148:0/2241295143 shutdown_connections 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0be6903740 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5583a39b05c0 0x5583a39b29e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0bc1ffb640 0 client.25195 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0be6903740 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5583a350fda0 0x5583a39aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0be6903740 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5583a357c070 0x5583a3937d50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0be6903740 1 --2- 172.21.15.148:0/2241295143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5583a355b390 0x5583a39377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.752+0000 7f0be6903740 1 -- 172.21.15.148:0/2241295143 >> 172.21.15.148:0/2241295143 conn(0x5583a3570460 msgr2=0x5583a392f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.753+0000 7f0be6903740 1 -- 172.21.15.148:0/2241295143 shutdown_connections 2024-09-21T01:14:46.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.753+0000 7f0be6903740 1 -- 172.21.15.148:0/2241295143 wait complete. 2024-09-21T01:14:46.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.753+0000 7f0be6903740 20 client.25195 trim_cache size 0 max 16384 2024-09-21T01:14:46.758 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:14:46.758 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:14:46.758 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": { 2024-09-21T01:14:46.758 INFO:teuthology.orchestra.run.smithi148.stdout: "0705e125-8af9-4cc6-98ec-fca2de415bde": { 2024-09-21T01:14:46.758 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:14:46.758 INFO:teuthology.orchestra.run.smithi148.stdout: "tag": "0705e125-8af9-4cc6-98ec-fca2de415bde", 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: "options": "recursive,force" 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_stats": { 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: "0705e125-8af9-4cc6-98ec-fca2de415bde": { 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:14:45.199229+0000", 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:14:46.759 INFO:teuthology.orchestra.run.smithi148.stdout: "7bf59ed6-eedb-4a06-a813-d8af8d9118b7": { 2024-09-21T01:14:46.760 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:14:02.691995+0000", 2024-09-21T01:14:46.760 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:14:46.760 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:14:46.760 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:14:46.760 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:14:46.760 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:14:46.760 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:14:46.760 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:14:46.760 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:14:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.753+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0bc40b6620 msgr2=0x7f0bc40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.753+0000 7f0be038f640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0bc40b6620 0x7f0bc40b8b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0006010 tx=0x7f0bd00093e0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.753+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bd8105190 msgr2=0x7f0bd819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.753+0000 7f0be038f640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bd8105190 0x7f0bd819aa70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800d740 tx=0x7f0bc800dc00 comp rx=0 tx=0).stop 2024-09-21T01:14:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.754+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 shutdown_connections 2024-09-21T01:14:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.754+0000 7f0be038f640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0bc40b6620 0x7f0bc40b8b30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.754+0000 7f0be038f640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bd8105190 0x7f0bd819aa70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.754+0000 7f0be038f640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bd8105ae0 0x7f0bd819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.754+0000 7f0be038f640 1 --2- 172.21.15.148:0/2870545257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd81031c0 0x7f0bd819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.754+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 >> 172.21.15.148:0/2870545257 conn(0x7f0bd8077c60 msgr2=0x7f0bd81064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.754+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 shutdown_connections 2024-09-21T01:14:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:14:46.754+0000 7f0be038f640 1 -- 172.21.15.148:0/2870545257 wait complete. 2024-09-21T01:14:47.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:47 smithi148 ceph-mon[31000]: scrub summary: idle 2024-09-21T01:14:47.445 INFO:tasks.cephfs.filesystem:scrub status for tag:0705e125-8af9-4cc6-98ec-fca2de415bde - {'path': '/', 'tag': '0705e125-8af9-4cc6-98ec-fca2de415bde', 'options': 'recursive,force'} 2024-09-21T01:14:47.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:47 smithi181 ceph-mon[34811]: scrub summary: idle 2024-09-21T01:14:47.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:47 smithi157 ceph-mon[34140]: scrub summary: idle 2024-09-21T01:14:48.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:48 smithi181 ceph-mon[34811]: pgmap v362: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T01:14:48.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:48 smithi157 ceph-mon[34140]: pgmap v362: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T01:14:48.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:48 smithi148 ceph-mon[31000]: pgmap v362: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T01:14:50.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:50 smithi181 ceph-mon[34811]: pgmap v363: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T01:14:50.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:50 smithi157 ceph-mon[34140]: pgmap v363: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T01:14:50.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:50 smithi148 ceph-mon[31000]: pgmap v363: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T01:14:52.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:52 smithi181 ceph-mon[34811]: pgmap v364: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T01:14:52.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:52 smithi157 ceph-mon[34140]: pgmap v364: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T01:14:52.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:52 smithi148 ceph-mon[31000]: pgmap v364: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T01:14:54.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:54 smithi181 ceph-mon[34811]: pgmap v365: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-21T01:14:54.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:54 smithi157 ceph-mon[34140]: pgmap v365: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-21T01:14:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.519+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3790158438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7641025b0 msgr2=0x7fe764102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.519+0000 7fe76b4b2640 1 --2- 172.21.15.148:0/3790158438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7641025b0 0x7fe764102a20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe760009900 tx=0x7fe76002a410 comp rx=0 tx=0).stop 2024-09-21T01:14:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.519+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3790158438 shutdown_connections 2024-09-21T01:14:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.520+0000 7fe76b4b2640 1 --2- 172.21.15.148:0/3790158438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe764103fd0 0x7fe76410a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.520+0000 7fe76b4b2640 1 --2- 172.21.15.148:0/3790158438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe764103630 0x7fe764103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.520+0000 7fe76b4b2640 1 --2- 172.21.15.148:0/3790158438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7641025b0 0x7fe764102a20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.520+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3790158438 >> 172.21.15.148:0/3790158438 conn(0x7fe7640fdf30 msgr2=0x7fe7641003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.520+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3790158438 shutdown_connections 2024-09-21T01:14:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.520+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3790158438 wait complete. 2024-09-21T01:14:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe76b4b2640 1 Processor -- start 2024-09-21T01:14:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe76b4b2640 1 -- start start 2024-09-21T01:14:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe76b4b2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7641025b0 0x7fe764198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe76b4b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe764103630 0x7fe764199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe76b4b2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe764103fd0 0x7fe76419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe768a4d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe764103630 0x7fe764199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe768a4d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe764103630 0x7fe764199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43314/0 (socket says 172.21.15.148:43314) 2024-09-21T01:14:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe76410e200 con 0x7fe764103630 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe768a4d640 1 -- 172.21.15.148:0/3062261459 learned_addr learned my addr 172.21.15.148:0/3062261459 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe76410e080 con 0x7fe7641025b0 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe76410e380 con 0x7fe764103fd0 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.521+0000 7fe76924e640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7641025b0 0x7fe764198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe76924e640 1 -- 172.21.15.148:0/3062261459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe764103fd0 msgr2=0x7fe76419a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe76924e640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe764103fd0 0x7fe76419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe76924e640 1 -- 172.21.15.148:0/3062261459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe764103630 msgr2=0x7fe764199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe76924e640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe764103630 0x7fe764199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe76924e640 1 -- 172.21.15.148:0/3062261459 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76419a900 con 0x7fe7641025b0 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe768a4d640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe764103630 0x7fe764199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe76924e640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7641025b0 0x7fe764198ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe760006010 tx=0x7fe760004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe75a7fc640 1 -- 172.21.15.148:0/3062261459 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76003f070 con 0x7fe7641025b0 2024-09-21T01:14:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe75a7fc640 1 -- 172.21.15.148:0/3062261459 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe760032e50 con 0x7fe7641025b0 2024-09-21T01:14:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe75a7fc640 1 -- 172.21.15.148:0/3062261459 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760035070 con 0x7fe7641025b0 2024-09-21T01:14:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76419ab90 con 0x7fe7641025b0 2024-09-21T01:14:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.522+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe76406b5a0 con 0x7fe7641025b0 2024-09-21T01:14:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.525+0000 7fe75a7fc640 1 -- 172.21.15.148:0/3062261459 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7fe7600037f0 con 0x7fe7641025b0 2024-09-21T01:14:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.526+0000 7fe77241d740 1 Processor -- start 2024-09-21T01:14:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.526+0000 7fe77241d740 1 -- start start 2024-09-21T01:14:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.526+0000 7fe77241d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf44e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.526+0000 7fe77241d740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf454c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.526+0000 7fe77241d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb7c4d0 0x561b1cf46010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.526+0000 7fe77241d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561b1ceb76f0 con 0x561b1cb9d1b0 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.526+0000 7fe77241d740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561b1cea6b20 con 0x561b1cb742f0 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.526+0000 7fe77241d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b1ceaa930 con 0x561b1cb7c4d0 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe769a4f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf44e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe75a7fc640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe7500b65a0 0x7fe7500b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe769a4f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf44e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43318/0 (socket says 172.21.15.148:43318) 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe769a4f640 1 -- 172.21.15.148:0/1703116977 learned_addr learned my addr 172.21.15.148:0/1703116977 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe768a4d640 1 --2- 172.21.15.148:0/1703116977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb7c4d0 0x561b1cf46010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe76924e640 1 --2- 172.21.15.148:0/1703116977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe769a4f640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe7500b65a0 0x7fe7500b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe769a4f640 1 -- 172.21.15.148:0/1703116977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb7c4d0 msgr2=0x561b1cf46010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe769a4f640 1 --2- 172.21.15.148:0/1703116977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb7c4d0 0x561b1cf46010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe769a4f640 1 -- 172.21.15.148:0/1703116977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 msgr2=0x561b1cf454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe769a4f640 1 --2- 172.21.15.148:0/1703116977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe769a4f640 1 -- 172.21.15.148:0/1703116977 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1ce6c530 con 0x561b1cb9d1b0 2024-09-21T01:14:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe75a7fc640 1 -- 172.21.15.148:0/3062261459 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fe760107af0 con 0x7fe7641025b0 2024-09-21T01:14:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.527+0000 7fe769a4f640 1 --2- 172.21.15.148:0/1703116977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf44e50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe75c012900 tx=0x7fe75c012dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f256d98bfe71512f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.528+0000 7fe769a4f640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe7500b65a0 0x7fe7500b8ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe75c01f000 tx=0x7fe75c01e000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.528+0000 7fe74f7fe640 1 -- 172.21.15.148:0/1703116977 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c003a30 con 0x561b1cb9d1b0 2024-09-21T01:14:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.528+0000 7fe74f7fe640 1 -- 172.21.15.148:0/1703116977 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c003bd0 con 0x561b1cb9d1b0 2024-09-21T01:14:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.528+0000 7fe74f7fe640 1 -- 172.21.15.148:0/1703116977 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c01c6a0 con 0x561b1cb9d1b0 2024-09-21T01:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 -- 172.21.15.148:0/1703116977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 msgr2=0x561b1cf44e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 --2- 172.21.15.148:0/1703116977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf44e50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe75c012900 tx=0x7fe75c012dc0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 -- 172.21.15.148:0/1703116977 shutdown_connections 2024-09-21T01:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 --2- 172.21.15.148:0/1703116977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb7c4d0 0x561b1cf46010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 --2- 172.21.15.148:0/1703116977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 --2- 172.21.15.148:0/1703116977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf44e50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 -- 172.21.15.148:0/1703116977 >> 172.21.15.148:0/1703116977 conn(0x561b1cb91300 msgr2=0x561b1cf408e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 -- 172.21.15.148:0/1703116977 shutdown_connections 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 -- 172.21.15.148:0/1703116977 wait complete. 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 -- start start 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.529+0000 7fe77241d740 1 Processor -- start 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe77241d740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf4e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe77241d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe77241d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 0x561b1cf4f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe77241d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561b1cddeab0 con 0x561b1cb7c4d0 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe77241d740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561b1ce4c730 con 0x561b1cb742f0 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe77241d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b1cf46b30 con 0x561b1cb9d1b0 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe768a4d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe768a4d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43322/0 (socket says 172.21.15.148:43322) 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe768a4d640 1 -- 172.21.15.148:0/1782964308 learned_addr learned my addr 172.21.15.148:0/1782964308 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe77241d740 10 client.0 _ll_register_callbacks cb 0x561b1cea06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe76924e640 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf4e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe769a4f640 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 0x561b1cf4f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe768a4d640 1 -- 172.21.15.148:0/1782964308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 msgr2=0x561b1cf4f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe768a4d640 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 0x561b1cf4f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe768a4d640 1 -- 172.21.15.148:0/1782964308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 msgr2=0x561b1cf4e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe768a4d640 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf4e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.530+0000 7fe768a4d640 1 -- 172.21.15.148:0/1782964308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1cc08790 con 0x561b1cb7c4d0 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.531+0000 7fe768a4d640 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4ecb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe754012d20 tx=0x7fe75400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4ec008990aef07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.531+0000 7fe74cff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.531+0000 7fe74cff9640 1 -- 172.21.15.148:0/1782964308 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754010430 con 0x561b1cb7c4d0 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.531+0000 7fe77241d740 1 -- 172.21.15.148:0/1782964308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe75c003bd0 con 0x561b1cb7c4d0 2024-09-21T01:14:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.531+0000 7fe74cff9640 1 -- 172.21.15.148:0/1782964308 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fe7540105d0 con 0x561b1cb7c4d0 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.531+0000 7fe74cff9640 1 -- 172.21.15.148:0/1782964308 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe754010810 con 0x561b1cb7c4d0 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.531+0000 7fe77241d740 10 client.15603 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.531+0000 7fe77241d740 1 -- 172.21.15.148:0/1782964308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561b1cc81620 con 0x561b1cb7c4d0 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.531+0000 7fe74cff9640 1 -- 172.21.15.148:0/1782964308 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c003bd0 con 0x561b1cb7c4d0 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.532+0000 7fe74cff9640 1 -- 172.21.15.148:0/1782964308 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe75401c810 con 0x561b1cb7c4d0 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.532+0000 7fe77241d740 10 client.15603 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.532+0000 7fe77241d740 10 client.15603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.532+0000 7fe77241d740 20 client.15603 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.532+0000 7fe77241d740 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b1cb5bd80 0x561b1cf5bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.532+0000 7fe77241d740 4 client.15603 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.532+0000 7fe77241d740 1 -- 172.21.15.148:0/1782964308 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b1ceb9640 con 0x561b1cb5bd80 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.532+0000 7fe76924e640 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b1cb5bd80 0x561b1cf5bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.532+0000 7fe74cff9640 10 client.15603 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.532+0000 7fe76924e640 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b1cb5bd80 0x561b1cf5bd90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eca5c5dd3c52b2f server_cookie=38eeadd797f4447d in_seq=0 out_seq=0 2024-09-21T01:14:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe74cff9640 1 -- 172.21.15.148:0/1782964308 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b1ceb9640 con 0x561b1cb5bd80 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe74cff9640 10 client.15603 handle_command_reply: tid=0 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe77241d740 1 client.15603 shutdown 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe77241d740 1 -- 172.21.15.148:0/1782964308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 msgr2=0x561b1cf4ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe77241d740 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4ecb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe754012d20 tx=0x7fe75400f790 comp rx=0 tx=0).stop 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe77241d740 1 -- 172.21.15.148:0/1782964308 shutdown_connections 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe77241d740 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b1cb5bd80 0x561b1cf5bd90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe77241d740 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4ecb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe74cff9640 0 client.15603 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe77241d740 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 0x561b1cf4f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe77241d740 1 --2- 172.21.15.148:0/1782964308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf4e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.533+0000 7fe77241d740 1 -- 172.21.15.148:0/1782964308 >> 172.21.15.148:0/1782964308 conn(0x561b1cb91300 msgr2=0x561b1cf3eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.534+0000 7fe77241d740 1 -- 172.21.15.148:0/1782964308 shutdown_connections 2024-09-21T01:14:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.534+0000 7fe77241d740 1 -- 172.21.15.148:0/1782964308 wait complete. 2024-09-21T01:14:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.534+0000 7fe77241d740 20 client.15603 trim_cache size 0 max 16384 2024-09-21T01:14:54.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe77241d740 1 Processor -- start 2024-09-21T01:14:54.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe77241d740 1 -- start start 2024-09-21T01:14:54.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe77241d740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf45d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe77241d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe768a4d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe768a4d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43326/0 (socket says 172.21.15.148:43326) 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe768a4d640 1 -- 172.21.15.148:0/4117199458 learned_addr learned my addr 172.21.15.148:0/4117199458 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe77241d740 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 0x561b1cf4cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe77241d740 1 -- 172.21.15.148:0/4117199458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641afa60 con 0x561b1cb7c4d0 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe77241d740 1 -- 172.21.15.148:0/4117199458 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641ad330 con 0x561b1cb742f0 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe77241d740 1 -- 172.21.15.148:0/4117199458 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641ab180 con 0x561b1cb9d1b0 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.549+0000 7fe76924e640 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf45d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe769a4f640 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 0x561b1cf4cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe768a4d640 1 -- 172.21.15.148:0/4117199458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 msgr2=0x561b1cf4cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe768a4d640 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 0x561b1cf4cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe768a4d640 1 -- 172.21.15.148:0/4117199458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 msgr2=0x561b1cf45d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe768a4d640 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf45d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe768a4d640 1 -- 172.21.15.148:0/4117199458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1cf4c7c0 con 0x561b1cb7c4d0 2024-09-21T01:14:54.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe76924e640 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf45d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:54.552 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe769a4f640 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 0x561b1cf4cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:54.553 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe768a4d640 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4d7f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe754001eb0 tx=0x7fe75400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4294d6736a2db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.553 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe74effd640 1 -- 172.21.15.148:0/4117199458 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754010430 con 0x561b1cb7c4d0 2024-09-21T01:14:54.553 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe74effd640 1 -- 172.21.15.148:0/4117199458 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe754022030 con 0x561b1cb7c4d0 2024-09-21T01:14:54.553 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.550+0000 7fe74effd640 1 -- 172.21.15.148:0/4117199458 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754005570 con 0x561b1cb7c4d0 2024-09-21T01:14:54.553 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.551+0000 7fe77241d740 1 -- 172.21.15.148:0/4117199458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 msgr2=0x561b1cf4d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.551+0000 7fe77241d740 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4d7f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe754001eb0 tx=0x7fe75400fd10 comp rx=0 tx=0).stop 2024-09-21T01:14:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.552+0000 7fe77241d740 1 -- 172.21.15.148:0/4117199458 shutdown_connections 2024-09-21T01:14:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.552+0000 7fe77241d740 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb7c4d0 0x561b1cf4d7f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.552+0000 7fe77241d740 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb9d1b0 0x561b1cf4cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.552+0000 7fe77241d740 1 --2- 172.21.15.148:0/4117199458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf45d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.552+0000 7fe77241d740 1 -- 172.21.15.148:0/4117199458 >> 172.21.15.148:0/4117199458 conn(0x561b1cb91300 msgr2=0x561b1cf40290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.552+0000 7fe77241d740 1 -- 172.21.15.148:0/4117199458 shutdown_connections 2024-09-21T01:14:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.552+0000 7fe77241d740 1 -- 172.21.15.148:0/4117199458 wait complete. 2024-09-21T01:14:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.552+0000 7fe77241d740 1 -- start start 2024-09-21T01:14:54.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.552+0000 7fe77241d740 1 Processor -- start 2024-09-21T01:14:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.553+0000 7fe77241d740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf51ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.553+0000 7fe77241d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb7c4d0 0x561b1cf52180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.553+0000 7fe77241d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf55d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.553+0000 7fe769a4f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf55d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.553+0000 7fe769a4f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf55d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43330/0 (socket says 172.21.15.148:43330) 2024-09-21T01:14:54.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.553+0000 7fe769a4f640 1 -- 172.21.15.148:0/1437152629 learned_addr learned my addr 172.21.15.148:0/1437152629 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.553+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641ab7f0 con 0x561b1cb9d1b0 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.553+0000 7fe76924e640 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf51ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.553+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641acc60 con 0x561b1cb742f0 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641abec0 con 0x561b1cb7c4d0 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe768a4d640 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb7c4d0 0x561b1cf52180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe76924e640 1 -- 172.21.15.148:0/1437152629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb7c4d0 msgr2=0x561b1cf52180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe76924e640 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb7c4d0 0x561b1cf52180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe76924e640 1 -- 172.21.15.148:0/1437152629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 msgr2=0x561b1cf55d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe76924e640 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf55d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe76924e640 1 -- 172.21.15.148:0/1437152629 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1cf564d0 con 0x561b1cb742f0 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe769a4f640 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf55d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe77241d740 10 client.0 _ll_register_callbacks cb 0x7fe754009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:14:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe76924e640 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf51ac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe760105450 tx=0x7fe760096640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14501cecddf5f9ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe74cff9640 10 client.25247 ms_handle_connect on v2:172.21.15.157:3300/0 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe754022030 con 0x561b1cb742f0 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.554+0000 7fe74cff9640 1 -- 172.21.15.148:0/1437152629 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760048040 con 0x561b1cb742f0 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe74cff9640 1 -- 172.21.15.148:0/1437152629 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fe7600c9040 con 0x561b1cb742f0 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe74cff9640 1 -- 172.21.15.148:0/1437152629 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe7600cd5e0 con 0x561b1cb742f0 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe77241d740 10 client.25247 fetch_fsmap learned FSMap version 24 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({fsmap=24}) -- 0x561b1cf53660 con 0x561b1cb742f0 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe74cff9640 1 -- 172.21.15.148:0/1437152629 <== mon.2 v2:172.21.15.157:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe76004b060 con 0x561b1cb742f0 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe77241d740 10 client.25247 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe77241d740 10 client.25247 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe77241d740 20 client.25247 populate_metadata read hostname 'smithi148' 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe77241d740 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b1cb311c0 0x561b1cfc8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe77241d740 4 client.25247 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:14:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.555+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b1ceb50f0 con 0x561b1cb311c0 2024-09-21T01:14:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.556+0000 7fe768a4d640 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b1cb311c0 0x561b1cfc8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.556+0000 7fe768a4d640 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b1cb311c0 0x561b1cfc8c20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdd319c8e53a1f01 server_cookie=7fe70701315f9660 in_seq=0 out_seq=0 2024-09-21T01:14:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.556+0000 7fe74cff9640 10 client.25247 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe74cff9640 1 -- 172.21.15.148:0/1437152629 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b1ceb50f0 con 0x561b1cb311c0 2024-09-21T01:14:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe74cff9640 10 client.25247 handle_command_reply: tid=0 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe77241d740 1 client.25247 shutdown 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 msgr2=0x561b1cf51ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe77241d740 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf51ac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe760105450 tx=0x7fe760096640 comp rx=0 tx=0).stop 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 shutdown_connections 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe77241d740 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b1cb311c0 0x561b1cfc8c20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe74cff9640 0 client.25247 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe77241d740 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b1cb9d1b0 0x561b1cf55d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe77241d740 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b1cb7c4d0 0x561b1cf52180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe77241d740 1 --2- 172.21.15.148:0/1437152629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b1cb742f0 0x561b1cf51ac0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.562+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 >> 172.21.15.148:0/1437152629 conn(0x561b1cb91300 msgr2=0x561b1cf45d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 shutdown_connections 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe77241d740 1 -- 172.21.15.148:0/1437152629 wait complete. 2024-09-21T01:14:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe77241d740 20 client.25247 trim_cache size 0 max 16384 2024-09-21T01:14:54.565 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-21T01:14:54.565 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-21T01:14:54.565 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-21T01:14:54.565 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-21T01:14:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe7500b65a0 msgr2=0x7fe7500b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe7500b65a0 0x7fe7500b8ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe75c01f000 tx=0x7fe75c01e000 comp rx=0 tx=0).stop 2024-09-21T01:14:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7641025b0 msgr2=0x7fe764198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7641025b0 0x7fe764198ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe760006010 tx=0x7fe760004270 comp rx=0 tx=0).stop 2024-09-21T01:14:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 shutdown_connections 2024-09-21T01:14:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fe7500b65a0 0x7fe7500b8ab0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe764103630 0x7fe764199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe764103fd0 0x7fe76419a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 --2- 172.21.15.148:0/3062261459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7641025b0 0x7fe764198ec0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 >> 172.21.15.148:0/3062261459 conn(0x7fe7640fdf30 msgr2=0x7fe764106950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 shutdown_connections 2024-09-21T01:14:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:14:54.563+0000 7fe76b4b2640 1 -- 172.21.15.148:0/3062261459 wait complete. 2024-09-21T01:14:54.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:54 smithi148 ceph-mon[31000]: pgmap v365: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-21T01:14:56.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:56 smithi181 ceph-mon[34811]: pgmap v366: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T01:14:56.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:56 smithi157 ceph-mon[34140]: pgmap v366: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T01:14:56.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:56 smithi148 ceph-mon[31000]: pgmap v366: 97 pgs: 97 active+clean; 672 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T01:14:58.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:14:58 smithi181 ceph-mon[34811]: pgmap v367: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T01:14:58.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:14:58 smithi157 ceph-mon[34140]: pgmap v367: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T01:14:58.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:14:58 smithi148 ceph-mon[31000]: pgmap v367: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T01:15:00.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:00 smithi181 ceph-mon[34811]: pgmap v368: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:15:00.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:00 smithi157 ceph-mon[34140]: pgmap v368: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:15:00.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:00 smithi148 ceph-mon[31000]: pgmap v368: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:15:02.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:02 smithi181 ceph-mon[34811]: pgmap v369: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:15:02.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:02 smithi157 ceph-mon[34140]: pgmap v369: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:15:02.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:02 smithi148 ceph-mon[31000]: pgmap v369: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:15:03.800 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T01:15:03.800 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-21T01:15:03.800 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T01:15:03.800 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T01:15:03.800 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-21T01:15:03.801 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T01:15:03.805 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T01:15:03.843 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T01:15:03.845 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T01:15:03.845 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T01:15:04.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:04 smithi181 ceph-mon[34811]: pgmap v370: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T01:15:04.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:04 smithi157 ceph-mon[34140]: pgmap v370: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T01:15:04.536 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T01:15:04.598 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T01:15:04.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:04 smithi148 ceph-mon[31000]: pgmap v370: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T01:15:04.638 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T01:15:04.640 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T01:15:04.640 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T01:15:04.678 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T01:15:04.682 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:15:04.682 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T01:15:04.739 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-21T01:15:04.740 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-21T01:15:04.740 DEBUG:teuthology.orchestra.run.smithi148:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-21T01:15:04.800 INFO:tasks.workunit.client.0.smithi148.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-21T01:15:04.819 INFO:tasks.workunit.client.0.smithi148.stderr:--2024-09-21 01:15:04-- http://download.ceph.com/qa/fsync-tester.c 2024-09-21T01:15:04.820 INFO:tasks.workunit.client.0.smithi148.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-21T01:15:04.841 INFO:tasks.workunit.client.0.smithi148.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-21T01:15:04.861 INFO:tasks.workunit.client.0.smithi148.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-21T01:15:04.862 INFO:tasks.workunit.client.0.smithi148.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-21T01:15:04.863 INFO:tasks.workunit.client.0.smithi148.stderr:Saving to: ‘fsync-tester.c’ 2024-09-21T01:15:04.866 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-21T01:15:04.866 INFO:tasks.workunit.client.0.smithi148.stderr: 0K .. 100% 548M=0s 2024-09-21T01:15:04.866 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-21T01:15:04.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-21 01:15:04 (548 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-21T01:15:04.866 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-21T01:15:04.866 INFO:tasks.workunit.client.0.smithi148.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-21T01:15:04.960 INFO:tasks.workunit.client.0.smithi148.stderr:+ ./fsync-tester 2024-09-21T01:15:06.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:06 smithi181 ceph-mon[34811]: pgmap v371: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:15:06.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:06 smithi157 ceph-mon[34140]: pgmap v371: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:15:06.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:06 smithi148 ceph-mon[31000]: pgmap v371: 97 pgs: 97 active+clean; 673 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T01:15:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.666+0000 7f0ef9569640 1 -- 172.21.15.148:0/1647431717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef4103fc0 msgr2=0x7f0ef410a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.666+0000 7f0ef9569640 1 --2- 172.21.15.148:0/1647431717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef4103fc0 0x7f0ef410a960 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009c90 tx=0x7f0eec02a860 comp rx=0 tx=0).stop 2024-09-21T01:15:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.667+0000 7f0ef9569640 1 -- 172.21.15.148:0/1647431717 shutdown_connections 2024-09-21T01:15:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.667+0000 7f0ef9569640 1 --2- 172.21.15.148:0/1647431717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef4103fc0 0x7f0ef410a960 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.667+0000 7f0ef9569640 1 --2- 172.21.15.148:0/1647431717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef4103620 0x7f0ef4103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.667+0000 7f0ef9569640 1 --2- 172.21.15.148:0/1647431717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef41025a0 0x7f0ef4102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.667+0000 7f0ef9569640 1 -- 172.21.15.148:0/1647431717 >> 172.21.15.148:0/1647431717 conn(0x7f0ef40fdee0 msgr2=0x7f0ef4100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.667+0000 7f0ef9569640 1 -- 172.21.15.148:0/1647431717 shutdown_connections 2024-09-21T01:15:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.667+0000 7f0ef9569640 1 -- 172.21.15.148:0/1647431717 wait complete. 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.667+0000 7f0ef9569640 1 Processor -- start 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.667+0000 7f0ef9569640 1 -- start start 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.667+0000 7f0ef9569640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef41025a0 0x7f0ef4106100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef9569640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef4103620 0x7f0ef4104a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef9569640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef4103fc0 0x7f0ef4104f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef9569640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef410e240 con 0x7f0ef4103fc0 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef9569640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef410e0c0 con 0x7f0ef4103620 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef9569640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef410e3c0 con 0x7f0ef41025a0 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef4103fc0 0x7f0ef4104f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef4103fc0 0x7f0ef4104f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44282/0 (socket says 172.21.15.148:44282) 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef37fe640 1 -- 172.21.15.148:0/1732785565 learned_addr learned my addr 172.21.15.148:0/1732785565 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0eebfff640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef4103620 0x7f0ef4104a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef41025a0 0x7f0ef4106100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef37fe640 1 -- 172.21.15.148:0/1732785565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef41025a0 msgr2=0x7f0ef4106100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef37fe640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef41025a0 0x7f0ef4106100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef37fe640 1 -- 172.21.15.148:0/1732785565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef4103620 msgr2=0x7f0ef4104a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef37fe640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef4103620 0x7f0ef4104a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef37fe640 1 -- 172.21.15.148:0/1732785565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef4105610 con 0x7f0ef4103fc0 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef41025a0 0x7f0ef4106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef37fe640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef4103fc0 0x7f0ef4104f70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0eec004cc0 tx=0x7f0eec004cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.668+0000 7f0ef0ff9640 1 -- 172.21.15.148:0/1732785565 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec030760 con 0x7f0ef4103fc0 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.669+0000 7f0ef0ff9640 1 -- 172.21.15.148:0/1732785565 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0eec030db0 con 0x7f0ef4103fc0 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.669+0000 7f0ef9569640 1 -- 172.21.15.148:0/1732785565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef41a4040 con 0x7f0ef4103fc0 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.669+0000 7f0ef0ff9640 1 -- 172.21.15.148:0/1732785565 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec03cce0 con 0x7f0ef4103fc0 2024-09-21T01:15:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.669+0000 7f0ef9569640 1 -- 172.21.15.148:0/1732785565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef41a43f0 con 0x7f0ef4103fc0 2024-09-21T01:15:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.671+0000 7f0f004da740 1 Processor -- start 2024-09-21T01:15:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.671+0000 7f0ef0ff9640 1 -- 172.21.15.148:0/1732785565 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f0eec030900 con 0x7f0ef4103fc0 2024-09-21T01:15:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0f004da740 1 -- start start 2024-09-21T01:15:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0f004da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6027de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0f004da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6027e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0f004da740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 0x562a6027f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0f004da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562a601f06f0 con 0x562a5fead2f0 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0f004da740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x562a601dfb20 con 0x562a5feb54d0 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0f004da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562a601e3930 con 0x562a5fed61b0 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0ef2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6027e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0ef2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6027e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44290/0 (socket says 172.21.15.148:44290) 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0ef2ffd640 1 -- 172.21.15.148:0/749396044 learned_addr learned my addr 172.21.15.148:0/749396044 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0eebfff640 1 --2- 172.21.15.148:0/749396044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6027de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0eebfff640 1 --2- 172.21.15.148:0/749396044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 0x562a6027f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0ef2ffd640 1 -- 172.21.15.148:0/749396044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 msgr2=0x562a6027de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/749396044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6027de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0ef2ffd640 1 -- 172.21.15.148:0/749396044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 msgr2=0x562a6027f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/749396044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 0x562a6027f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0ef2ffd640 1 -- 172.21.15.148:0/749396044 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a601a5530 con 0x562a5fead2f0 2024-09-21T01:15:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0eebfff640 1 --2- 172.21.15.148:0/749396044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6027de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.672+0000 7f0ef0ff9640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65a0 0x7f0ee00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.673+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/749396044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6027e4c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400bd40 tx=0x7f0ee400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49bdacb760627c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.673+0000 7f0eebfff640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65a0 0x7f0ee00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.673+0000 7f0ef0ff9640 1 -- 172.21.15.148:0/1732785565 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f0eec1084c0 con 0x7f0ef4103fc0 2024-09-21T01:15:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.673+0000 7f0ee97fa640 1 -- 172.21.15.148:0/749396044 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4004220 con 0x562a5fead2f0 2024-09-21T01:15:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.673+0000 7f0ee97fa640 1 -- 172.21.15.148:0/749396044 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee400be30 con 0x562a5fead2f0 2024-09-21T01:15:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.673+0000 7f0ee97fa640 1 -- 172.21.15.148:0/749396044 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40116a0 con 0x562a5fead2f0 2024-09-21T01:15:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.674+0000 7f0eebfff640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65a0 0x7f0ee00b8ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0058c0 tx=0x7f0edc0046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.674+0000 7f0f004da740 1 -- 172.21.15.148:0/749396044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 msgr2=0x562a6027e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.674+0000 7f0f004da740 1 --2- 172.21.15.148:0/749396044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6027e4c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400bd40 tx=0x7f0ee400f730 comp rx=0 tx=0).stop 2024-09-21T01:15:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.674+0000 7f0f004da740 1 -- 172.21.15.148:0/749396044 shutdown_connections 2024-09-21T01:15:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.674+0000 7f0f004da740 1 --2- 172.21.15.148:0/749396044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6027e4c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.674+0000 7f0f004da740 1 --2- 172.21.15.148:0/749396044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 0x562a6027f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.674+0000 7f0f004da740 1 --2- 172.21.15.148:0/749396044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6027de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.674+0000 7f0f004da740 1 -- 172.21.15.148:0/749396044 >> 172.21.15.148:0/749396044 conn(0x562a5feca300 msgr2=0x562a602798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.674+0000 7f0f004da740 1 -- 172.21.15.148:0/749396044 shutdown_connections 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.674+0000 7f0f004da740 1 -- 172.21.15.148:0/749396044 wait complete. 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.675+0000 7f0f004da740 1 -- start start 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.675+0000 7f0f004da740 1 Processor -- start 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.675+0000 7f0f004da740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 0x562a60287580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.675+0000 7f0f004da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5feb54d0 0x562a60287c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.675+0000 7f0f004da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fed61b0 0x562a602887b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.675+0000 7f0f004da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562a60117ab0 con 0x562a5fed61b0 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.675+0000 7f0f004da740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x562a60185730 con 0x562a5fead2f0 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.675+0000 7f0f004da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562a6027fb30 con 0x562a5feb54d0 2024-09-21T01:15:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0f004da740 10 client.0 _ll_register_callbacks cb 0x562a601d96b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fed61b0 0x562a602887b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0eebfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5feb54d0 0x562a60287c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fed61b0 0x562a602887b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44292/0 (socket says 172.21.15.148:44292) 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef37fe640 1 -- 172.21.15.148:0/1647318933 learned_addr learned my addr 172.21.15.148:0/1647318933 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 0x562a60287580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef37fe640 1 -- 172.21.15.148:0/1647318933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5feb54d0 msgr2=0x562a60287c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef37fe640 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5feb54d0 0x562a60287c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef37fe640 1 -- 172.21.15.148:0/1647318933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 msgr2=0x562a60287580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef37fe640 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 0x562a60287580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef37fe640 1 -- 172.21.15.148:0/1647318933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a5ff41790 con 0x562a5fed61b0 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 0x562a60287580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0ef37fe640 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fed61b0 0x562a602887b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0ce490 tx=0x7f0eec03c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729d4e1a20719f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0eda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1647318933 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec1082d0 con 0x562a5fed61b0 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1647318933 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f0eec0d7a90 con 0x562a5fed61b0 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0f004da740 1 -- 172.21.15.148:0/1647318933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee400be30 con 0x562a5fed61b0 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.676+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1647318933 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0eec0ce010 con 0x562a5fed61b0 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0f004da740 10 client.15621 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0f004da740 1 -- 172.21.15.148:0/1647318933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a5ffba620 con 0x562a5fed61b0 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1647318933 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee400be30 con 0x562a5fed61b0 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1647318933 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f0eec0c9e50 con 0x562a5fed61b0 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0f004da740 10 client.15621 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0f004da740 10 client.15621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:07.687 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0f004da740 20 client.15621 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:07.687 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0f004da740 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x562a5fe94d80 0x562a60294c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.687 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0f004da740 4 client.15621 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:07.687 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0f004da740 1 -- 172.21.15.148:0/1647318933 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a601f2640 con 0x562a5fe94d80 2024-09-21T01:15:07.687 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.677+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x562a5fe94d80 0x562a60294c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.687 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.678+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x562a5fe94d80 0x562a60294c30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51ec72b42d0c9ea9 server_cookie=c80c70a4b1401abd in_seq=0 out_seq=0 2024-09-21T01:15:07.687 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.678+0000 7f0eda7fc640 10 client.15621 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:07.687 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.678+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1647318933 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a601f2640 con 0x562a5fe94d80 2024-09-21T01:15:07.687 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.678+0000 7f0eda7fc640 10 client.15621 handle_command_reply: tid=0 2024-09-21T01:15:07.687 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.678+0000 7f0f004da740 1 client.15621 shutdown 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 1 -- 172.21.15.148:0/1647318933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fed61b0 msgr2=0x562a602887b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fed61b0 0x562a602887b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0ce490 tx=0x7f0eec03c7b0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 1 -- 172.21.15.148:0/1647318933 shutdown_connections 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x562a5fe94d80 0x562a60294c30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fed61b0 0x562a602887b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5feb54d0 0x562a60287c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0eda7fc640 0 client.15621 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 1 --2- 172.21.15.148:0/1647318933 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 0x562a60287580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 1 -- 172.21.15.148:0/1647318933 >> 172.21.15.148:0/1647318933 conn(0x562a5feca300 msgr2=0x562a60277ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 1 -- 172.21.15.148:0/1647318933 shutdown_connections 2024-09-21T01:15:07.688 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 1 -- 172.21.15.148:0/1647318933 wait complete. 2024-09-21T01:15:07.689 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.679+0000 7f0f004da740 20 client.15621 trim_cache size 0 max 16384 2024-09-21T01:15:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.693+0000 7f0f004da740 1 Processor -- start 2024-09-21T01:15:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.693+0000 7f0f004da740 1 -- start start 2024-09-21T01:15:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0f004da740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 0x562a6027ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0f004da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5feb54d0 0x562a6027e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0f004da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6027a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0f004da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41af930 con 0x562a5feb54d0 2024-09-21T01:15:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0f004da740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41ad200 con 0x562a5fead2f0 2024-09-21T01:15:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0f004da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41ab050 con 0x562a5fed61b0 2024-09-21T01:15:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0eebfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5feb54d0 0x562a6027e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0eebfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5feb54d0 0x562a6027e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44296/0 (socket says 172.21.15.148:44296) 2024-09-21T01:15:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0eebfff640 1 -- 172.21.15.148:0/1275200326 learned_addr learned my addr 172.21.15.148:0/1275200326 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/1275200326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 0x562a6027ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0ef37fe640 1 --2- 172.21.15.148:0/1275200326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6027a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0eebfff640 1 -- 172.21.15.148:0/1275200326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 msgr2=0x562a6027a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0eebfff640 1 --2- 172.21.15.148:0/1275200326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6027a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0eebfff640 1 -- 172.21.15.148:0/1275200326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 msgr2=0x562a6027ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0eebfff640 1 --2- 172.21.15.148:0/1275200326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 0x562a6027ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.694+0000 7f0eebfff640 1 -- 172.21.15.148:0/1275200326 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a60287fb0 con 0x562a5feb54d0 2024-09-21T01:15:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.695+0000 7f0eebfff640 1 --2- 172.21.15.148:0/1275200326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5feb54d0 0x562a6027e330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0edc01a460 tx=0x7f0edc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a70faa3f4ecc95e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.695+0000 7f0ee8ff9640 1 -- 172.21.15.148:0/1275200326 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc01ab10 con 0x562a5feb54d0 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.695+0000 7f0ee8ff9640 1 -- 172.21.15.148:0/1275200326 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0edc01acb0 con 0x562a5feb54d0 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.695+0000 7f0ee8ff9640 1 -- 172.21.15.148:0/1275200326 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc003d50 con 0x562a5feb54d0 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 -- 172.21.15.148:0/1275200326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5feb54d0 msgr2=0x562a6027e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 --2- 172.21.15.148:0/1275200326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5feb54d0 0x562a6027e330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0edc01a460 tx=0x7f0edc014000 comp rx=0 tx=0).stop 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 -- 172.21.15.148:0/1275200326 shutdown_connections 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 --2- 172.21.15.148:0/1275200326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5feb54d0 0x562a6027e330 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 --2- 172.21.15.148:0/1275200326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6027a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 --2- 172.21.15.148:0/1275200326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5fead2f0 0x562a6027ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 -- 172.21.15.148:0/1275200326 >> 172.21.15.148:0/1275200326 conn(0x562a5feca300 msgr2=0x562a602867a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 -- 172.21.15.148:0/1275200326 shutdown_connections 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 -- 172.21.15.148:0/1275200326 wait complete. 2024-09-21T01:15:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 -- start start 2024-09-21T01:15:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.696+0000 7f0f004da740 1 Processor -- start 2024-09-21T01:15:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0f004da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6028f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0f004da740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 0x562a6028e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0f004da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6028e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0f004da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41ab6c0 con 0x562a5fead2f0 2024-09-21T01:15:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0f004da740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41acb30 con 0x562a5feb54d0 2024-09-21T01:15:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0f004da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41abd90 con 0x562a5fed61b0 2024-09-21T01:15:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0f004da740 10 client.0 _ll_register_callbacks cb 0x7f0eec03ce80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0ef2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6028f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0ef2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6028f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44312/0 (socket says 172.21.15.148:44312) 2024-09-21T01:15:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0ef2ffd640 1 -- 172.21.15.148:0/1887171833 learned_addr learned my addr 172.21.15.148:0/1887171833 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0ef37fe640 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6028e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0eebfff640 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 0x562a6028e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0ef2ffd640 1 -- 172.21.15.148:0/1887171833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 msgr2=0x562a6028e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6028e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0ef2ffd640 1 -- 172.21.15.148:0/1887171833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 msgr2=0x562a6028e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 0x562a6028e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0ef2ffd640 1 -- 172.21.15.148:0/1887171833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6028ce10 con 0x562a5fead2f0 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0eebfff640 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 0x562a6028e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0ef2ffd640 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6028f590 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400bc90 tx=0x7f0ee400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449cb66186a1e9a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0eda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.697+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1887171833 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4033060 con 0x562a5fead2f0 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0f004da740 1 -- 172.21.15.148:0/1887171833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0edc01acb0 con 0x562a5fead2f0 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1887171833 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f0ee4003b20 con 0x562a5fead2f0 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1887171833 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0ee4003d20 con 0x562a5fead2f0 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0f004da740 10 client.15627 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0f004da740 1 -- 172.21.15.148:0/1887171833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a602ff880 con 0x562a5fead2f0 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1887171833 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0edc01acb0 con 0x562a5fead2f0 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1887171833 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f0ee402d030 con 0x562a5fead2f0 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0f004da740 10 client.15627 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0f004da740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0f004da740 20 client.15627 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0f004da740 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x562a5fe6a1c0 0x562a60301fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0f004da740 4 client.15627 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.698+0000 7f0f004da740 1 -- 172.21.15.148:0/1887171833 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a601ee0f0 con 0x562a5fe6a1c0 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.699+0000 7f0eebfff640 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x562a5fe6a1c0 0x562a60301fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.699+0000 7f0eebfff640 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x562a5fe6a1c0 0x562a60301fe0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=449bdc0b96a8cacc server_cookie=1e904619a993f285 in_seq=0 out_seq=0 2024-09-21T01:15:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.699+0000 7f0eda7fc640 10 client.15627 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.707+0000 7f0eda7fc640 1 -- 172.21.15.148:0/1887171833 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a601ee0f0 con 0x562a5fe6a1c0 2024-09-21T01:15:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.707+0000 7f0eda7fc640 10 client.15627 handle_command_reply: tid=0 2024-09-21T01:15:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.707+0000 7f0f004da740 1 client.15627 shutdown 2024-09-21T01:15:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 1 -- 172.21.15.148:0/1887171833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 msgr2=0x562a6028f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6028f590 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400bc90 tx=0x7f0ee400bf20 comp rx=0 tx=0).stop 2024-09-21T01:15:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 1 -- 172.21.15.148:0/1887171833 shutdown_connections 2024-09-21T01:15:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x562a5fe6a1c0 0x562a60301fe0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a5fed61b0 0x562a6028e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a5feb54d0 0x562a6028e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0eda7fc640 0 client.15627 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 1 --2- 172.21.15.148:0/1887171833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562a5fead2f0 0x562a6028f590 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 1 -- 172.21.15.148:0/1887171833 >> 172.21.15.148:0/1887171833 conn(0x562a5feca300 msgr2=0x562a602867a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 1 -- 172.21.15.148:0/1887171833 shutdown_connections 2024-09-21T01:15:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 1 -- 172.21.15.148:0/1887171833 wait complete. 2024-09-21T01:15:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0f004da740 20 client.15627 trim_cache size 0 max 16384 2024-09-21T01:15:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-21T01:15:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-21T01:15:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-21T01:15:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-21T01:15:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0ef9569640 1 -- 172.21.15.148:0/1732785565 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65a0 msgr2=0x7f0ee00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0ef9569640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65a0 0x7f0ee00b8ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0058c0 tx=0x7f0edc0046c0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0ef9569640 1 -- 172.21.15.148:0/1732785565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef4103fc0 msgr2=0x7f0ef4104f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0ef9569640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef4103fc0 0x7f0ef4104f70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0eec004cc0 tx=0x7f0eec004cf0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0ef9569640 1 -- 172.21.15.148:0/1732785565 shutdown_connections 2024-09-21T01:15:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0ef9569640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f0ee00b65a0 0x7f0ee00b8ab0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0ef9569640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ef4103fc0 0x7f0ef4104f70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0ef9569640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef4103620 0x7f0ef4104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.708+0000 7f0ef9569640 1 --2- 172.21.15.148:0/1732785565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ef41025a0 0x7f0ef4106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.709+0000 7f0ef9569640 1 -- 172.21.15.148:0/1732785565 >> 172.21.15.148:0/1732785565 conn(0x7f0ef40fdee0 msgr2=0x7f0ef40ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.709+0000 7f0ef9569640 1 -- 172.21.15.148:0/1732785565 shutdown_connections 2024-09-21T01:15:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:07.709+0000 7f0ef9569640 1 -- 172.21.15.148:0/1732785565 wait complete. 2024-09-21T01:15:08.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:08 smithi181 ceph-mon[34811]: pgmap v372: 97 pgs: 97 active+clean; 712 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-21T01:15:08.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:08 smithi181 ceph-mon[34811]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:15:08.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:08 smithi157 ceph-mon[34140]: pgmap v372: 97 pgs: 97 active+clean; 712 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-21T01:15:08.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:08 smithi157 ceph-mon[34140]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:15:08.499 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:08 smithi148 ceph-mon[31000]: pgmap v372: 97 pgs: 97 active+clean; 712 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-21T01:15:08.500 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:08 smithi148 ceph-mon[31000]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:15:10.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:10 smithi181 ceph-mon[34811]: pgmap v373: 97 pgs: 97 active+clean; 1.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 260 KiB/s wr, 6 op/s 2024-09-21T01:15:10.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:10 smithi157 ceph-mon[34140]: pgmap v373: 97 pgs: 97 active+clean; 1.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 260 KiB/s wr, 6 op/s 2024-09-21T01:15:10.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:10 smithi148 ceph-mon[31000]: pgmap v373: 97 pgs: 97 active+clean; 1.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 260 KiB/s wr, 6 op/s 2024-09-21T01:15:12.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:12 smithi181 ceph-mon[34811]: pgmap v374: 97 pgs: 97 active+clean; 1.7 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 261 KiB/s wr, 8 op/s 2024-09-21T01:15:12.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:12 smithi157 ceph-mon[34140]: pgmap v374: 97 pgs: 97 active+clean; 1.7 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 261 KiB/s wr, 8 op/s 2024-09-21T01:15:12.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:12 smithi148 ceph-mon[31000]: pgmap v374: 97 pgs: 97 active+clean; 1.7 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 261 KiB/s wr, 8 op/s 2024-09-21T01:15:14.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:14 smithi181 ceph-mon[34811]: pgmap v375: 97 pgs: 97 active+clean; 1.7 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 265 KiB/s wr, 12 op/s 2024-09-21T01:15:14.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:14 smithi157 ceph-mon[34140]: pgmap v375: 97 pgs: 97 active+clean; 1.7 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 265 KiB/s wr, 12 op/s 2024-09-21T01:15:14.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:14 smithi148 ceph-mon[31000]: pgmap v375: 97 pgs: 97 active+clean; 1.7 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 265 KiB/s wr, 12 op/s 2024-09-21T01:15:16.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:16 smithi181 ceph-mon[34811]: pgmap v376: 97 pgs: 97 active+clean; 1.7 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 691 KiB/s wr, 10 op/s 2024-09-21T01:15:16.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:16 smithi157 ceph-mon[34140]: pgmap v376: 97 pgs: 97 active+clean; 1.7 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 691 KiB/s wr, 10 op/s 2024-09-21T01:15:16.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:16 smithi148 ceph-mon[31000]: pgmap v376: 97 pgs: 97 active+clean; 1.7 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 691 KiB/s wr, 10 op/s 2024-09-21T01:15:17.446 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:15:17.711 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:18.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.204+0000 7f879c7e6640 1 -- 172.21.15.148:0/1071203431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8794105380 msgr2=0x7f879410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.204+0000 7f879c7e6640 1 --2- 172.21.15.148:0/1071203431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8794105380 0x7f879410d8d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8784009900 tx=0x7f878402a410 comp rx=0 tx=0).stop 2024-09-21T01:15:18.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.205+0000 7f879c7e6640 1 -- 172.21.15.148:0/1071203431 shutdown_connections 2024-09-21T01:15:18.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.205+0000 7f879c7e6640 1 --2- 172.21.15.148:0/1071203431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8794105380 0x7f879410d8d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.205+0000 7f879c7e6640 1 --2- 172.21.15.148:0/1071203431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f879410de60 0x7f8794110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.205+0000 7f879c7e6640 1 --2- 172.21.15.148:0/1071203431 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8794104a30 0x7f8794104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.205+0000 7f879c7e6640 1 -- 172.21.15.148:0/1071203431 >> 172.21.15.148:0/1071203431 conn(0x7f87940797b0 msgr2=0x7f8794079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:18.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.205+0000 7f879c7e6640 1 -- 172.21.15.148:0/1071203431 shutdown_connections 2024-09-21T01:15:18.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.205+0000 7f879c7e6640 1 -- 172.21.15.148:0/1071203431 wait complete. 2024-09-21T01:15:18.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.206+0000 7f879c7e6640 1 Processor -- start 2024-09-21T01:15:18.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.206+0000 7f879c7e6640 1 -- start start 2024-09-21T01:15:18.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.206+0000 7f879c7e6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8794104a30 0x7f879419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.206+0000 7f879c7e6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8794105380 0x7f879419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f879c7e6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879410de60 0x7f879419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f879c7e6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8794113aa0 con 0x7f8794104a30 2024-09-21T01:15:18.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f879c7e6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8794113920 con 0x7f8794105380 2024-09-21T01:15:18.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f879c7e6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8794113c20 con 0x7f879410de60 2024-09-21T01:15:18.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f879a582640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8794104a30 0x7f879419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f8799d81640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8794105380 0x7f879419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f8799d81640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8794105380 0x7f879419aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:40296/0 (socket says 172.21.15.148:40296) 2024-09-21T01:15:18.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f8799d81640 1 -- 172.21.15.148:0/671378247 learned_addr learned my addr 172.21.15.148:0/671378247 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:18.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f879ad83640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879410de60 0x7f879419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f8799d81640 1 -- 172.21.15.148:0/671378247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879410de60 msgr2=0x7f879419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f8799d81640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879410de60 0x7f879419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f8799d81640 1 -- 172.21.15.148:0/671378247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8794104a30 msgr2=0x7f879419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f8799d81640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8794104a30 0x7f879419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f8799d81640 1 -- 172.21.15.148:0/671378247 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87941a0420 con 0x7f8794105380 2024-09-21T01:15:18.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f879a582640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8794104a30 0x7f879419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:18.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.207+0000 7f879ad83640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879410de60 0x7f879419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:18.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.208+0000 7f8799d81640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8794105380 0x7f879419aa50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8784006010 tx=0x7f8784004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:18.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.208+0000 7f878b7fe640 1 -- 172.21.15.148:0/671378247 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878403f030 con 0x7f8794105380 2024-09-21T01:15:18.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.208+0000 7f879c7e6640 1 -- 172.21.15.148:0/671378247 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87941a06b0 con 0x7f8794105380 2024-09-21T01:15:18.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.208+0000 7f878b7fe640 1 -- 172.21.15.148:0/671378247 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8784003aa0 con 0x7f8794105380 2024-09-21T01:15:18.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.208+0000 7f878b7fe640 1 -- 172.21.15.148:0/671378247 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784035070 con 0x7f8794105380 2024-09-21T01:15:18.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.208+0000 7f879c7e6640 1 -- 172.21.15.148:0/671378247 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87941a6e70 con 0x7f8794105380 2024-09-21T01:15:18.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.212+0000 7f87a2d5a740 1 Processor -- start 2024-09-21T01:15:18.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.212+0000 7f87a2d5a740 1 -- start start 2024-09-21T01:15:18.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.212+0000 7f878b7fe640 1 -- 172.21.15.148:0/671378247 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f8784042030 con 0x7f8794105380 2024-09-21T01:15:18.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.212+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca7557270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 0x55dca75577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 0x55dca7557cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f87a2d5a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dca74cde50 con 0x55dca718f390 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f879ad83640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca7557270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f8799d81640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 0x55dca7557cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f879ad83640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca7557270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:49438/0 (socket says 172.21.15.148:49438) 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f879ad83640 1 -- 172.21.15.148:0/1988472041 learned_addr learned my addr 172.21.15.148:0/1988472041 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f879a582640 1 --2- 172.21.15.148:0/1988472041 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 0x55dca75577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1988472041 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55dca74bd280 con 0x55dca71871b0 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1988472041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55dca74c1090 con 0x55dca71b0070 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f879ad83640 1 -- 172.21.15.148:0/1988472041 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 msgr2=0x55dca75577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:18.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f879ad83640 1 --2- 172.21.15.148:0/1988472041 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 0x55dca75577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f879ad83640 1 -- 172.21.15.148:0/1988472041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 msgr2=0x55dca7557cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:18.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f879ad83640 1 --2- 172.21.15.148:0/1988472041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 0x55dca7557cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.213+0000 7f879ad83640 1 -- 172.21.15.148:0/1988472041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca721b650 con 0x55dca71b0070 2024-09-21T01:15:18.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.214+0000 7f879ad83640 1 --2- 172.21.15.148:0/1988472041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca7557270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f878c011790 tx=0x7f878c011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df68f029473e1e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:18.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.214+0000 7f8788ff9640 1 -- 172.21.15.148:0/1988472041 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c003c30 con 0x55dca71b0070 2024-09-21T01:15:18.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.214+0000 7f8788ff9640 1 -- 172.21.15.148:0/1988472041 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f878c00fe50 con 0x55dca71b0070 2024-09-21T01:15:18.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.214+0000 7f878b7fe640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87800b6620 0x7f87800b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.214+0000 7f8788ff9640 1 -- 172.21.15.148:0/1988472041 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c0193e0 con 0x55dca71b0070 2024-09-21T01:15:18.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.214+0000 7f879a582640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87800b6620 0x7f87800b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.215+0000 7f878b7fe640 1 -- 172.21.15.148:0/671378247 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f87841078b0 con 0x7f8794105380 2024-09-21T01:15:18.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.216+0000 7f879a582640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87800b6620 0x7f87800b8b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55dca7555ef0 tx=0x7f879000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:18.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.216+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1988472041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 msgr2=0x55dca7557270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.216+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/1988472041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca7557270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f878c011790 tx=0x7f878c011c50 comp rx=0 tx=0).stop 2024-09-21T01:15:18.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.216+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1988472041 shutdown_connections 2024-09-21T01:15:18.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.216+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/1988472041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 0x55dca7557cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.216+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/1988472041 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 0x55dca75577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.216+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/1988472041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca7557270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.216+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1988472041 >> 172.21.15.148:0/1988472041 conn(0x55dca71a4460 msgr2=0x55dca7555160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:18.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.217+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1988472041 shutdown_connections 2024-09-21T01:15:18.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.217+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1988472041 wait complete. 2024-09-21T01:15:18.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.217+0000 7f87a2d5a740 1 -- start start 2024-09-21T01:15:18.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.217+0000 7f87a2d5a740 1 Processor -- start 2024-09-21T01:15:18.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 0x55dca75628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 0x55dca7562e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca756eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f87a2d5a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dca731e700 con 0x55dca718f390 2024-09-21T01:15:18.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f87a2d5a740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55dca7458110 con 0x55dca71871b0 2024-09-21T01:15:18.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f87a2d5a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55dca7565a50 con 0x55dca71b0070 2024-09-21T01:15:18.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f87a2d5a740 10 client.0 _ll_register_callbacks cb 0x55dca7471990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:18.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f879a582640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 0x55dca75628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f879a582640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 0x55dca75628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:40314/0 (socket says 172.21.15.148:40314) 2024-09-21T01:15:18.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f879a582640 1 -- 172.21.15.148:0/1512708273 learned_addr learned my addr 172.21.15.148:0/1512708273 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:18.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f8799d81640 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 0x55dca7562e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.218+0000 7f879a582640 1 -- 172.21.15.148:0/1512708273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 msgr2=0x55dca756eda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:15:18.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.219+0000 7f879a582640 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca756eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.219+0000 7f879a582640 1 -- 172.21.15.148:0/1512708273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 msgr2=0x55dca7562e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:18.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.219+0000 7f879a582640 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 0x55dca7562e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.219+0000 7f879a582640 1 -- 172.21.15.148:0/1512708273 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca7485c40 con 0x55dca71871b0 2024-09-21T01:15:18.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.219+0000 7f8799d81640 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 0x55dca7562e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:18.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.219+0000 7f879a582640 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 0x55dca75628d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8790010910 tx=0x7f87900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88e52743d5573bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:18.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.219+0000 7f877dffb640 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-09-21T01:15:18.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.219+0000 7f877dffb640 1 -- 172.21.15.148:0/1512708273 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879001fb40 con 0x55dca71871b0 2024-09-21T01:15:18.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.220+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1512708273 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f878c00fe50 con 0x55dca71871b0 2024-09-21T01:15:18.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.220+0000 7f877dffb640 1 -- 172.21.15.148:0/1512708273 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f8790017030 con 0x55dca71871b0 2024-09-21T01:15:18.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.226+0000 7f877dffb640 1 -- 172.21.15.148:0/1512708273 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f879001fce0 con 0x55dca71871b0 2024-09-21T01:15:18.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.226+0000 7f87a2d5a740 10 client.25274 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:18.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.226+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1512708273 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dca7571810 con 0x55dca71871b0 2024-09-21T01:15:18.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.227+0000 7f877dffb640 1 -- 172.21.15.148:0/1512708273 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f878c00fe50 con 0x55dca71871b0 2024-09-21T01:15:18.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.227+0000 7f877dffb640 1 -- 172.21.15.148:0/1512708273 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f879001c3f0 con 0x55dca71871b0 2024-09-21T01:15:18.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.227+0000 7f87a2d5a740 10 client.25274 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:18.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.227+0000 7f87a2d5a740 10 client.25274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:18.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.227+0000 7f87a2d5a740 20 client.25274 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:18.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.227+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dca716e9f0 0x55dca7575220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.227+0000 7f87a2d5a740 4 client.25274 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:18.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.227+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1512708273 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dca74cfda0 con 0x55dca716e9f0 2024-09-21T01:15:18.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.227+0000 7f8799d81640 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dca716e9f0 0x55dca7575220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.228+0000 7f877dffb640 10 client.25274 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:18.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.228+0000 7f8799d81640 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dca716e9f0 0x55dca7575220 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79d0251939288b11 server_cookie=ecbb8f37e884d327 in_seq=0 out_seq=0 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.229+0000 7f877dffb640 1 -- 172.21.15.148:0/1512708273 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dca74cfda0 con 0x55dca716e9f0 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.229+0000 7f877dffb640 10 client.25274 handle_command_reply: tid=0 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.229+0000 7f87a2d5a740 1 client.25274 shutdown 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.229+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1512708273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 msgr2=0x55dca75628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.229+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 0x55dca75628d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8790010910 tx=0x7f87900046c0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.230+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1512708273 shutdown_connections 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.230+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dca716e9f0 0x55dca7575220 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.230+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca718f390 0x55dca7562e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.230+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca756eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.230+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/1512708273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca71871b0 0x55dca75628d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.230+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1512708273 >> 172.21.15.148:0/1512708273 conn(0x55dca71a4460 msgr2=0x55dca755a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:18.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.230+0000 7f877dffb640 0 client.25274 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:18.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.230+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1512708273 shutdown_connections 2024-09-21T01:15:18.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.230+0000 7f87a2d5a740 1 -- 172.21.15.148:0/1512708273 wait complete. 2024-09-21T01:15:18.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.230+0000 7f87a2d5a740 20 client.25274 trim_cache size 0 max 16384 2024-09-21T01:15:18.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.248+0000 7f87a2d5a740 1 Processor -- start 2024-09-21T01:15:18.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.248+0000 7f87a2d5a740 1 -- start start 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71871b0 0x55dca7562d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71b0070 0x55dca755fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f87a2d5a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f87941b1ca0 con 0x55dca71b0070 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f87a2d5a740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f87941af570 con 0x55dca718f390 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f87a2d5a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87941ad3c0 con 0x55dca71871b0 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f8799d81640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f8799d81640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:40324/0 (socket says 172.21.15.148:40324) 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f8799d81640 1 -- 172.21.15.148:0/3641270565 learned_addr learned my addr 172.21.15.148:0/3641270565 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f879a582640 1 --2- 172.21.15.148:0/3641270565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71871b0 0x55dca7562d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f879ad83640 1 --2- 172.21.15.148:0/3641270565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71b0070 0x55dca755fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f8799d81640 1 -- 172.21.15.148:0/3641270565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71871b0 msgr2=0x55dca7562d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:18.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f8799d81640 1 --2- 172.21.15.148:0/3641270565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71871b0 0x55dca7562d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f8799d81640 1 -- 172.21.15.148:0/3641270565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71b0070 msgr2=0x55dca755fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:18.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f8799d81640 1 --2- 172.21.15.148:0/3641270565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71b0070 0x55dca755fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f8799d81640 1 -- 172.21.15.148:0/3641270565 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca7563970 con 0x55dca718f390 2024-09-21T01:15:18.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.249+0000 7f879ad83640 1 --2- 172.21.15.148:0/3641270565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71b0070 0x55dca755fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:18.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.250+0000 7f8799d81640 1 --2- 172.21.15.148:0/3641270565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756eca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87840cd930 tx=0x7f878410d530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f38ae3ed78cc371a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:18.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.250+0000 7f877ffff640 1 -- 172.21.15.148:0/3641270565 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784049040 con 0x55dca718f390 2024-09-21T01:15:18.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.250+0000 7f877ffff640 1 -- 172.21.15.148:0/3641270565 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87840cd4b0 con 0x55dca718f390 2024-09-21T01:15:18.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.250+0000 7f877ffff640 1 -- 172.21.15.148:0/3641270565 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87840d7310 con 0x55dca718f390 2024-09-21T01:15:18.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.251+0000 7f87a2d5a740 1 -- 172.21.15.148:0/3641270565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 msgr2=0x55dca756eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.251+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/3641270565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756eca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87840cd930 tx=0x7f878410d530 comp rx=0 tx=0).stop 2024-09-21T01:15:18.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.251+0000 7f87a2d5a740 1 -- 172.21.15.148:0/3641270565 shutdown_connections 2024-09-21T01:15:18.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.251+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/3641270565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71b0070 0x55dca755fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.251+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/3641270565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756eca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.251+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/3641270565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71871b0 0x55dca7562d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.251+0000 7f87a2d5a740 1 -- 172.21.15.148:0/3641270565 >> 172.21.15.148:0/3641270565 conn(0x55dca71a4460 msgr2=0x55dca7562680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:18.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.251+0000 7f87a2d5a740 1 -- 172.21.15.148:0/3641270565 shutdown_connections 2024-09-21T01:15:18.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.251+0000 7f87a2d5a740 1 -- 172.21.15.148:0/3641270565 wait complete. 2024-09-21T01:15:18.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.252+0000 7f87a2d5a740 1 -- start start 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.252+0000 7f87a2d5a740 1 Processor -- start 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.252+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71871b0 0x55dca75db620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.252+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.252+0000 7f87a2d5a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca756b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.252+0000 7f87a2d5a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f87941ada30 con 0x55dca71871b0 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f87a2d5a740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f87941aeea0 con 0x55dca718f390 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f87a2d5a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87941ae100 con 0x55dca71b0070 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f8799d81640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f879a582640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71871b0 0x55dca75db620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f8799d81640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:40336/0 (socket says 172.21.15.148:40336) 2024-09-21T01:15:18.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f879a582640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71871b0 0x55dca75db620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39932/0 (socket says 172.21.15.148:39932) 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f8799d81640 1 -- 172.21.15.148:0/2575476523 learned_addr learned my addr 172.21.15.148:0/2575476523 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f87a2d5a740 10 client.0 _ll_register_callbacks cb 0x7f879000bc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f8799d81640 1 -- 172.21.15.148:0/2575476523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 msgr2=0x55dca756b3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f8799d81640 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca756b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f8799d81640 1 -- 172.21.15.148:0/2575476523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71871b0 msgr2=0x55dca75db620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f8799d81640 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71871b0 0x55dca75db620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f8799d81640 1 -- 172.21.15.148:0/2575476523 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca75d8af0 con 0x55dca718f390 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f8799d81640 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756ad00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87841052f0 tx=0x7f8784005a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aba470784318a7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.253+0000 7f877dffb640 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f877dffb640 1 -- 172.21.15.148:0/2575476523 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784049050 con 0x55dca718f390 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f87a2d5a740 1 -- 172.21.15.148:0/2575476523 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87840cd4b0 con 0x55dca718f390 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f877dffb640 1 -- 172.21.15.148:0/2575476523 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f87840c9c10 con 0x55dca718f390 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f877dffb640 1 -- 172.21.15.148:0/2575476523 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f87840c9840 con 0x55dca718f390 2024-09-21T01:15:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f87a2d5a740 10 client.25280 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f87a2d5a740 1 -- 172.21.15.148:0/2575476523 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dca75e40f0 con 0x55dca718f390 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f877dffb640 1 -- 172.21.15.148:0/2575476523 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87840cd4b0 con 0x55dca718f390 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f877dffb640 1 -- 172.21.15.148:0/2575476523 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f87840ccd20 con 0x55dca718f390 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f87a2d5a740 10 client.25280 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f87a2d5a740 10 client.25280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.254+0000 7f87a2d5a740 20 client.25280 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.255+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dca7143da0 0x55dca75e67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.255+0000 7f87a2d5a740 4 client.25280 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.255+0000 7f87a2d5a740 1 -- 172.21.15.148:0/2575476523 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dca74cb850 con 0x55dca7143da0 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.255+0000 7f879a582640 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dca7143da0 0x55dca75e67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.255+0000 7f877dffb640 10 client.25280 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.256+0000 7f879a582640 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dca7143da0 0x55dca75e67c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2fb5dc07da5f3a3 server_cookie=57109c622ad4fbe1 in_seq=0 out_seq=0 2024-09-21T01:15:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f877dffb640 1 -- 172.21.15.148:0/2575476523 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x55dca74cb850 con 0x55dca7143da0 2024-09-21T01:15:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f877dffb640 10 client.25280 handle_command_reply: tid=0 2024-09-21T01:15:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 client.25280 shutdown 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 -- 172.21.15.148:0/2575476523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 msgr2=0x55dca756ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756ad00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87841052f0 tx=0x7f8784005a40 comp rx=0 tx=0).stop 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 -- 172.21.15.148:0/2575476523 shutdown_connections 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dca7143da0 0x55dca75e67c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f877dffb640 0 client.25280 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dca71b0070 0x55dca756b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dca718f390 0x55dca756ad00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 --2- 172.21.15.148:0/2575476523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dca71871b0 0x55dca75db620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 -- 172.21.15.148:0/2575476523 >> 172.21.15.148:0/2575476523 conn(0x55dca71a4460 msgr2=0x55dca75582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 -- 172.21.15.148:0/2575476523 shutdown_connections 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 1 -- 172.21.15.148:0/2575476523 wait complete. 2024-09-21T01:15:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.257+0000 7f87a2d5a740 20 client.25280 trim_cache size 0 max 16384 2024-09-21T01:15:18.261 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:15:18.261 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "no active scrubs running", 2024-09-21T01:15:18.261 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": {}, 2024-09-21T01:15:18.261 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_stats": { 2024-09-21T01:15:18.261 INFO:teuthology.orchestra.run.smithi148.stdout: "0705e125-8af9-4cc6-98ec-fca2de415bde": { 2024-09-21T01:15:18.261 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:14:45.199229+0000", 2024-09-21T01:15:18.261 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:15:18.261 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:15:18.261 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:15:18.261 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: "7bf59ed6-eedb-4a06-a813-d8af8d9118b7": { 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:14:02.691995+0000", 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:15:18.262 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:15:18.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 -- 172.21.15.148:0/671378247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87800b6620 msgr2=0x7f87800b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87800b6620 0x7f87800b8b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55dca7555ef0 tx=0x7f879000b410 comp rx=0 tx=0).stop 2024-09-21T01:15:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 -- 172.21.15.148:0/671378247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8794105380 msgr2=0x7f879419aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8794105380 0x7f879419aa50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8784006010 tx=0x7f8784004060 comp rx=0 tx=0).stop 2024-09-21T01:15:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 -- 172.21.15.148:0/671378247 shutdown_connections 2024-09-21T01:15:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87800b6620 0x7f87800b8b30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f879410de60 0x7f879419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8794105380 0x7f879419aa50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 --2- 172.21.15.148:0/671378247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8794104a30 0x7f879419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 -- 172.21.15.148:0/671378247 >> 172.21.15.148:0/671378247 conn(0x7f87940797b0 msgr2=0x7f87941008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 -- 172.21.15.148:0/671378247 shutdown_connections 2024-09-21T01:15:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:18.258+0000 7f879c7e6640 1 -- 172.21.15.148:0/671378247 wait complete. 2024-09-21T01:15:18.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:18 smithi148 ceph-mon[31000]: pgmap v377: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 693 KiB/s wr, 13 op/s 2024-09-21T01:15:18.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:18 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:15:18.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:18 smithi181 ceph-mon[34811]: pgmap v377: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 693 KiB/s wr, 13 op/s 2024-09-21T01:15:18.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:18 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:15:18.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:18 smithi157 ceph-mon[34140]: pgmap v377: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 693 KiB/s wr, 13 op/s 2024-09-21T01:15:18.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:18 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:15:19.146 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:15:19.147 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:15:19.463 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:19.723 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:19 smithi148 ceph-mon[31000]: pgmap v378: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-21T01:15:19.723 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.723 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.724 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.724 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.724 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:15:19.724 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:15:19.724 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:19 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:19 smithi181 ceph-mon[34811]: pgmap v378: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-21T01:15:19.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:15:19.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:15:19.731 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:19 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:19 smithi157 ceph-mon[34140]: pgmap v378: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-21T01:15:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:15:19.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:15:19.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:19 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:15:19.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.941+0000 7efde03aa640 1 -- 172.21.15.148:0/1452031275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd8101de0 msgr2=0x7efdd81021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.941+0000 7efde03aa640 1 --2- 172.21.15.148:0/1452031275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd8101de0 0x7efdd81021f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009900 tx=0x7efdc802a410 comp rx=0 tx=0).stop 2024-09-21T01:15:19.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.941+0000 7efde03aa640 1 -- 172.21.15.148:0/1452031275 shutdown_connections 2024-09-21T01:15:19.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.941+0000 7efde03aa640 1 --2- 172.21.15.148:0/1452031275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd8101de0 0x7efdd81021f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.941+0000 7efde03aa640 1 --2- 172.21.15.148:0/1452031275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd8102730 0x7efdd8110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.941+0000 7efde03aa640 1 --2- 172.21.15.148:0/1452031275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdd81086f0 0x7efdd8108b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.941+0000 7efde03aa640 1 -- 172.21.15.148:0/1452031275 >> 172.21.15.148:0/1452031275 conn(0x7efdd8077c60 msgr2=0x7efdd80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:19.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.941+0000 7efde03aa640 1 -- 172.21.15.148:0/1452031275 shutdown_connections 2024-09-21T01:15:19.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.941+0000 7efde03aa640 1 -- 172.21.15.148:0/1452031275 wait complete. 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.942+0000 7efde03aa640 1 Processor -- start 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.942+0000 7efde03aa640 1 -- start start 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efde03aa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd8101de0 0x7efdd819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efde03aa640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdd8102730 0x7efdd819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efde03aa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd81086f0 0x7efdd81a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efde03aa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efdd8113aa0 con 0x7efdd81086f0 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efde03aa640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efdd8113920 con 0x7efdd8102730 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efde03aa640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efdd8113c20 con 0x7efdd8101de0 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efdde947640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd81086f0 0x7efdd81a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efdde947640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd81086f0 0x7efdd81a1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39946/0 (socket says 172.21.15.148:39946) 2024-09-21T01:15:19.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efdde947640 1 -- 172.21.15.148:0/3876563160 learned_addr learned my addr 172.21.15.148:0/3876563160 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:19.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efdde146640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd8101de0 0x7efdd819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efddd945640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdd8102730 0x7efdd819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efdde947640 1 -- 172.21.15.148:0/3876563160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd8101de0 msgr2=0x7efdd819c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efdde947640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd8101de0 0x7efdd819c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efdde947640 1 -- 172.21.15.148:0/3876563160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdd8102730 msgr2=0x7efdd819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efdde947640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdd8102730 0x7efdd819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efdde947640 1 -- 172.21.15.148:0/3876563160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd81a25e0 con 0x7efdd81086f0 2024-09-21T01:15:19.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.943+0000 7efdde947640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd81086f0 0x7efdd81a1f70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efdd000eaa0 tx=0x7efdd000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:19.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.944+0000 7efdcf7fe640 1 -- 172.21.15.148:0/3876563160 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0004d20 con 0x7efdd81086f0 2024-09-21T01:15:19.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.944+0000 7efde03aa640 1 -- 172.21.15.148:0/3876563160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd81a28d0 con 0x7efdd81086f0 2024-09-21T01:15:19.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.944+0000 7efdcf7fe640 1 -- 172.21.15.148:0/3876563160 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdd0005020 con 0x7efdd81086f0 2024-09-21T01:15:19.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.944+0000 7efdcf7fe640 1 -- 172.21.15.148:0/3876563160 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd00116d0 con 0x7efdd81086f0 2024-09-21T01:15:19.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.944+0000 7efde03aa640 1 -- 172.21.15.148:0/3876563160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd81a90f0 con 0x7efdd81086f0 2024-09-21T01:15:19.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.945+0000 7efde03aa640 1 -- 172.21.15.148:0/3876563160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd81021f0 con 0x7efdd81086f0 2024-09-21T01:15:19.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.946+0000 7efdcf7fe640 1 -- 172.21.15.148:0/3876563160 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7efdd000caf0 con 0x7efdd81086f0 2024-09-21T01:15:19.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.947+0000 7efdcf7fe640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efdc40b65d0 0x7efdc40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.947+0000 7efdde146640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efdc40b65d0 0x7efdc40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.947+0000 7efdcf7fe640 1 -- 172.21.15.148:0/3876563160 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7efdd00e7910 con 0x7efdd81086f0 2024-09-21T01:15:19.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.948+0000 7efdde146640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efdc40b65d0 0x7efdc40b8ae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efdd400ab60 tx=0x7efdd400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:19.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:19.951+0000 7efdcf7fe640 1 -- 172.21.15.148:0/3876563160 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efdd0016030 con 0x7efdd81086f0 2024-09-21T01:15:20.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.175+0000 7efde03aa640 1 -- 172.21.15.148:0/3876563160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdd819d860 con 0x7efdd81086f0 2024-09-21T01:15:20.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.176+0000 7efdcf7fe640 1 -- 172.21.15.148:0/3876563160 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11927 (secure 0 0 0) 0x7efdd00ae050 con 0x7efdd81086f0 2024-09-21T01:15:20.177 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:15:20.177 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-21T01:15:07:196837+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:15:06.787318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24646,24631]},"id":1}]} 2024-09-21T01:15:20.178 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-21T01:15:20.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.179+0000 7efde03aa640 1 -- 172.21.15.148:0/3876563160 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efdc40b65d0 msgr2=0x7efdc40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.179+0000 7efde03aa640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efdc40b65d0 0x7efdc40b8ae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efdd400ab60 tx=0x7efdd400a2d0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.179+0000 7efde03aa640 1 -- 172.21.15.148:0/3876563160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd81086f0 msgr2=0x7efdd81a1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.179+0000 7efde03aa640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd81086f0 0x7efdd81a1f70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efdd000eaa0 tx=0x7efdd000eea0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.179+0000 7efde03aa640 1 -- 172.21.15.148:0/3876563160 shutdown_connections 2024-09-21T01:15:20.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.179+0000 7efde03aa640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7efdc40b65d0 0x7efdc40b8ae0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.179+0000 7efde03aa640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd81086f0 0x7efdd81a1f70 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.179+0000 7efde03aa640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdd8102730 0x7efdd819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.179+0000 7efde03aa640 1 --2- 172.21.15.148:0/3876563160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdd8101de0 0x7efdd819c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.179+0000 7efde03aa640 1 -- 172.21.15.148:0/3876563160 >> 172.21.15.148:0/3876563160 conn(0x7efdd8077c60 msgr2=0x7efdd8106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.180+0000 7efde03aa640 1 -- 172.21.15.148:0/3876563160 shutdown_connections 2024-09-21T01:15:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:20.180+0000 7efde03aa640 1 -- 172.21.15.148:0/3876563160 wait complete. 2024-09-21T01:15:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:20 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3876563160' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:20.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:20 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3876563160' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.813+0000 7f14622c5640 1 -- 172.21.15.148:0/410887855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f145c103650 msgr2=0x7f145c103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.813+0000 7f14622c5640 1 --2- 172.21.15.148:0/410887855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f145c103650 0x7f145c103a60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1444009900 tx=0x7f144402a410 comp rx=0 tx=0).stop 2024-09-21T01:15:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.813+0000 7f14622c5640 1 -- 172.21.15.148:0/410887855 shutdown_connections 2024-09-21T01:15:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.813+0000 7f14622c5640 1 --2- 172.21.15.148:0/410887855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f145c103650 0x7f145c103a60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.813+0000 7f14622c5640 1 --2- 172.21.15.148:0/410887855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145c103ff0 0x7f145c10a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.813+0000 7f14622c5640 1 --2- 172.21.15.148:0/410887855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f145c1025d0 0x7f145c102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.813+0000 7f14622c5640 1 -- 172.21.15.148:0/410887855 >> 172.21.15.148:0/410887855 conn(0x7f145c0fdf30 msgr2=0x7f145c1003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.813+0000 7f14622c5640 1 -- 172.21.15.148:0/410887855 shutdown_connections 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.813+0000 7f14622c5640 1 -- 172.21.15.148:0/410887855 wait complete. 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f14622c5640 1 Processor -- start 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f14622c5640 1 -- start start 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f14622c5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145c1025d0 0x7f145c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f14622c5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f145c103650 0x7f145c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f14622c5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f145c103ff0 0x7f145c19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f14622c5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f145c10e270 con 0x7f145c103ff0 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f14622c5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f145c10e0f0 con 0x7f145c1025d0 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f14622c5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f145c10e3f0 con 0x7f145c103650 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f1460862640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f145c103ff0 0x7f145c19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f1460862640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f145c103ff0 0x7f145c19b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39958/0 (socket says 172.21.15.148:39958) 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f1460862640 1 -- 172.21.15.148:0/564472952 learned_addr learned my addr 172.21.15.148:0/564472952 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.814+0000 7f1453fff640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f145c103650 0x7f145c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f145bfff640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145c1025d0 0x7f145c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f1460862640 1 -- 172.21.15.148:0/564472952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f145c103650 msgr2=0x7f145c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f1460862640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f145c103650 0x7f145c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f1460862640 1 -- 172.21.15.148:0/564472952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145c1025d0 msgr2=0x7f145c19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f1460862640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145c1025d0 0x7f145c19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f1460862640 1 -- 172.21.15.148:0/564472952 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c19ba00 con 0x7f145c103ff0 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f1460862640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f145c103ff0 0x7f145c19b1e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f145400cad0 tx=0x7f145400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f1459ffb640 1 -- 172.21.15.148:0/564472952 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145400ae20 con 0x7f145c103ff0 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f14622c5640 1 -- 172.21.15.148:0/564472952 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145c19bcf0 con 0x7f145c103ff0 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f1459ffb640 1 -- 172.21.15.148:0/564472952 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1454005020 con 0x7f145c103ff0 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f1459ffb640 1 -- 172.21.15.148:0/564472952 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145400f6b0 con 0x7f145c103ff0 2024-09-21T01:15:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.815+0000 7f14622c5640 1 -- 172.21.15.148:0/564472952 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f145c1a23e0 con 0x7f145c103ff0 2024-09-21T01:15:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.818+0000 7f1469234740 1 Processor -- start 2024-09-21T01:15:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.818+0000 7f1459ffb640 1 -- 172.21.15.148:0/564472952 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f145400f850 con 0x7f145c103ff0 2024-09-21T01:15:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1469234740 1 -- start start 2024-09-21T01:15:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1469234740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8b21b0 0x561b2fc59e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1469234740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc5a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1469234740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc5b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1469234740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561b2fbcc6f0 con 0x561b2f8892f0 2024-09-21T01:15:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1469234740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561b2fbbbb20 con 0x561b2f8b21b0 2024-09-21T01:15:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1469234740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b2fbbf930 con 0x561b2f8914d0 2024-09-21T01:15:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f145bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc5a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f145bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc5a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39960/0 (socket says 172.21.15.148:39960) 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f145bfff640 1 -- 172.21.15.148:0/3379833625 learned_addr learned my addr 172.21.15.148:0/3379833625 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1453fff640 1 --2- 172.21.15.148:0/3379833625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc5b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f145bfff640 1 -- 172.21.15.148:0/3379833625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 msgr2=0x561b2fc5b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f145bfff640 1 --2- 172.21.15.148:0/3379833625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc5b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1453fff640 1 --2- 172.21.15.148:0/3379833625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8b21b0 0x561b2fc59e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f145bfff640 1 -- 172.21.15.148:0/3379833625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8b21b0 msgr2=0x561b2fc59e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f145bfff640 1 --2- 172.21.15.148:0/3379833625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8b21b0 0x561b2fc59e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f145bfff640 1 -- 172.21.15.148:0/3379833625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b2fb81530 con 0x561b2f8892f0 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1453fff640 1 --2- 172.21.15.148:0/3379833625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8b21b0 0x561b2fc59e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.819+0000 7f1459ffb640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f14480b65a0 0x7f14480b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.820+0000 7f145bfff640 1 --2- 172.21.15.148:0/3379833625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc5a4c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f144c00bcf0 tx=0x7f144c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306007d31fc3f0e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.820+0000 7f1453fff640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f14480b65a0 0x7f14480b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.820+0000 7f1459ffb640 1 -- 172.21.15.148:0/564472952 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f14540e7510 con 0x7f145c103ff0 2024-09-21T01:15:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.820+0000 7f14527fc640 1 -- 172.21.15.148:0/3379833625 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c015070 con 0x561b2f8892f0 2024-09-21T01:15:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.820+0000 7f14527fc640 1 -- 172.21.15.148:0/3379833625 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f144c01a910 con 0x561b2f8892f0 2024-09-21T01:15:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.820+0000 7f14527fc640 1 -- 172.21.15.148:0/3379833625 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c0119a0 con 0x561b2f8892f0 2024-09-21T01:15:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.821+0000 7f1453fff640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f14480b65a0 0x7f14480b8ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1444004770 tx=0x7f14440314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.821+0000 7f1469234740 1 -- 172.21.15.148:0/3379833625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 msgr2=0x561b2fc5a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.821+0000 7f1469234740 1 --2- 172.21.15.148:0/3379833625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc5a4c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f144c00bcf0 tx=0x7f144c00f730 comp rx=0 tx=0).stop 2024-09-21T01:15:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.821+0000 7f1469234740 1 -- 172.21.15.148:0/3379833625 shutdown_connections 2024-09-21T01:15:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.821+0000 7f1469234740 1 --2- 172.21.15.148:0/3379833625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc5a4c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.821+0000 7f1469234740 1 --2- 172.21.15.148:0/3379833625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc5b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.821+0000 7f1469234740 1 --2- 172.21.15.148:0/3379833625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8b21b0 0x561b2fc59e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.821+0000 7f1469234740 1 -- 172.21.15.148:0/3379833625 >> 172.21.15.148:0/3379833625 conn(0x561b2f8a6300 msgr2=0x561b2fc558e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.821+0000 7f1469234740 1 -- 172.21.15.148:0/3379833625 shutdown_connections 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.821+0000 7f1469234740 1 -- 172.21.15.148:0/3379833625 wait complete. 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.822+0000 7f1469234740 1 -- start start 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.822+0000 7f1469234740 1 Processor -- start 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1469234740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 0x561b2fc635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1469234740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc63c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1469234740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc64800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1469234740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561b2faf3ab0 con 0x561b2f8b21b0 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1469234740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561b2fb61730 con 0x561b2f8892f0 2024-09-21T01:15:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1469234740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b2fc5bb30 con 0x561b2f8914d0 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1469234740 10 client.0 _ll_register_callbacks cb 0x561b2fbb56b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1460862640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc64800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1460862640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc64800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39976/0 (socket says 172.21.15.148:39976) 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1460862640 1 -- 172.21.15.148:0/4020247382 learned_addr learned my addr 172.21.15.148:0/4020247382 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f145bfff640 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 0x561b2fc635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1453fff640 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc63c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1460862640 1 -- 172.21.15.148:0/4020247382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 msgr2=0x561b2fc63c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1460862640 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc63c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1460862640 1 -- 172.21.15.148:0/4020247382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 msgr2=0x561b2fc635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1460862640 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 0x561b2fc635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1460862640 1 -- 172.21.15.148:0/4020247382 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b2f91d790 con 0x561b2f8b21b0 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1453fff640 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc63c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f1460862640 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc64800 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f14540ad4e0 tx=0x7f14540ad130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aeacdfcef485f65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f143b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.823+0000 7f143b7fe640 1 -- 172.21.15.148:0/4020247382 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145401d030 con 0x561b2f8b21b0 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f143b7fe640 1 -- 172.21.15.148:0/4020247382 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f14540e72e0 con 0x561b2f8b21b0 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f1469234740 1 -- 172.21.15.148:0/4020247382 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f144c01a910 con 0x561b2f8b21b0 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f143b7fe640 1 -- 172.21.15.148:0/4020247382 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f14540b6f70 con 0x561b2f8b21b0 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f1469234740 10 client.15660 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f1469234740 1 -- 172.21.15.148:0/4020247382 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561b2f996620 con 0x561b2f8b21b0 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f143b7fe640 1 -- 172.21.15.148:0/4020247382 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f144c01a910 con 0x561b2f8b21b0 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f143b7fe640 1 -- 172.21.15.148:0/4020247382 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f1454094ce0 con 0x561b2f8b21b0 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f1469234740 10 client.15660 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f1469234740 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f1469234740 20 client.15660 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f1469234740 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b2f870d80 0x561b2fc70cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f1469234740 4 client.15660 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.824+0000 7f1469234740 1 -- 172.21.15.148:0/4020247382 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b2fbce640 con 0x561b2f870d80 2024-09-21T01:15:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.825+0000 7f145bfff640 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b2f870d80 0x561b2fc70cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.825+0000 7f143b7fe640 10 client.15660 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.825+0000 7f145bfff640 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b2f870d80 0x561b2fc70cc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb403e8080909fe8 server_cookie=33c8fbcc50f32708 in_seq=0 out_seq=0 2024-09-21T01:15:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.826+0000 7f143b7fe640 1 -- 172.21.15.148:0/4020247382 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b2fbce640 con 0x561b2f870d80 2024-09-21T01:15:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.826+0000 7f143b7fe640 10 client.15660 handle_command_reply: tid=0 2024-09-21T01:15:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.826+0000 7f1469234740 1 client.15660 shutdown 2024-09-21T01:15:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.826+0000 7f1469234740 1 -- 172.21.15.148:0/4020247382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 msgr2=0x561b2fc64800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.826+0000 7f1469234740 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc64800 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f14540ad4e0 tx=0x7f14540ad130 comp rx=0 tx=0).stop 2024-09-21T01:15:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.827+0000 7f1469234740 1 -- 172.21.15.148:0/4020247382 shutdown_connections 2024-09-21T01:15:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.827+0000 7f1469234740 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b2f870d80 0x561b2fc70cc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.827+0000 7f1469234740 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc64800 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.827+0000 7f143b7fe640 0 client.15660 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.827+0000 7f1469234740 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc63c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.827+0000 7f1469234740 1 --2- 172.21.15.148:0/4020247382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 0x561b2fc635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.827+0000 7f1469234740 1 -- 172.21.15.148:0/4020247382 >> 172.21.15.148:0/4020247382 conn(0x561b2f8a6300 msgr2=0x561b2fc53ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.827+0000 7f1469234740 1 -- 172.21.15.148:0/4020247382 shutdown_connections 2024-09-21T01:15:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.827+0000 7f1469234740 1 -- 172.21.15.148:0/4020247382 wait complete. 2024-09-21T01:15:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.827+0000 7f1469234740 20 client.15660 trim_cache size 0 max 16384 2024-09-21T01:15:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.841+0000 7f1469234740 1 Processor -- start 2024-09-21T01:15:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.841+0000 7f1469234740 1 -- start start 2024-09-21T01:15:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f1469234740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc505c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f1469234740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8914d0 0x561b2fc61ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f1469234740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8b21b0 0x561b2fc62020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f1469234740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1ad810 con 0x561b2f8892f0 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f1469234740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1ab0e0 con 0x561b2f8914d0 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f1469234740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1a8f30 con 0x561b2f8b21b0 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f145bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f145bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc505c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39986/0 (socket says 172.21.15.148:39986) 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f145bfff640 1 -- 172.21.15.148:0/2245771819 learned_addr learned my addr 172.21.15.148:0/2245771819 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f1460862640 1 --2- 172.21.15.148:0/2245771819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8b21b0 0x561b2fc62020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f1453fff640 1 --2- 172.21.15.148:0/2245771819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8914d0 0x561b2fc61ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f145bfff640 1 -- 172.21.15.148:0/2245771819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8b21b0 msgr2=0x561b2fc62020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f145bfff640 1 --2- 172.21.15.148:0/2245771819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8b21b0 0x561b2fc62020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f145bfff640 1 -- 172.21.15.148:0/2245771819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8914d0 msgr2=0x561b2fc61ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f145bfff640 1 --2- 172.21.15.148:0/2245771819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8914d0 0x561b2fc61ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.842+0000 7f145bfff640 1 -- 172.21.15.148:0/2245771819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b2fc64000 con 0x561b2f8892f0 2024-09-21T01:15:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.843+0000 7f145bfff640 1 --2- 172.21.15.148:0/2245771819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc505c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f144c006010 tx=0x7f144c005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b48a8e931ab779 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.843+0000 7f1451ffb640 1 -- 172.21.15.148:0/2245771819 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c030070 con 0x561b2f8892f0 2024-09-21T01:15:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.843+0000 7f1451ffb640 1 -- 172.21.15.148:0/2245771819 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f144c0055f0 con 0x561b2f8892f0 2024-09-21T01:15:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.843+0000 7f1451ffb640 1 -- 172.21.15.148:0/2245771819 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c015040 con 0x561b2f8892f0 2024-09-21T01:15:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 -- 172.21.15.148:0/2245771819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 msgr2=0x561b2fc505c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 --2- 172.21.15.148:0/2245771819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc505c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f144c006010 tx=0x7f144c005280 comp rx=0 tx=0).stop 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 -- 172.21.15.148:0/2245771819 shutdown_connections 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 --2- 172.21.15.148:0/2245771819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8b21b0 0x561b2fc62020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 --2- 172.21.15.148:0/2245771819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8914d0 0x561b2fc61ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 --2- 172.21.15.148:0/2245771819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8892f0 0x561b2fc505c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 -- 172.21.15.148:0/2245771819 >> 172.21.15.148:0/2245771819 conn(0x561b2f8a6300 msgr2=0x561b2fc5ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 -- 172.21.15.148:0/2245771819 shutdown_connections 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 -- 172.21.15.148:0/2245771819 wait complete. 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 -- start start 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.844+0000 7f1469234740 1 Processor -- start 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1469234740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 0x561b2fc6b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1469234740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc6a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1469234740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc6a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1469234740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1a95a0 con 0x561b2f8b21b0 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1469234740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1aaa10 con 0x561b2f8892f0 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1469234740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1a9c70 con 0x561b2f8914d0 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1469234740 10 client.0 _ll_register_callbacks cb 0x7f14540a93f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1460862640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc6a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1460862640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc6a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40000/0 (socket says 172.21.15.148:40000) 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1460862640 1 -- 172.21.15.148:0/1157622011 learned_addr learned my addr 172.21.15.148:0/1157622011 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f145bfff640 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 0x561b2fc6b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1453fff640 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc6a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1460862640 1 -- 172.21.15.148:0/1157622011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 msgr2=0x561b2fc6a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1460862640 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc6a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1460862640 1 -- 172.21.15.148:0/1157622011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 msgr2=0x561b2fc6b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1460862640 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 0x561b2fc6b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1460862640 1 -- 172.21.15.148:0/1157622011 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b2fc6acd0 con 0x561b2f8b21b0 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f145bfff640 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 0x561b2fc6b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f1460862640 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc6a590 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f14540e4f50 tx=0x7f145400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95475ca2ab42bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.845+0000 7f143b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f143b7fe640 1 -- 172.21.15.148:0/1157622011 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14540c8060 con 0x561b2f8b21b0 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f143b7fe640 1 -- 172.21.15.148:0/1157622011 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f14540a8ea0 con 0x561b2f8b21b0 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f1469234740 1 -- 172.21.15.148:0/1157622011 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b2fbca0f0 con 0x561b2f8b21b0 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f143b7fe640 1 -- 172.21.15.148:0/1157622011 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f145401d040 con 0x561b2f8b21b0 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f1469234740 10 client.15666 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f1469234740 1 -- 172.21.15.148:0/1157622011 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561b2fcdb6c0 con 0x561b2f8b21b0 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f143b7fe640 1 -- 172.21.15.148:0/1157622011 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561b2fbca0f0 con 0x561b2f8b21b0 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f143b7fe640 1 -- 172.21.15.148:0/1157622011 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f1454094ce0 con 0x561b2f8b21b0 2024-09-21T01:15:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f1469234740 10 client.15666 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f1469234740 10 client.15666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f1469234740 20 client.15666 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f1469234740 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b2f8461c0 0x561b2fcddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f1469234740 4 client.15666 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:15:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.846+0000 7f1469234740 1 -- 172.21.15.148:0/1157622011 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b2fbc7520 con 0x561b2f8461c0 2024-09-21T01:15:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.847+0000 7f145bfff640 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b2f8461c0 0x561b2fcddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.847+0000 7f143b7fe640 10 client.15666 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.847+0000 7f145bfff640 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b2f8461c0 0x561b2fcddef0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d0a24ba15ba6cda server_cookie=a5930f4c9d5948a4 in_seq=0 out_seq=0 2024-09-21T01:15:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f143b7fe640 1 -- 172.21.15.148:0/1157622011 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b2fbc7520 con 0x561b2f8461c0 2024-09-21T01:15:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f143b7fe640 10 client.15666 handle_command_reply: tid=0 2024-09-21T01:15:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f1469234740 1 client.15666 shutdown 2024-09-21T01:15:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f1469234740 1 -- 172.21.15.148:0/1157622011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 msgr2=0x561b2fc6a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f1469234740 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc6a590 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f14540e4f50 tx=0x7f145400a890 comp rx=0 tx=0).stop 2024-09-21T01:15:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f1469234740 1 -- 172.21.15.148:0/1157622011 shutdown_connections 2024-09-21T01:15:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f1469234740 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b2f8461c0 0x561b2fcddef0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f1469234740 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b2f8b21b0 0x561b2fc6a590 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f1469234740 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b2f8914d0 0x561b2fc6a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f143b7fe640 0 client.15666 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f1469234740 1 --2- 172.21.15.148:0/1157622011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b2f8892f0 0x561b2fc6b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.854+0000 7f1469234740 1 -- 172.21.15.148:0/1157622011 >> 172.21.15.148:0/1157622011 conn(0x561b2f8a6300 msgr2=0x561b2fc5ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f1469234740 1 -- 172.21.15.148:0/1157622011 shutdown_connections 2024-09-21T01:15:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f1469234740 1 -- 172.21.15.148:0/1157622011 wait complete. 2024-09-21T01:15:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f1469234740 20 client.15666 trim_cache size 0 max 16384 2024-09-21T01:15:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-21T01:15:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-21T01:15:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-21T01:15:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-21T01:15:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 -- 172.21.15.148:0/564472952 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f14480b65a0 msgr2=0x7f14480b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f14480b65a0 0x7f14480b8ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1444004770 tx=0x7f14440314a0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 -- 172.21.15.148:0/564472952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f145c103ff0 msgr2=0x7f145c19b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f145c103ff0 0x7f145c19b1e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f145400cad0 tx=0x7f145400cf90 comp rx=0 tx=0).stop 2024-09-21T01:15:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 -- 172.21.15.148:0/564472952 shutdown_connections 2024-09-21T01:15:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f14480b65a0 0x7f14480b8ab0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f145c103ff0 0x7f145c19b1e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f145c103650 0x7f145c19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 --2- 172.21.15.148:0/564472952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145c1025d0 0x7f145c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 -- 172.21.15.148:0/564472952 >> 172.21.15.148:0/564472952 conn(0x7f145c0fdf30 msgr2=0x7f145c0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 -- 172.21.15.148:0/564472952 shutdown_connections 2024-09-21T01:15:20.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:20.855+0000 7f14622c5640 1 -- 172.21.15.148:0/564472952 wait complete. 2024-09-21T01:15:20.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:20 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3876563160' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:20.941 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:21.670 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:21 smithi148 ceph-mon[31000]: pgmap v379: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 860 KiB/s wr, 10 op/s 2024-09-21T01:15:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:21 smithi181 ceph-mon[34811]: pgmap v379: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 860 KiB/s wr, 10 op/s 2024-09-21T01:15:21.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:21 smithi157 ceph-mon[34140]: pgmap v379: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 860 KiB/s wr, 10 op/s 2024-09-21T01:15:21.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.767+0000 7f8a30f82640 1 -- 172.21.15.148:0/3224030617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103b80 msgr2=0x7f8a2c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.767+0000 7f8a30f82640 1 --2- 172.21.15.148:0/3224030617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103b80 0x7f8a2c103f90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009900 tx=0x7f8a1c02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:21.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.767+0000 7f8a30f82640 1 -- 172.21.15.148:0/3224030617 shutdown_connections 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.767+0000 7f8a30f82640 1 --2- 172.21.15.148:0/3224030617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c109e10 0x7f8a2c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.767+0000 7f8a30f82640 1 --2- 172.21.15.148:0/3224030617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c1094c0 0x7f8a2c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.767+0000 7f8a30f82640 1 --2- 172.21.15.148:0/3224030617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103b80 0x7f8a2c103f90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.767+0000 7f8a30f82640 1 -- 172.21.15.148:0/3224030617 >> 172.21.15.148:0/3224030617 conn(0x7f8a2c0ff610 msgr2=0x7f8a2c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.768+0000 7f8a30f82640 1 -- 172.21.15.148:0/3224030617 shutdown_connections 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.768+0000 7f8a30f82640 1 -- 172.21.15.148:0/3224030617 wait complete. 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.768+0000 7f8a30f82640 1 Processor -- start 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a30f82640 1 -- start start 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a30f82640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103b80 0x7f8a2c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a30f82640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c1094c0 0x7f8a2c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a30f82640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c109e10 0x7f8a2c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a30f82640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c113ad0 con 0x7f8a2c103b80 2024-09-21T01:15:21.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a30f82640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c113950 con 0x7f8a2c1094c0 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a30f82640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c113c50 con 0x7f8a2c109e10 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a2a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103b80 0x7f8a2c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a2a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103b80 0x7f8a2c19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40008/0 (socket says 172.21.15.148:40008) 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a2a59c640 1 -- 172.21.15.148:0/1794651051 learned_addr learned my addr 172.21.15.148:0/1794651051 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a2ad9d640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c109e10 0x7f8a2c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c1094c0 0x7f8a2c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a2a59c640 1 -- 172.21.15.148:0/1794651051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c109e10 msgr2=0x7f8a2c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c109e10 0x7f8a2c19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a2a59c640 1 -- 172.21.15.148:0/1794651051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c1094c0 msgr2=0x7f8a2c19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c1094c0 0x7f8a2c19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.769+0000 7f8a2a59c640 1 -- 172.21.15.148:0/1794651051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c1a0430 con 0x7f8a2c103b80 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.770+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103b80 0x7f8a2c19a4c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c005940 tx=0x7f8a1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.770+0000 7f8a237fe640 1 -- 172.21.15.148:0/1794651051 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c03f030 con 0x7f8a2c103b80 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.770+0000 7f8a237fe640 1 -- 172.21.15.148:0/1794651051 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a1c003cb0 con 0x7f8a2c103b80 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.770+0000 7f8a30f82640 1 -- 172.21.15.148:0/1794651051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2c1a06c0 con 0x7f8a2c103b80 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.770+0000 7f8a237fe640 1 -- 172.21.15.148:0/1794651051 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c035070 con 0x7f8a2c103b80 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.770+0000 7f8a30f82640 1 -- 172.21.15.148:0/1794651051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2c1a6e80 con 0x7f8a2c103b80 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.773+0000 7f8a237fe640 1 -- 172.21.15.148:0/1794651051 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f8a1c042030 con 0x7f8a2c103b80 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.773+0000 7f8a374f6740 1 Processor -- start 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.773+0000 7f8a374f6740 1 -- start start 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.773+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab45070 0x561acaeec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.773+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaeecbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.773+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab24390 0x561acaeed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.773+0000 7f8a374f6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561acae62ea0 con 0x561acab1c1b0 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.773+0000 7f8a374f6740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561acae522d0 con 0x561acab45070 2024-09-21T01:15:21.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.773+0000 7f8a374f6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561acae560e0 con 0x561acab24390 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaeecbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2ad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab45070 0x561acaeec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2ad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab45070 0x561acaeec6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:40444/0 (socket says 172.21.15.148:40444) 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaeecbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40024/0 (socket says 172.21.15.148:40024) 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2ad9d640 1 -- 172.21.15.148:0/4102998834 learned_addr learned my addr 172.21.15.148:0/4102998834 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a237fe640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b65a0 0x7f8a180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/4102998834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab24390 0x561acaeed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2ad9d640 1 -- 172.21.15.148:0/4102998834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab24390 msgr2=0x561acaeed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2ad9d640 1 --2- 172.21.15.148:0/4102998834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab24390 0x561acaeed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2ad9d640 1 -- 172.21.15.148:0/4102998834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 msgr2=0x561acaeecbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a237fe640 1 -- 172.21.15.148:0/1794651051 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f8a1c107c70 con 0x7f8a2c103b80 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2ad9d640 1 --2- 172.21.15.148:0/4102998834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaeecbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2ad9d640 1 -- 172.21.15.148:0/4102998834 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561acabb0650 con 0x561acab45070 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/4102998834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaeecbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.774+0000 7f8a2ad9d640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b65a0 0x7f8a180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.775+0000 7f8a2ad9d640 1 --2- 172.21.15.148:0/4102998834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab45070 0x561acaeec6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a24010510 tx=0x7f8a24009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=576c56cf35bea6c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.775+0000 7f8a2ad9d640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b65a0 0x7f8a180b8ab0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8a24020000 tx=0x7f8a2401b000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.775+0000 7f8a20ff9640 1 -- 172.21.15.148:0/4102998834 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24023070 con 0x561acab45070 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.775+0000 7f8a20ff9640 1 -- 172.21.15.148:0/4102998834 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a2401d8b0 con 0x561acab45070 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.775+0000 7f8a20ff9640 1 -- 172.21.15.148:0/4102998834 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a240118a0 con 0x561acab45070 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 -- 172.21.15.148:0/4102998834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab45070 msgr2=0x561acaeec6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 --2- 172.21.15.148:0/4102998834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab45070 0x561acaeec6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a24010510 tx=0x7f8a24009f90 comp rx=0 tx=0).stop 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 -- 172.21.15.148:0/4102998834 shutdown_connections 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 --2- 172.21.15.148:0/4102998834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaeecbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 --2- 172.21.15.148:0/4102998834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab24390 0x561acaeed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 --2- 172.21.15.148:0/4102998834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab45070 0x561acaeec6a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 -- 172.21.15.148:0/4102998834 >> 172.21.15.148:0/4102998834 conn(0x561acab39460 msgr2=0x561acaeea590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 -- 172.21.15.148:0/4102998834 shutdown_connections 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 -- 172.21.15.148:0/4102998834 wait complete. 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 -- start start 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.776+0000 7f8a374f6740 1 Processor -- start 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab1c1b0 0x561acaef7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab24390 0x561acaef82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab45070 0x561acaf04170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a374f6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561acacb3700 con 0x561acab24390 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a374f6740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561acaded160 con 0x561acab1c1b0 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a374f6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561acaefae80 con 0x561acab45070 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a374f6740 10 client.0 _ll_register_callbacks cb 0x561acae069e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a29d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab24390 0x561acaef82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a29d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab24390 0x561acaef82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40032/0 (socket says 172.21.15.148:40032) 2024-09-21T01:15:21.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a29d9b640 1 -- 172.21.15.148:0/4049237353 learned_addr learned my addr 172.21.15.148:0/4049237353 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a2ad9d640 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab45070 0x561acaf04170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab1c1b0 0x561acaef7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a29d9b640 1 -- 172.21.15.148:0/4049237353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab45070 msgr2=0x561acaf04170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab45070 0x561acaf04170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a29d9b640 1 -- 172.21.15.148:0/4049237353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab1c1b0 msgr2=0x561acaef7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab1c1b0 0x561acaef7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a29d9b640 1 -- 172.21.15.148:0/4049237353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561acae1ac90 con 0x561acab24390 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.777+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab24390 0x561acaef82f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8a14012700 tx=0x7f8a14012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7d1eb14ee127a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a11ffb640 1 -- 172.21.15.148:0/4049237353 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1401f060 con 0x561acab24390 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a11ffb640 1 -- 172.21.15.148:0/4049237353 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f8a1401a430 con 0x561acab24390 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a374f6740 1 -- 172.21.15.148:0/4049237353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a2401d8b0 con 0x561acab24390 2024-09-21T01:15:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a11ffb640 1 -- 172.21.15.148:0/4049237353 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a14010e80 con 0x561acab24390 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a374f6740 10 client.15678 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a374f6740 1 -- 172.21.15.148:0/4049237353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561acaf06bf0 con 0x561acab24390 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a11ffb640 1 -- 172.21.15.148:0/4049237353 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a2401d8b0 con 0x561acab24390 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a11ffb640 1 -- 172.21.15.148:0/4049237353 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f8a1400e420 con 0x561acab24390 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a374f6740 10 client.15678 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a374f6740 10 client.15678 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a374f6740 20 client.15678 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a374f6740 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x561acab039f0 0x561acaf0a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.778+0000 7f8a374f6740 4 client.15678 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.779+0000 7f8a374f6740 1 -- 172.21.15.148:0/4049237353 --> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561acae64df0 con 0x561acab039f0 2024-09-21T01:15:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.779+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x561acab039f0 0x561acaf0a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.779+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x561acab039f0 0x561acaf0a120 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6a8e833cba5b9a88 server_cookie=cea39210ef0a505d in_seq=0 out_seq=0 2024-09-21T01:15:21.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.779+0000 7f8a11ffb640 10 client.15678 ms_handle_connect on v2:172.21.15.181:6836/3446561094 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a11ffb640 1 -- 172.21.15.148:0/4049237353 <== mds.2 v2:172.21.15.181:6836/3446561094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561acae64df0 con 0x561acab039f0 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a11ffb640 10 client.15678 handle_command_reply: tid=0 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 client.15678 shutdown 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 -- 172.21.15.148:0/4049237353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab24390 msgr2=0x561acaef82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab24390 0x561acaef82f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8a14012700 tx=0x7f8a14012bc0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 -- 172.21.15.148:0/4049237353 shutdown_connections 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x561acab039f0 0x561acaf0a120 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab24390 0x561acaef82f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a11ffb640 0 client.15678 ms_handle_reset on v2:172.21.15.181:6836/3446561094 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab45070 0x561acaf04170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 --2- 172.21.15.148:0/4049237353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab1c1b0 0x561acaef7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 -- 172.21.15.148:0/4049237353 >> 172.21.15.148:0/4049237353 conn(0x561acab39460 msgr2=0x561acaeef880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 -- 172.21.15.148:0/4049237353 shutdown_connections 2024-09-21T01:15:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 1 -- 172.21.15.148:0/4049237353 wait complete. 2024-09-21T01:15:21.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.780+0000 7f8a374f6740 20 client.15678 trim_cache size 0 max 16384 2024-09-21T01:15:21.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a374f6740 1 Processor -- start 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a374f6740 1 -- start start 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab039f0 0x561acaeea5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaf04070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 0x561acaeef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a374f6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c1b1ca0 con 0x561acab1c1b0 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a374f6740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c1af570 con 0x561acab24390 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a374f6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c1ad3c0 con 0x561acab039f0 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a29d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaf04070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a29d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaf04070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40038/0 (socket says 172.21.15.148:40038) 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a29d9b640 1 -- 172.21.15.148:0/3105411583 learned_addr learned my addr 172.21.15.148:0/3105411583 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a2ad9d640 1 --2- 172.21.15.148:0/3105411583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 0x561acaeef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/3105411583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab039f0 0x561acaeea5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a29d9b640 1 -- 172.21.15.148:0/3105411583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab039f0 msgr2=0x561acaeea5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/3105411583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab039f0 0x561acaeea5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a29d9b640 1 -- 172.21.15.148:0/3105411583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 msgr2=0x561acaeef7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/3105411583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 0x561acaeef7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.794+0000 7f8a29d9b640 1 -- 172.21.15.148:0/3105411583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561acaef9070 con 0x561acab1c1b0 2024-09-21T01:15:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.795+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/3105411583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaf04070 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8a14005940 tx=0x7f8a1400ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6ae9d2ea8f43ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.795+0000 7f8a13fff640 1 -- 172.21.15.148:0/3105411583 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14033070 con 0x561acab1c1b0 2024-09-21T01:15:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.795+0000 7f8a13fff640 1 -- 172.21.15.148:0/3105411583 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a140054e0 con 0x561acab1c1b0 2024-09-21T01:15:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.795+0000 7f8a13fff640 1 -- 172.21.15.148:0/3105411583 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1402a040 con 0x561acab1c1b0 2024-09-21T01:15:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 -- 172.21.15.148:0/3105411583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 msgr2=0x561acaf04070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 --2- 172.21.15.148:0/3105411583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaf04070 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8a14005940 tx=0x7f8a1400ae30 comp rx=0 tx=0).stop 2024-09-21T01:15:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 -- 172.21.15.148:0/3105411583 shutdown_connections 2024-09-21T01:15:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 --2- 172.21.15.148:0/3105411583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaf04070 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 --2- 172.21.15.148:0/3105411583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 0x561acaeef7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 --2- 172.21.15.148:0/3105411583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab039f0 0x561acaeea5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 -- 172.21.15.148:0/3105411583 >> 172.21.15.148:0/3105411583 conn(0x561acab39460 msgr2=0x561acaee9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 -- 172.21.15.148:0/3105411583 shutdown_connections 2024-09-21T01:15:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 -- 172.21.15.148:0/3105411583 wait complete. 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 -- start start 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.796+0000 7f8a374f6740 1 Processor -- start 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab039f0 0x561acaefc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaefc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a374f6740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 0x561acaefcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a374f6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c1ada30 con 0x561acab1c1b0 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a374f6740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c1aeea0 con 0x561acab24390 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a374f6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c1ae100 con 0x561acab039f0 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a374f6740 10 client.0 _ll_register_callbacks cb 0x7f8a1400a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a29d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaefc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a29d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaefc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40050/0 (socket says 172.21.15.148:40050) 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a29d9b640 1 -- 172.21.15.148:0/3551163368 learned_addr learned my addr 172.21.15.148:0/3551163368 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:21.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab039f0 0x561acaefc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a2ad9d640 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 0x561acaefcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a29d9b640 1 -- 172.21.15.148:0/3551163368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab039f0 msgr2=0x561acaefc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab039f0 0x561acaefc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a29d9b640 1 -- 172.21.15.148:0/3551163368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 msgr2=0x561acaefcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 0x561acaefcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a29d9b640 1 -- 172.21.15.148:0/3551163368 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561acaf73ce0 con 0x561acab1c1b0 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.797+0000 7f8a2ad9d640 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 0x561acaefcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.798+0000 7f8a29d9b640 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaefc7e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400e8c0 tx=0x7f8a1400a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbff22cf06935e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.798+0000 7f8a11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.798+0000 7f8a11ffb640 1 -- 172.21.15.148:0/3551163368 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1401f070 con 0x561acab1c1b0 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.798+0000 7f8a11ffb640 1 -- 172.21.15.148:0/3551163368 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f8a1400e530 con 0x561acab1c1b0 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.798+0000 7f8a374f6740 1 -- 172.21.15.148:0/3551163368 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a140054e0 con 0x561acab1c1b0 2024-09-21T01:15:21.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.798+0000 7f8a11ffb640 1 -- 172.21.15.148:0/3551163368 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a14033040 con 0x561acab1c1b0 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.798+0000 7f8a374f6740 10 client.15684 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.798+0000 7f8a374f6740 1 -- 172.21.15.148:0/3551163368 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561acaf74f60 con 0x561acab1c1b0 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.798+0000 7f8a11ffb640 1 -- 172.21.15.148:0/3551163368 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a140054e0 con 0x561acab1c1b0 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.799+0000 7f8a11ffb640 1 -- 172.21.15.148:0/3551163368 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f8a1403f030 con 0x561acab1c1b0 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.799+0000 7f8a374f6740 10 client.15684 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.799+0000 7f8a374f6740 10 client.15684 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.799+0000 7f8a374f6740 20 client.15684 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.799+0000 7f8a374f6740 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x561acab45070 0x561acaf776a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.799+0000 7f8a374f6740 4 client.15684 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.799+0000 7f8a374f6740 1 -- 172.21.15.148:0/3551163368 --> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561acae608a0 con 0x561acab45070 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.799+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x561acab45070 0x561acaf776a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.799+0000 7f8a11ffb640 10 client.15684 ms_handle_connect on v2:172.21.15.181:6836/3446561094 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.799+0000 7f8a2a59c640 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x561acab45070 0x561acaf776a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69e910b9e0efb8a6 server_cookie=d8aacf16095b8d18 in_seq=0 out_seq=0 2024-09-21T01:15:21.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a11ffb640 1 -- 172.21.15.148:0/3551163368 <== mds.2 v2:172.21.15.181:6836/3446561094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561acae608a0 con 0x561acab45070 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a11ffb640 10 client.15684 handle_command_reply: tid=0 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 client.15684 shutdown 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 -- 172.21.15.148:0/3551163368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 msgr2=0x561acaefc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaefc7e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400e8c0 tx=0x7f8a1400a350 comp rx=0 tx=0).stop 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 -- 172.21.15.148:0/3551163368 shutdown_connections 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x561acab45070 0x561acaf776a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a11ffb640 0 client.15684 ms_handle_reset on v2:172.21.15.181:6836/3446561094 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561acab1c1b0 0x561acaefc7e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561acab24390 0x561acaefcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 --2- 172.21.15.148:0/3551163368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561acab039f0 0x561acaefc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 -- 172.21.15.148:0/3551163368 >> 172.21.15.148:0/3551163368 conn(0x561acab39460 msgr2=0x561acaeef7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 -- 172.21.15.148:0/3551163368 shutdown_connections 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 1 -- 172.21.15.148:0/3551163368 wait complete. 2024-09-21T01:15:21.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.800+0000 7f8a374f6740 20 client.15684 trim_cache size 0 max 16384 2024-09-21T01:15:21.806 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-21T01:15:21.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 -- 172.21.15.148:0/1794651051 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b65a0 msgr2=0x7f8a180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b65a0 0x7f8a180b8ab0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8a24020000 tx=0x7f8a2401b000 comp rx=0 tx=0).stop 2024-09-21T01:15:21.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 -- 172.21.15.148:0/1794651051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103b80 msgr2=0x7f8a2c19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103b80 0x7f8a2c19a4c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c005940 tx=0x7f8a1c0042f0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 -- 172.21.15.148:0/1794651051 shutdown_connections 2024-09-21T01:15:21.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b65a0 0x7f8a180b8ab0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c109e10 0x7f8a2c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c1094c0 0x7f8a2c19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 --2- 172.21.15.148:0/1794651051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103b80 0x7f8a2c19a4c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 -- 172.21.15.148:0/1794651051 >> 172.21.15.148:0/1794651051 conn(0x7f8a2c0ff610 msgr2=0x7f8a2c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 -- 172.21.15.148:0/1794651051 shutdown_connections 2024-09-21T01:15:21.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:21.801+0000 7f8a30f82640 1 -- 172.21.15.148:0/1794651051 wait complete. 2024-09-21T01:15:22.701 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:15:22.967 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.444+0000 7f0238215640 1 -- 172.21.15.148:0/267400615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0230108d00 msgr2=0x7f023010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.444+0000 7f0238215640 1 --2- 172.21.15.148:0/267400615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0230108d00 0x7f023010f530 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0228009ca0 tx=0x7f022802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.444+0000 7f0238215640 1 -- 172.21.15.148:0/267400615 shutdown_connections 2024-09-21T01:15:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.444+0000 7f0238215640 1 --2- 172.21.15.148:0/267400615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0230108d00 0x7f023010f530 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.444+0000 7f0238215640 1 --2- 172.21.15.148:0/267400615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02301083b0 0x7f02301087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.444+0000 7f0238215640 1 --2- 172.21.15.148:0/267400615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0230103180 0x7f0230103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.444+0000 7f0238215640 1 -- 172.21.15.148:0/267400615 >> 172.21.15.148:0/267400615 conn(0x7f0230077c60 msgr2=0x7f02300780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.444+0000 7f0238215640 1 -- 172.21.15.148:0/267400615 shutdown_connections 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.444+0000 7f0238215640 1 -- 172.21.15.148:0/267400615 wait complete. 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f0238215640 1 Processor -- start 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f0238215640 1 -- start start 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f0238215640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0230103180 0x7f023019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f0238215640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02301083b0 0x7f023019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f0238215640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0230108d00 0x7f02301a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f0238215640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0230113ae0 con 0x7f02301083b0 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f0238215640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0230113960 con 0x7f0230108d00 2024-09-21T01:15:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f0238215640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0230113c60 con 0x7f0230103180 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f0235fb1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0230103180 0x7f023019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f02357b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02301083b0 0x7f023019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f02357b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02301083b0 0x7f023019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40066/0 (socket says 172.21.15.148:40066) 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f0235fb1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0230103180 0x7f023019c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:49608/0 (socket says 172.21.15.148:49608) 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f02357b0640 1 -- 172.21.15.148:0/2831657139 learned_addr learned my addr 172.21.15.148:0/2831657139 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.445+0000 7f02367b2640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0230108d00 0x7f02301a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0235fb1640 1 -- 172.21.15.148:0/2831657139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0230108d00 msgr2=0x7f02301a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0235fb1640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0230108d00 0x7f02301a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0235fb1640 1 -- 172.21.15.148:0/2831657139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02301083b0 msgr2=0x7f023019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0235fb1640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02301083b0 0x7f023019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0235fb1640 1 -- 172.21.15.148:0/2831657139 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02301a2640 con 0x7f0230103180 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f02357b0640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02301083b0 0x7f023019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0235fb1640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0230103180 0x7f023019c6d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f022c00d6d0 tx=0x7f022c00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0226ffd640 1 -- 172.21.15.148:0/2831657139 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c017070 con 0x7f0230103180 2024-09-21T01:15:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0238215640 1 -- 172.21.15.148:0/2831657139 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02301a2930 con 0x7f0230103180 2024-09-21T01:15:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0226ffd640 1 -- 172.21.15.148:0/2831657139 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f022c009820 con 0x7f0230103180 2024-09-21T01:15:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0226ffd640 1 -- 172.21.15.148:0/2831657139 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c004c40 con 0x7f0230103180 2024-09-21T01:15:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.446+0000 7f0238215640 1 -- 172.21.15.148:0/2831657139 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02301093e0 con 0x7f0230103180 2024-09-21T01:15:23.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.449+0000 7f023e789740 1 Processor -- start 2024-09-21T01:15:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.449+0000 7f023e789740 1 -- start start 2024-09-21T01:15:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f023e789740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbdb070 0x55669bf826a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f023e789740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf82be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f023e789740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbba390 0x55669bf83120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f023e789740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55669bef8ea0 con 0x55669bbdb070 2024-09-21T01:15:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f023e789740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55669bee82d0 con 0x55669bbba390 2024-09-21T01:15:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f023e789740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55669beec0e0 con 0x55669bbb21b0 2024-09-21T01:15:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f02367b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbdb070 0x55669bf826a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f02367b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbdb070 0x55669bf826a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40078/0 (socket says 172.21.15.148:40078) 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f02367b2640 1 -- 172.21.15.148:0/890867006 learned_addr learned my addr 172.21.15.148:0/890867006 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f02357b0640 1 --2- 172.21.15.148:0/890867006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbba390 0x55669bf83120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f02367b2640 1 -- 172.21.15.148:0/890867006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 msgr2=0x55669bf82be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f02367b2640 1 --2- 172.21.15.148:0/890867006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf82be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f02367b2640 1 -- 172.21.15.148:0/890867006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbba390 msgr2=0x55669bf83120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f02367b2640 1 --2- 172.21.15.148:0/890867006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbba390 0x55669bf83120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.450+0000 7f02367b2640 1 -- 172.21.15.148:0/890867006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55669bc46650 con 0x55669bbdb070 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.451+0000 7f0226ffd640 1 -- 172.21.15.148:0/2831657139 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f022c005220 con 0x7f0230103180 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.451+0000 7f02367b2640 1 --2- 172.21.15.148:0/890867006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbdb070 0x55669bf826a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f022802f4c0 tx=0x7f0228009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2288c86bfcf4b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.451+0000 7f021bfff640 1 -- 172.21.15.148:0/890867006 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228031cf0 con 0x55669bbdb070 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.451+0000 7f021bfff640 1 -- 172.21.15.148:0/890867006 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0228036030 con 0x55669bbdb070 2024-09-21T01:15:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.451+0000 7f021bfff640 1 -- 172.21.15.148:0/890867006 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02280042a0 con 0x55669bbdb070 2024-09-21T01:15:23.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.451+0000 7f0226ffd640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f021c0b65a0 0x7f021c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f0235fb1640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f021c0b65a0 0x7f021c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f0226ffd640 1 -- 172.21.15.148:0/2831657139 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f022c0e6f20 con 0x7f0230103180 2024-09-21T01:15:23.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f023e789740 1 -- 172.21.15.148:0/890867006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbdb070 msgr2=0x55669bf826a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:23.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f023e789740 1 --2- 172.21.15.148:0/890867006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbdb070 0x55669bf826a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f022802f4c0 tx=0x7f0228009800 comp rx=0 tx=0).stop 2024-09-21T01:15:23.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f023e789740 1 -- 172.21.15.148:0/890867006 shutdown_connections 2024-09-21T01:15:23.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f023e789740 1 --2- 172.21.15.148:0/890867006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbba390 0x55669bf83120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f023e789740 1 --2- 172.21.15.148:0/890867006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf82be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f023e789740 1 --2- 172.21.15.148:0/890867006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbdb070 0x55669bf826a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f023e789740 1 -- 172.21.15.148:0/890867006 >> 172.21.15.148:0/890867006 conn(0x55669bbcf460 msgr2=0x55669bf80590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:23.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f0235fb1640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f021c0b65a0 0x7f021c0b8ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55669bf81320 tx=0x7f022c0a18c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:23.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f023e789740 1 -- 172.21.15.148:0/890867006 shutdown_connections 2024-09-21T01:15:23.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.452+0000 7f023e789740 1 -- 172.21.15.148:0/890867006 wait complete. 2024-09-21T01:15:23.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.453+0000 7f023e789740 1 -- start start 2024-09-21T01:15:23.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.453+0000 7f023e789740 1 Processor -- start 2024-09-21T01:15:23.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.453+0000 7f023e789740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf8dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.453+0000 7f023e789740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf8e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.453+0000 7f023e789740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbdb070 0x55669bf99f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.453+0000 7f023e789740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55669bd49700 con 0x55669bbba390 2024-09-21T01:15:23.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.453+0000 7f023e789740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55669be83160 con 0x55669bbdb070 2024-09-21T01:15:23.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.453+0000 7f023e789740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55669bf90ca0 con 0x55669bbb21b0 2024-09-21T01:15:23.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.453+0000 7f023e789740 10 client.0 _ll_register_callbacks cb 0x55669be9c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:23.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02357b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf8e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02357b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf8e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40086/0 (socket says 172.21.15.148:40086) 2024-09-21T01:15:23.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02357b0640 1 -- 172.21.15.148:0/2842254717 learned_addr learned my addr 172.21.15.148:0/2842254717 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:23.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02367b2640 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbdb070 0x55669bf99f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02367b2640 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf8dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02357b0640 1 -- 172.21.15.148:0/2842254717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 msgr2=0x55669bf8dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:23.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02357b0640 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf8dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02357b0640 1 -- 172.21.15.148:0/2842254717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbdb070 msgr2=0x55669bf99f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:23.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02357b0640 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbdb070 0x55669bf99f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02357b0640 1 -- 172.21.15.148:0/2842254717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55669beb0c90 con 0x55669bbba390 2024-09-21T01:15:23.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02357b0640 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf8e250 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f022000b810 tx=0x7f022000bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cb33cb10419ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:23.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02197fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:23.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02197fa640 1 -- 172.21.15.148:0/2842254717 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022000ca40 con 0x55669bbba390 2024-09-21T01:15:23.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f02197fa640 1 -- 172.21.15.148:0/2842254717 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f022000cbe0 con 0x55669bbba390 2024-09-21T01:15:23.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.454+0000 7f023e789740 1 -- 172.21.15.148:0/2842254717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0228036030 con 0x55669bbba390 2024-09-21T01:15:23.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f02197fa640 1 -- 172.21.15.148:0/2842254717 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f022000cde0 con 0x55669bbba390 2024-09-21T01:15:23.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f023e789740 10 client.15696 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:23.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f023e789740 1 -- 172.21.15.148:0/2842254717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55669bf9c9d0 con 0x55669bbba390 2024-09-21T01:15:23.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f02197fa640 1 -- 172.21.15.148:0/2842254717 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0228036030 con 0x55669bbba390 2024-09-21T01:15:23.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f02197fa640 1 -- 172.21.15.148:0/2842254717 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f0220021590 con 0x55669bbba390 2024-09-21T01:15:23.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f023e789740 10 client.15696 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:23.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f023e789740 10 client.15696 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:15:23.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f023e789740 20 client.15696 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:23.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f023e789740 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55669bb999f0 0x55669bf9ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f023e789740 4 client.15696 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:23.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.455+0000 7f023e789740 1 -- 172.21.15.148:0/2842254717 --> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55669befadf0 con 0x55669bb999f0 2024-09-21T01:15:23.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.456+0000 7f02367b2640 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55669bb999f0 0x55669bf9ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.456+0000 7f02367b2640 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55669bb999f0 0x55669bf9ff90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed1a9b8f274ee9ae server_cookie=97a08c9a7c5e1b3c in_seq=0 out_seq=0 2024-09-21T01:15:23.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.456+0000 7f02197fa640 10 client.15696 ms_handle_connect on v2:172.21.15.181:6838/2036386246 2024-09-21T01:15:23.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f02197fa640 1 -- 172.21.15.148:0/2842254717 <== mds.1 v2:172.21.15.181:6838/2036386246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55669befadf0 con 0x55669bb999f0 2024-09-21T01:15:23.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f02197fa640 10 client.15696 handle_command_reply: tid=0 2024-09-21T01:15:23.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 client.15696 shutdown 2024-09-21T01:15:23.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 -- 172.21.15.148:0/2842254717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 msgr2=0x55669bf8e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:23.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf8e250 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f022000b810 tx=0x7f022000bcd0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 -- 172.21.15.148:0/2842254717 shutdown_connections 2024-09-21T01:15:23.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55669bb999f0 0x55669bf9ff90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf8e250 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbdb070 0x55669bf99f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f02197fa640 0 client.15696 ms_handle_reset on v2:172.21.15.181:6838/2036386246 2024-09-21T01:15:23.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 --2- 172.21.15.148:0/2842254717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf8dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 -- 172.21.15.148:0/2842254717 >> 172.21.15.148:0/2842254717 conn(0x55669bbcf460 msgr2=0x55669bf85880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:23.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 -- 172.21.15.148:0/2842254717 shutdown_connections 2024-09-21T01:15:23.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.457+0000 7f023e789740 1 -- 172.21.15.148:0/2842254717 wait complete. 2024-09-21T01:15:23.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.458+0000 7f023e789740 20 client.15696 trim_cache size 0 max 16384 2024-09-21T01:15:23.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f023e789740 1 Processor -- start 2024-09-21T01:15:23.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f023e789740 1 -- start start 2024-09-21T01:15:23.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f023e789740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bb999f0 0x55669bf84090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f023e789740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf8f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f023e789740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf99e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f023e789740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f02301afa50 con 0x55669bbba390 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f023e789740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f02301ad320 con 0x55669bb999f0 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f023e789740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f02301ab1b0 con 0x55669bbb21b0 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f02367b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf99e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f02367b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf99e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40102/0 (socket says 172.21.15.148:40102) 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f02367b2640 1 -- 172.21.15.148:0/1429163372 learned_addr learned my addr 172.21.15.148:0/1429163372 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f02357b0640 1 --2- 172.21.15.148:0/1429163372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf8f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.483+0000 7f02367b2640 1 --2- 172.21.15.148:0/1429163372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bb999f0 0x55669bf84090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.484+0000 7f02367b2640 1 -- 172.21.15.148:0/1429163372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 msgr2=0x55669bf8f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:23.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.484+0000 7f02367b2640 1 --2- 172.21.15.148:0/1429163372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf8f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.484+0000 7f02367b2640 1 -- 172.21.15.148:0/1429163372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bb999f0 msgr2=0x55669bf84090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.484+0000 7f02367b2640 1 --2- 172.21.15.148:0/1429163372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bb999f0 0x55669bf84090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.484+0000 7f02367b2640 1 -- 172.21.15.148:0/1429163372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55669bf85500 con 0x55669bbba390 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.484+0000 7f02357b0640 1 --2- 172.21.15.148:0/1429163372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf8f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.484+0000 7f02367b2640 1 --2- 172.21.15.148:0/1429163372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf99e90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0228003cb0 tx=0x7f0228009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28cd3f08d2c08f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.484+0000 7f021b7fe640 1 -- 172.21.15.148:0/1429163372 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228032cf0 con 0x55669bbba390 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.484+0000 7f021b7fe640 1 -- 172.21.15.148:0/1429163372 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0228036070 con 0x55669bbba390 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.484+0000 7f021b7fe640 1 -- 172.21.15.148:0/1429163372 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228004570 con 0x55669bbba390 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.485+0000 7f023e789740 1 -- 172.21.15.148:0/1429163372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 msgr2=0x55669bf99e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.485+0000 7f023e789740 1 --2- 172.21.15.148:0/1429163372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf99e90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0228003cb0 tx=0x7f0228009800 comp rx=0 tx=0).stop 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.485+0000 7f023e789740 1 -- 172.21.15.148:0/1429163372 shutdown_connections 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.485+0000 7f023e789740 1 --2- 172.21.15.148:0/1429163372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf99e90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.485+0000 7f023e789740 1 --2- 172.21.15.148:0/1429163372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bbb21b0 0x55669bf8f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.485+0000 7f023e789740 1 --2- 172.21.15.148:0/1429163372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bb999f0 0x55669bf84090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.485+0000 7f023e789740 1 -- 172.21.15.148:0/1429163372 >> 172.21.15.148:0/1429163372 conn(0x55669bbcf460 msgr2=0x55669bf8f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:23.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.485+0000 7f023e789740 1 -- 172.21.15.148:0/1429163372 shutdown_connections 2024-09-21T01:15:23.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.486+0000 7f023e789740 1 -- 172.21.15.148:0/1429163372 wait complete. 2024-09-21T01:15:23.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.486+0000 7f023e789740 1 -- start start 2024-09-21T01:15:23.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.486+0000 7f023e789740 1 Processor -- start 2024-09-21T01:15:23.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f023e789740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bb999f0 0x55669bf920f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f023e789740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbb21b0 0x55669bf92630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f023e789740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf92b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f023e789740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f02301ab800 con 0x55669bbba390 2024-09-21T01:15:23.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f023e789740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f02301acc50 con 0x55669bbb21b0 2024-09-21T01:15:23.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f023e789740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f02301abeb0 con 0x55669bb999f0 2024-09-21T01:15:23.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f023e789740 10 client.0 _ll_register_callbacks cb 0x7f0220009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:23.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f02367b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf92b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f02367b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf92b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40108/0 (socket says 172.21.15.148:40108) 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f02367b2640 1 -- 172.21.15.148:0/3989469681 learned_addr learned my addr 172.21.15.148:0/3989469681 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f02357b0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbb21b0 0x55669bf92630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f02367b2640 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bb999f0 0x55669bf920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f02357b0640 1 -- 172.21.15.148:0/3989469681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bb999f0 msgr2=0x55669bf920f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f02357b0640 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bb999f0 0x55669bf920f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f02357b0640 1 -- 172.21.15.148:0/3989469681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 msgr2=0x55669bf92b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.487+0000 7f02357b0640 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf92b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.488+0000 7f02357b0640 1 -- 172.21.15.148:0/3989469681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55669c009b50 con 0x55669bbb21b0 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.488+0000 7f02367b2640 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf92b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.488+0000 7f02357b0640 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbb21b0 0x55669bf92630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0220021980 tx=0x7f022000cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976c0bf58f5c7c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.488+0000 7f02197fa640 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.490+0000 7f02197fa640 1 -- 172.21.15.148:0/3989469681 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220000e60 con 0x55669bbb21b0 2024-09-21T01:15:23.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.490+0000 7f02197fa640 1 -- 172.21.15.148:0/3989469681 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f02200213d0 con 0x55669bbb21b0 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.490+0000 7f023e789740 1 -- 172.21.15.148:0/3989469681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0228036070 con 0x55669bbb21b0 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f02197fa640 1 -- 172.21.15.148:0/3989469681 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f02200215f0 con 0x55669bbb21b0 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f023e789740 10 client.25328 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f023e789740 1 -- 172.21.15.148:0/3989469681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55669c00adb0 con 0x55669bbb21b0 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f02197fa640 1 -- 172.21.15.148:0/3989469681 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0228036070 con 0x55669bbb21b0 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f02197fa640 1 -- 172.21.15.148:0/3989469681 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f0220004750 con 0x55669bbb21b0 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f023e789740 10 client.25328 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f023e789740 10 client.25328 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f023e789740 20 client.25328 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f023e789740 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55669bbdb070 0x55669c00d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f023e789740 4 client.25328 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.491+0000 7f023e789740 1 -- 172.21.15.148:0/3989469681 --> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55669bef68a0 con 0x55669bbdb070 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.492+0000 7f02367b2640 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55669bbdb070 0x55669c00d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:23.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.492+0000 7f02197fa640 10 client.25328 ms_handle_connect on v2:172.21.15.181:6838/2036386246 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.492+0000 7f02367b2640 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55669bbdb070 0x55669c00d5a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e63de01cb7951c0b server_cookie=9d1557aa540a0375 in_seq=0 out_seq=0 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.492+0000 7f02197fa640 1 -- 172.21.15.148:0/3989469681 <== mds.1 v2:172.21.15.181:6838/2036386246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55669bef68a0 con 0x55669bbdb070 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.492+0000 7f02197fa640 10 client.25328 handle_command_reply: tid=0 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.492+0000 7f023e789740 1 client.25328 shutdown 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.492+0000 7f023e789740 1 -- 172.21.15.148:0/3989469681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbb21b0 msgr2=0x55669bf92630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.492+0000 7f023e789740 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbb21b0 0x55669bf92630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0220021980 tx=0x7f022000cc70 comp rx=0 tx=0).stop 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f023e789740 1 -- 172.21.15.148:0/3989469681 shutdown_connections 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f023e789740 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55669bbdb070 0x55669c00d5a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f023e789740 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669bbba390 0x55669bf92b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f023e789740 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55669bbb21b0 0x55669bf92630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f02197fa640 0 client.25328 ms_handle_reset on v2:172.21.15.181:6838/2036386246 2024-09-21T01:15:23.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f023e789740 1 --2- 172.21.15.148:0/3989469681 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55669bb999f0 0x55669bf920f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f023e789740 1 -- 172.21.15.148:0/3989469681 >> 172.21.15.148:0/3989469681 conn(0x55669bbcf460 msgr2=0x55669bf8fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:23.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f023e789740 1 -- 172.21.15.148:0/3989469681 shutdown_connections 2024-09-21T01:15:23.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f023e789740 1 -- 172.21.15.148:0/3989469681 wait complete. 2024-09-21T01:15:23.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f023e789740 20 client.25328 trim_cache size 0 max 16384 2024-09-21T01:15:23.498 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-21T01:15:23.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f0238215640 1 -- 172.21.15.148:0/2831657139 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f021c0b65a0 msgr2=0x7f021c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:23.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f0238215640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f021c0b65a0 0x7f021c0b8ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55669bf81320 tx=0x7f022c0a18c0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f0238215640 1 -- 172.21.15.148:0/2831657139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0230103180 msgr2=0x7f023019c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:23.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f0238215640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0230103180 0x7f023019c6d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f022c00d6d0 tx=0x7f022c00db90 comp rx=0 tx=0).stop 2024-09-21T01:15:23.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f0238215640 1 -- 172.21.15.148:0/2831657139 shutdown_connections 2024-09-21T01:15:23.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f0238215640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f021c0b65a0 0x7f021c0b8ab0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.493+0000 7f0238215640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02301083b0 0x7f023019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.494+0000 7f0238215640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0230108d00 0x7f02301a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.494+0000 7f0238215640 1 --2- 172.21.15.148:0/2831657139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0230103180 0x7f023019c6d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:23.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.494+0000 7f0238215640 1 -- 172.21.15.148:0/2831657139 >> 172.21.15.148:0/2831657139 conn(0x7f0230077c60 msgr2=0x7f02301061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:23.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.494+0000 7f0238215640 1 -- 172.21.15.148:0/2831657139 shutdown_connections 2024-09-21T01:15:23.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:23.494+0000 7f0238215640 1 -- 172.21.15.148:0/2831657139 wait complete. 2024-09-21T01:15:23.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:23 smithi148 ceph-mon[31000]: pgmap v380: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 861 KiB/s wr, 12 op/s 2024-09-21T01:15:23.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:23 smithi157 ceph-mon[34140]: pgmap v380: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 861 KiB/s wr, 12 op/s 2024-09-21T01:15:23.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:23 smithi181 ceph-mon[34811]: pgmap v380: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 861 KiB/s wr, 12 op/s 2024-09-21T01:15:24.377 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:15:24.655 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:25.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 -- 172.21.15.148:0/3789875269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87301083c0 msgr2=0x7f87301087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 --2- 172.21.15.148:0/3789875269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87301083c0 0x7f87301087d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f871c009900 tx=0x7f871c02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:25.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 -- 172.21.15.148:0/3789875269 shutdown_connections 2024-09-21T01:15:25.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 --2- 172.21.15.148:0/3789875269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87301083c0 0x7f87301087d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 --2- 172.21.15.148:0/3789875269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8730108d10 0x7f873010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 --2- 172.21.15.148:0/3789875269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8730102a80 0x7f8730102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 -- 172.21.15.148:0/3789875269 >> 172.21.15.148:0/3789875269 conn(0x7f8730079740 msgr2=0x7f8730079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 -- 172.21.15.148:0/3789875269 shutdown_connections 2024-09-21T01:15:25.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 -- 172.21.15.148:0/3789875269 wait complete. 2024-09-21T01:15:25.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 Processor -- start 2024-09-21T01:15:25.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.169+0000 7f873720a640 1 -- start start 2024-09-21T01:15:25.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f873720a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8730102a80 0x7f873019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f873720a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87301083c0 0x7f873019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f873720a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8730108d10 0x7f873019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f873720a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112980 con 0x7f8730108d10 2024-09-21T01:15:25.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f873720a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112800 con 0x7f8730102a80 2024-09-21T01:15:25.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f873720a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112b00 con 0x7f87301083c0 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f8734fa6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8730102a80 0x7f873019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f8734fa6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8730102a80 0x7f873019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:40550/0 (socket says 172.21.15.148:40550) 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f8734fa6640 1 -- 172.21.15.148:0/3483321702 learned_addr learned my addr 172.21.15.148:0/3483321702 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f87357a7640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8730108d10 0x7f873019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f872ffff640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87301083c0 0x7f873019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f8734fa6640 1 -- 172.21.15.148:0/3483321702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87301083c0 msgr2=0x7f873019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f8734fa6640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87301083c0 0x7f873019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f8734fa6640 1 -- 172.21.15.148:0/3483321702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8730108d10 msgr2=0x7f873019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f8734fa6640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8730108d10 0x7f873019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.170+0000 7f8734fa6640 1 -- 172.21.15.148:0/3483321702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87301a0410 con 0x7f8730102a80 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.171+0000 7f8734fa6640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8730102a80 0x7f873019a4a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f872400d950 tx=0x7f872400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.171+0000 7f872dffb640 1 -- 172.21.15.148:0/3483321702 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724017070 con 0x7f8730102a80 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.171+0000 7f873720a640 1 -- 172.21.15.148:0/3483321702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87301a0700 con 0x7f8730102a80 2024-09-21T01:15:25.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.171+0000 7f872dffb640 1 -- 172.21.15.148:0/3483321702 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8724009c30 con 0x7f8730102a80 2024-09-21T01:15:25.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.171+0000 7f872dffb640 1 -- 172.21.15.148:0/3483321702 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872400f620 con 0x7f8730102a80 2024-09-21T01:15:25.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.171+0000 7f873720a640 1 -- 172.21.15.148:0/3483321702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87301a6e60 con 0x7f8730102a80 2024-09-21T01:15:25.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.174+0000 7f873d77e740 1 Processor -- start 2024-09-21T01:15:25.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.174+0000 7f873d77e740 1 -- start start 2024-09-21T01:15:25.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.174+0000 7f872dffb640 1 -- 172.21.15.148:0/3483321702 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) ==== 154564+0+0 (secure 0 0 0) 0x7f8724010460 con 0x7f8730102a80 2024-09-21T01:15:25.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.174+0000 7f873d77e740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a62070 0x559062e096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.174+0000 7f873d77e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a391b0 0x559062e09be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.174+0000 7f873d77e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a41390 0x559062e0a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f873d77e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559062d7fea0 con 0x559062a391b0 2024-09-21T01:15:25.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f873d77e740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x559062d6f2d0 con 0x559062a62070 2024-09-21T01:15:25.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f873d77e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559062d730e0 con 0x559062a41390 2024-09-21T01:15:25.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f8734fa6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a391b0 0x559062e09be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f8734fa6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a391b0 0x559062e09be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40126/0 (socket says 172.21.15.148:40126) 2024-09-21T01:15:25.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f8734fa6640 1 -- 172.21.15.148:0/2531859425 learned_addr learned my addr 172.21.15.148:0/2531859425 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:25.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f87357a7640 1 --2- 172.21.15.148:0/2531859425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a62070 0x559062e096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f872ffff640 1 --2- 172.21.15.148:0/2531859425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a41390 0x559062e0a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f8734fa6640 1 -- 172.21.15.148:0/2531859425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a41390 msgr2=0x559062e0a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f8734fa6640 1 --2- 172.21.15.148:0/2531859425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a41390 0x559062e0a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f8734fa6640 1 -- 172.21.15.148:0/2531859425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a62070 msgr2=0x559062e096a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f8734fa6640 1 --2- 172.21.15.148:0/2531859425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a62070 0x559062e096a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f8734fa6640 1 -- 172.21.15.148:0/2531859425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559062acd650 con 0x559062a391b0 2024-09-21T01:15:25.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f872dffb640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87200b65a0 0x7f87200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f8734fa6640 1 --2- 172.21.15.148:0/2531859425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a391b0 0x559062e09be0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f87240e4950 tx=0x7f87240ef730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6489714fe4b81ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.175+0000 7f87357a7640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87200b65a0 0x7f87200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.176+0000 7f872dffb640 1 -- 172.21.15.148:0/3483321702 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f87240e7030 con 0x7f8730102a80 2024-09-21T01:15:25.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.176+0000 7f871affd640 1 -- 172.21.15.148:0/2531859425 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240a9790 con 0x559062a391b0 2024-09-21T01:15:25.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.176+0000 7f871affd640 1 -- 172.21.15.148:0/2531859425 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87240acc50 con 0x559062a391b0 2024-09-21T01:15:25.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.176+0000 7f871affd640 1 -- 172.21.15.148:0/2531859425 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240ac8b0 con 0x559062a391b0 2024-09-21T01:15:25.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 -- 172.21.15.148:0/2531859425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a391b0 msgr2=0x559062e09be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f87357a7640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87200b65a0 0x7f87200b8ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8728005fd0 tx=0x7f8728009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 --2- 172.21.15.148:0/2531859425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a391b0 0x559062e09be0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f87240e4950 tx=0x7f87240ef730 comp rx=0 tx=0).stop 2024-09-21T01:15:25.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 -- 172.21.15.148:0/2531859425 shutdown_connections 2024-09-21T01:15:25.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 --2- 172.21.15.148:0/2531859425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a391b0 0x559062e09be0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 --2- 172.21.15.148:0/2531859425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a41390 0x559062e0a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 --2- 172.21.15.148:0/2531859425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a62070 0x559062e096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 -- 172.21.15.148:0/2531859425 >> 172.21.15.148:0/2531859425 conn(0x559062a56460 msgr2=0x559062e07590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 -- 172.21.15.148:0/2531859425 shutdown_connections 2024-09-21T01:15:25.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 -- 172.21.15.148:0/2531859425 wait complete. 2024-09-21T01:15:25.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 -- start start 2024-09-21T01:15:25.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.177+0000 7f873d77e740 1 Processor -- start 2024-09-21T01:15:25.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f873d77e740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 0x559062e14dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f873d77e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a41390 0x559062e15310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f873d77e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e211a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f873d77e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559062bd0700 con 0x559062a62070 2024-09-21T01:15:25.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f873d77e740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x559062d0a160 con 0x559062a391b0 2024-09-21T01:15:25.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f873d77e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559062e17e80 con 0x559062a41390 2024-09-21T01:15:25.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f873d77e740 10 client.0 _ll_register_callbacks cb 0x559062d239e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:25.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f87357a7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e211a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f87357a7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e211a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40128/0 (socket says 172.21.15.148:40128) 2024-09-21T01:15:25.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f87357a7640 1 -- 172.21.15.148:0/98837145 learned_addr learned my addr 172.21.15.148:0/98837145 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:25.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f8734fa6640 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 0x559062e14dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.178+0000 7f872ffff640 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a41390 0x559062e15310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f87357a7640 1 -- 172.21.15.148:0/98837145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a41390 msgr2=0x559062e15310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f87357a7640 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a41390 0x559062e15310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f87357a7640 1 -- 172.21.15.148:0/98837145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 msgr2=0x559062e14dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f87357a7640 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 0x559062e14dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f87357a7640 1 -- 172.21.15.148:0/98837145 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559062d37c90 con 0x559062a62070 2024-09-21T01:15:25.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f8734fa6640 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 0x559062e14dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:25.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f87357a7640 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e211a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8728005c40 tx=0x7f8728004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a2e529d45bc46b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f870ffff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:25.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f870ffff640 1 -- 172.21.15.148:0/98837145 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728020620 con 0x559062a62070 2024-09-21T01:15:25.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f870ffff640 1 -- 172.21.15.148:0/98837145 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f87280207c0 con 0x559062a62070 2024-09-21T01:15:25.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f873d77e740 1 -- 172.21.15.148:0/98837145 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87240acc50 con 0x559062a62070 2024-09-21T01:15:25.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f870ffff640 1 -- 172.21.15.148:0/98837145 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8728020a00 con 0x559062a62070 2024-09-21T01:15:25.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f873d77e740 10 client.15714 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:25.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f873d77e740 1 -- 172.21.15.148:0/98837145 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559062e23c30 con 0x559062a62070 2024-09-21T01:15:25.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.179+0000 7f870ffff640 1 -- 172.21.15.148:0/98837145 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87240acc50 con 0x559062a62070 2024-09-21T01:15:25.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.180+0000 7f870ffff640 1 -- 172.21.15.148:0/98837145 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f872800f040 con 0x559062a62070 2024-09-21T01:15:25.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.180+0000 7f873d77e740 10 client.15714 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:25.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.180+0000 7f873d77e740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:25.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.180+0000 7f873d77e740 20 client.15714 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:25.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.180+0000 7f873d77e740 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x559062a209f0 0x559062e270e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.180+0000 7f873d77e740 4 client.15714 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:25.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.180+0000 7f873d77e740 1 -- 172.21.15.148:0/98837145 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559062d81df0 con 0x559062a209f0 2024-09-21T01:15:25.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.180+0000 7f8734fa6640 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x559062a209f0 0x559062e270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.181+0000 7f870ffff640 10 client.15714 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:25.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.181+0000 7f8734fa6640 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x559062a209f0 0x559062e270e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de397fbc28ffd66d server_cookie=bf7aac5e9fad4210 in_seq=0 out_seq=0 2024-09-21T01:15:25.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.181+0000 7f870ffff640 1 -- 172.21.15.148:0/98837145 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559062d81df0 con 0x559062a209f0 2024-09-21T01:15:25.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.181+0000 7f870ffff640 10 client.15714 handle_command_reply: tid=0 2024-09-21T01:15:25.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.181+0000 7f873d77e740 1 client.15714 shutdown 2024-09-21T01:15:25.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 1 -- 172.21.15.148:0/98837145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 msgr2=0x559062e211a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e211a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8728005c40 tx=0x7f8728004a40 comp rx=0 tx=0).stop 2024-09-21T01:15:25.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 1 -- 172.21.15.148:0/98837145 shutdown_connections 2024-09-21T01:15:25.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x559062a209f0 0x559062e270e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e211a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a41390 0x559062e15310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f870ffff640 0 client.15714 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:25.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 1 --2- 172.21.15.148:0/98837145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 0x559062e14dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 1 -- 172.21.15.148:0/98837145 >> 172.21.15.148:0/98837145 conn(0x559062a56460 msgr2=0x559062e0c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 1 -- 172.21.15.148:0/98837145 shutdown_connections 2024-09-21T01:15:25.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 1 -- 172.21.15.148:0/98837145 wait complete. 2024-09-21T01:15:25.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.182+0000 7f873d77e740 20 client.15714 trim_cache size 0 max 16384 2024-09-21T01:15:25.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.207+0000 7f873d77e740 1 Processor -- start 2024-09-21T01:15:25.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.207+0000 7f873d77e740 1 -- start start 2024-09-21T01:15:25.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.207+0000 7f873d77e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a391b0 0x559062e0ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.207+0000 7f873d77e740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a41390 0x559062e06bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.207+0000 7f873d77e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e07100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.207+0000 7f873d77e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f87301b1ce0 con 0x559062a62070 2024-09-21T01:15:25.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.207+0000 7f873d77e740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f87301af5b0 con 0x559062a41390 2024-09-21T01:15:25.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.207+0000 7f873d77e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87301ad400 con 0x559062a391b0 2024-09-21T01:15:25.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.207+0000 7f87357a7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e07100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f87357a7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e07100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40142/0 (socket says 172.21.15.148:40142) 2024-09-21T01:15:25.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f87357a7640 1 -- 172.21.15.148:0/604197911 learned_addr learned my addr 172.21.15.148:0/604197911 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:25.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f872ffff640 1 --2- 172.21.15.148:0/604197911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a41390 0x559062e06bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f8734fa6640 1 --2- 172.21.15.148:0/604197911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a391b0 0x559062e0ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f87357a7640 1 -- 172.21.15.148:0/604197911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a391b0 msgr2=0x559062e0ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f87357a7640 1 --2- 172.21.15.148:0/604197911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a391b0 0x559062e0ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f87357a7640 1 -- 172.21.15.148:0/604197911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a41390 msgr2=0x559062e06bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f87357a7640 1 --2- 172.21.15.148:0/604197911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a41390 0x559062e06bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f87357a7640 1 -- 172.21.15.148:0/604197911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559062e08350 con 0x559062a62070 2024-09-21T01:15:25.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f87357a7640 1 --2- 172.21.15.148:0/604197911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e07100 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8728018040 tx=0x7f8728005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dce3aed45c60862 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f871a7fc640 1 -- 172.21.15.148:0/604197911 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728020da0 con 0x559062a62070 2024-09-21T01:15:25.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f871a7fc640 1 -- 172.21.15.148:0/604197911 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f872801fc10 con 0x559062a62070 2024-09-21T01:15:25.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.208+0000 7f871a7fc640 1 -- 172.21.15.148:0/604197911 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872801d3e0 con 0x559062a62070 2024-09-21T01:15:25.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.209+0000 7f873d77e740 1 -- 172.21.15.148:0/604197911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 msgr2=0x559062e07100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.209+0000 7f873d77e740 1 --2- 172.21.15.148:0/604197911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e07100 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8728018040 tx=0x7f8728005b40 comp rx=0 tx=0).stop 2024-09-21T01:15:25.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.209+0000 7f873d77e740 1 -- 172.21.15.148:0/604197911 shutdown_connections 2024-09-21T01:15:25.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.209+0000 7f873d77e740 1 --2- 172.21.15.148:0/604197911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a62070 0x559062e07100 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.209+0000 7f873d77e740 1 --2- 172.21.15.148:0/604197911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a41390 0x559062e06bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.209+0000 7f873d77e740 1 --2- 172.21.15.148:0/604197911 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a391b0 0x559062e0ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.209+0000 7f873d77e740 1 -- 172.21.15.148:0/604197911 >> 172.21.15.148:0/604197911 conn(0x559062a56460 msgr2=0x559062e0a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.209+0000 7f873d77e740 1 -- 172.21.15.148:0/604197911 shutdown_connections 2024-09-21T01:15:25.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.209+0000 7f873d77e740 1 -- 172.21.15.148:0/604197911 wait complete. 2024-09-21T01:15:25.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.210+0000 7f873d77e740 1 -- start start 2024-09-21T01:15:25.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.210+0000 7f873d77e740 1 Processor -- start 2024-09-21T01:15:25.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.210+0000 7f873d77e740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 0x559062e1d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.210+0000 7f873d77e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a41390 0x559062e1d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.210+0000 7f873d77e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a62070 0x559062e8ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.210+0000 7f873d77e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f87301ada70 con 0x559062a41390 2024-09-21T01:15:25.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.210+0000 7f873d77e740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f87301aeee0 con 0x559062a391b0 2024-09-21T01:15:25.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.210+0000 7f873d77e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87301ae140 con 0x559062a62070 2024-09-21T01:15:25.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.210+0000 7f873d77e740 10 client.0 _ll_register_callbacks cb 0x7f8728009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:25.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f872ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a41390 0x559062e1d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f872ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a41390 0x559062e1d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40148/0 (socket says 172.21.15.148:40148) 2024-09-21T01:15:25.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f872ffff640 1 -- 172.21.15.148:0/2359587508 learned_addr learned my addr 172.21.15.148:0/2359587508 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:25.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f87357a7640 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a62070 0x559062e8ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f8734fa6640 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 0x559062e1d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f872ffff640 1 -- 172.21.15.148:0/2359587508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a62070 msgr2=0x559062e8ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f872ffff640 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a62070 0x559062e8ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f872ffff640 1 -- 172.21.15.148:0/2359587508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 msgr2=0x559062e1d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f872ffff640 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 0x559062e1d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f872ffff640 1 -- 172.21.15.148:0/2359587508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559062e1dce0 con 0x559062a41390 2024-09-21T01:15:25.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f8734fa6640 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 0x559062e1d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:25.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f872ffff640 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a41390 0x559062e1d640 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f871c009900 tx=0x7f871c0317a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00ff0dc0cdffbf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f870ffff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:25.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f870ffff640 1 -- 172.21.15.148:0/2359587508 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c035040 con 0x559062a41390 2024-09-21T01:15:25.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f870ffff640 1 -- 172.21.15.148:0/2359587508 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f871c004040 con 0x559062a41390 2024-09-21T01:15:25.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.211+0000 7f873d77e740 1 -- 172.21.15.148:0/2359587508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f872801fc10 con 0x559062a41390 2024-09-21T01:15:25.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f870ffff640 1 -- 172.21.15.148:0/2359587508 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f871c004240 con 0x559062a41390 2024-09-21T01:15:25.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f873d77e740 10 client.15720 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:25.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f873d77e740 1 -- 172.21.15.148:0/2359587508 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559062e96350 con 0x559062a41390 2024-09-21T01:15:25.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f870ffff640 1 -- 172.21.15.148:0/2359587508 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f872801fc10 con 0x559062a41390 2024-09-21T01:15:25.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f870ffff640 1 -- 172.21.15.148:0/2359587508 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f871c004ac0 con 0x559062a41390 2024-09-21T01:15:25.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f873d77e740 10 client.15720 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:25.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f873d77e740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:25.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f873d77e740 20 client.15720 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:25.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f873d77e740 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5590629f5da0 0x559062e98bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f873d77e740 4 client.15720 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:15:25.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f873d77e740 1 -- 172.21.15.148:0/2359587508 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559062d7d8a0 con 0x5590629f5da0 2024-09-21T01:15:25.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.212+0000 7f8734fa6640 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5590629f5da0 0x559062e98bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f870ffff640 10 client.15720 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f8734fa6640 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5590629f5da0 0x559062e98bf0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f79cf8776688c92b server_cookie=e64269230b030b71 in_seq=0 out_seq=0 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f870ffff640 1 -- 172.21.15.148:0/2359587508 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559062d7d8a0 con 0x5590629f5da0 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f870ffff640 10 client.15720 handle_command_reply: tid=0 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f873d77e740 1 client.15720 shutdown 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f873d77e740 1 -- 172.21.15.148:0/2359587508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a41390 msgr2=0x559062e1d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f873d77e740 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a41390 0x559062e1d640 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f871c009900 tx=0x7f871c0317a0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f873d77e740 1 -- 172.21.15.148:0/2359587508 shutdown_connections 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f873d77e740 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5590629f5da0 0x559062e98bf0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f870ffff640 0 client.15720 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f873d77e740 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559062a41390 0x559062e1d640 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f873d77e740 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559062a62070 0x559062e8ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f873d77e740 1 --2- 172.21.15.148:0/2359587508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559062a391b0 0x559062e1d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.213+0000 7f873d77e740 1 -- 172.21.15.148:0/2359587508 >> 172.21.15.148:0/2359587508 conn(0x559062a56460 msgr2=0x559062e16280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873d77e740 1 -- 172.21.15.148:0/2359587508 shutdown_connections 2024-09-21T01:15:25.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873d77e740 1 -- 172.21.15.148:0/2359587508 wait complete. 2024-09-21T01:15:25.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873d77e740 20 client.15720 trim_cache size 0 max 16384 2024-09-21T01:15:25.225 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-21T01:15:25.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 -- 172.21.15.148:0/3483321702 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87200b65a0 msgr2=0x7f87200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87200b65a0 0x7f87200b8ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8728005fd0 tx=0x7f8728009600 comp rx=0 tx=0).stop 2024-09-21T01:15:25.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 -- 172.21.15.148:0/3483321702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8730102a80 msgr2=0x7f873019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8730102a80 0x7f873019a4a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f872400d950 tx=0x7f872400de10 comp rx=0 tx=0).stop 2024-09-21T01:15:25.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 -- 172.21.15.148:0/3483321702 shutdown_connections 2024-09-21T01:15:25.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f87200b65a0 0x7f87200b8ab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8730108d10 0x7f873019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87301083c0 0x7f873019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 --2- 172.21.15.148:0/3483321702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8730102a80 0x7f873019a4a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 -- 172.21.15.148:0/3483321702 >> 172.21.15.148:0/3483321702 conn(0x7f8730079740 msgr2=0x7f873006bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.214+0000 7f873720a640 1 -- 172.21.15.148:0/3483321702 shutdown_connections 2024-09-21T01:15:25.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:25.215+0000 7f873720a640 1 -- 172.21.15.148:0/3483321702 wait complete. 2024-09-21T01:15:25.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:25 smithi157 ceph-mon[34140]: pgmap v381: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-21T01:15:25.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:25 smithi148 ceph-mon[31000]: pgmap v381: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-21T01:15:25.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:25 smithi181 ceph-mon[34811]: pgmap v381: 97 pgs: 97 active+clean; 1.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-21T01:15:26.952 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:15:26.952 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:15:27.222 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:27.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:27 smithi148 ceph-mon[31000]: pgmap v382: 97 pgs: 97 active+clean; 1.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 860 KiB/s wr, 12 op/s 2024-09-21T01:15:27.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:27 smithi148 ceph-mon[31000]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T01:15:27.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 -- 172.21.15.148:0/1838648362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc0103b90 msgr2=0x7fccc0103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 --2- 172.21.15.148:0/1838648362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc0103b90 0x7fccc0103fa0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009900 tx=0x7fccb002a410 comp rx=0 tx=0).stop 2024-09-21T01:15:27.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 -- 172.21.15.148:0/1838648362 shutdown_connections 2024-09-21T01:15:27.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 --2- 172.21.15.148:0/1838648362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc0109e20 0x7fccc0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 --2- 172.21.15.148:0/1838648362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccc01094d0 0x7fccc01098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 --2- 172.21.15.148:0/1838648362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc0103b90 0x7fccc0103fa0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 -- 172.21.15.148:0/1838648362 >> 172.21.15.148:0/1838648362 conn(0x7fccc00ff600 msgr2=0x7fccc0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:27.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 -- 172.21.15.148:0/1838648362 shutdown_connections 2024-09-21T01:15:27.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 -- 172.21.15.148:0/1838648362 wait complete. 2024-09-21T01:15:27.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 Processor -- start 2024-09-21T01:15:27.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.771+0000 7fccc665b640 1 -- start start 2024-09-21T01:15:27.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccc665b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc0103b90 0x7fccc019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccc665b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc01094d0 0x7fccc019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccc665b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccc0109e20 0x7fccc019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccc665b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0113b40 con 0x7fccc01094d0 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccc665b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fccc01139c0 con 0x7fccc0109e20 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccc665b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0113cc0 con 0x7fccc0103b90 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc01094d0 0x7fccc019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc01094d0 0x7fccc019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37520/0 (socket says 172.21.15.148:37520) 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccbf7fe640 1 -- 172.21.15.148:0/942204497 learned_addr learned my addr 172.21.15.148:0/942204497 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccc4bf8640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccc0109e20 0x7fccc019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.772+0000 7fccbffff640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc0103b90 0x7fccc019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccbf7fe640 1 -- 172.21.15.148:0/942204497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc0103b90 msgr2=0x7fccc019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc0103b90 0x7fccc019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccbf7fe640 1 -- 172.21.15.148:0/942204497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccc0109e20 msgr2=0x7fccc019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccc0109e20 0x7fccc019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccbf7fe640 1 -- 172.21.15.148:0/942204497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc01a0480 con 0x7fccc01094d0 2024-09-21T01:15:27.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc01094d0 0x7fccc019aab0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c970 tx=0x7fccb400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:27.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccbd7fa640 1 -- 172.21.15.148:0/942204497 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4007bb0 con 0x7fccc01094d0 2024-09-21T01:15:27.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccc665b640 1 -- 172.21.15.148:0/942204497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc01a0770 con 0x7fccc01094d0 2024-09-21T01:15:27.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccbd7fa640 1 -- 172.21.15.148:0/942204497 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccb4007d50 con 0x7fccc01094d0 2024-09-21T01:15:27.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccbd7fa640 1 -- 172.21.15.148:0/942204497 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb400f450 con 0x7fccc01094d0 2024-09-21T01:15:27.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.773+0000 7fccc665b640 1 -- 172.21.15.148:0/942204497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc01a6f50 con 0x7fccc01094d0 2024-09-21T01:15:27.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.776+0000 7fccbd7fa640 1 -- 172.21.15.148:0/942204497 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7fccb400f5f0 con 0x7fccc01094d0 2024-09-21T01:15:27.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.776+0000 7fccccbcf740 1 Processor -- start 2024-09-21T01:15:27.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.776+0000 7fccccbcf740 1 -- start start 2024-09-21T01:15:27.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a866350 0x55c39ac0d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac0d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a845670 0x55c39ac0deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccccbcf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c39ab83e60 con 0x55c39a866350 2024-09-21T01:15:27.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccccbcf740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55c39ab73290 con 0x55c39a83d490 2024-09-21T01:15:27.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccccbcf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c39ab770a0 con 0x55c39a845670 2024-09-21T01:15:27.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccc4bf8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a866350 0x55c39ac0d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccc4bf8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a866350 0x55c39ac0d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37530/0 (socket says 172.21.15.148:37530) 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccc4bf8640 1 -- 172.21.15.148:0/3060251972 learned_addr learned my addr 172.21.15.148:0/3060251972 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/3060251972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a845670 0x55c39ac0deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccbffff640 1 --2- 172.21.15.148:0/3060251972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac0d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccbd7fa640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcca80b6590 0x7fcca80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccc4bf8640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcca80b6590 0x7fcca80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3060251972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 msgr2=0x55c39ac0d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/3060251972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac0d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3060251972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a866350 msgr2=0x55c39ac0d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/3060251972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a866350 0x55c39ac0d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3060251972 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39a8d1930 con 0x55c39a845670 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.777+0000 7fccbffff640 1 --2- 172.21.15.148:0/3060251972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac0d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.778+0000 7fccbd7fa640 1 -- 172.21.15.148:0/942204497 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fccb40e6f90 con 0x7fccc01094d0 2024-09-21T01:15:27.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.778+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/3060251972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a845670 0x55c39ac0deb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fccb40e4a20 tx=0x7fccb401f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9425a13a1496311 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:27.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.778+0000 7fccc4bf8640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcca80b6590 0x7fcca80b8aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009b80 tx=0x7fccb8004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:27.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.778+0000 7fcca67fc640 1 -- 172.21.15.148:0/3060251972 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb40acf90 con 0x55c39a845670 2024-09-21T01:15:27.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.778+0000 7fcca67fc640 1 -- 172.21.15.148:0/3060251972 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccb40accd0 con 0x55c39a845670 2024-09-21T01:15:27.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.778+0000 7fcca67fc640 1 -- 172.21.15.148:0/3060251972 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb40ac930 con 0x55c39a845670 2024-09-21T01:15:27.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.779+0000 7fccccbcf740 1 -- 172.21.15.148:0/3060251972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a845670 msgr2=0x55c39ac0deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.779+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3060251972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a845670 0x55c39ac0deb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fccb40e4a20 tx=0x7fccb401f000 comp rx=0 tx=0).stop 2024-09-21T01:15:27.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.779+0000 7fccccbcf740 1 -- 172.21.15.148:0/3060251972 shutdown_connections 2024-09-21T01:15:27.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.779+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3060251972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a845670 0x55c39ac0deb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.779+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3060251972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac0d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.779+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3060251972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a866350 0x55c39ac0d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.779+0000 7fccccbcf740 1 -- 172.21.15.148:0/3060251972 >> 172.21.15.148:0/3060251972 conn(0x55c39a85a740 msgr2=0x55c39ac0b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:27.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.779+0000 7fccccbcf740 1 -- 172.21.15.148:0/3060251972 shutdown_connections 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.779+0000 7fccccbcf740 1 -- 172.21.15.148:0/3060251972 wait complete. 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.780+0000 7fccccbcf740 1 -- start start 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.780+0000 7fccccbcf740 1 Processor -- start 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.780+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac1d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.780+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.780+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac29240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.780+0000 7fccccbcf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c39a9d4890 con 0x55c39a845670 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.780+0000 7fccccbcf740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55c39ab0dd40 con 0x55c39a83d490 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.780+0000 7fccccbcf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c39ac1ff10 con 0x55c39a866350 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.780+0000 7fccccbcf740 10 client.0 _ll_register_callbacks cb 0x55c39ab71c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37534/0 (socket says 172.21.15.148:37534) 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3795492388 learned_addr learned my addr 172.21.15.148:0/3795492388 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:27.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccc4bf8640 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac29240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccbffff640 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac1d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3795492388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 msgr2=0x55c39ac29240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac29240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3795492388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 msgr2=0x55c39ac1d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac1d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3795492388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39ac29830 con 0x55c39a845670 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1d980 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fccb40e4a50 tx=0x7fccb40ac930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73338af22d01be5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fcc9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.781+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3795492388 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb401d070 con 0x55c39a845670 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3795492388 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fccb40c2dd0 con 0x55c39a845670 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fccccbcf740 1 -- 172.21.15.148:0/3795492388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccb40accd0 con 0x55c39a845670 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3795492388 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fccb40acb10 con 0x55c39a845670 2024-09-21T01:15:27.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fccccbcf740 10 client.15732 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fccccbcf740 1 -- 172.21.15.148:0/3795492388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c39ac2c140 con 0x55c39a845670 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3795492388 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccb40accd0 con 0x55c39a845670 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3795492388 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7fccb40b66a0 con 0x55c39a845670 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fccccbcf740 10 client.15732 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fccccbcf740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fccccbcf740 20 client.15732 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55c39a824cd0 0x55c39ac2f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fccccbcf740 4 client.15732 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.782+0000 7fccccbcf740 1 -- 172.21.15.148:0/3795492388 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c39ab85db0 con 0x55c39a824cd0 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.783+0000 7fccbffff640 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55c39a824cd0 0x55c39ac2f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.783+0000 7fcc9f7fe640 10 client.15732 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:27.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.783+0000 7fccbffff640 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55c39a824cd0 0x55c39ac2f4a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c393bd5122b01d3 server_cookie=96e212114c9a93df in_seq=0 out_seq=0 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3795492388 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c39ab85db0 con 0x55c39a824cd0 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fcc9f7fe640 10 client.15732 handle_command_reply: tid=0 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fccccbcf740 1 client.15732 shutdown 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fccccbcf740 1 -- 172.21.15.148:0/3795492388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 msgr2=0x55c39ac1d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1d980 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fccb40e4a50 tx=0x7fccb40ac930 comp rx=0 tx=0).stop 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fccccbcf740 1 -- 172.21.15.148:0/3795492388 shutdown_connections 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55c39a824cd0 0x55c39ac2f4a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1d980 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac29240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fcc9f7fe640 0 client.15732 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3795492388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac1d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.784+0000 7fccccbcf740 1 -- 172.21.15.148:0/3795492388 >> 172.21.15.148:0/3795492388 conn(0x55c39a85a740 msgr2=0x55c39ac0ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:27.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.785+0000 7fccccbcf740 1 -- 172.21.15.148:0/3795492388 shutdown_connections 2024-09-21T01:15:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.785+0000 7fccccbcf740 1 -- 172.21.15.148:0/3795492388 wait complete. 2024-09-21T01:15:27.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.785+0000 7fccccbcf740 20 client.15732 trim_cache size 0 max 16384 2024-09-21T01:15:27.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.802+0000 7fccccbcf740 1 Processor -- start 2024-09-21T01:15:27.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.802+0000 7fccccbcf740 1 -- start start 2024-09-21T01:15:27.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac1bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac1a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccccbcf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fccc01afac0 con 0x55c39a845670 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccccbcf740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fccc01ad390 con 0x55c39a83d490 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccccbcf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fccc01ab1e0 con 0x55c39a866350 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37544/0 (socket says 172.21.15.148:37544) 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccbf7fe640 1 -- 172.21.15.148:0/932649602 learned_addr learned my addr 172.21.15.148:0/932649602 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccbffff640 1 --2- 172.21.15.148:0/932649602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac1bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccc4bf8640 1 --2- 172.21.15.148:0/932649602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac1a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccbf7fe640 1 -- 172.21.15.148:0/932649602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 msgr2=0x55c39ac1a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/932649602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac1a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccbf7fe640 1 -- 172.21.15.148:0/932649602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 msgr2=0x55c39ac1bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:27.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/932649602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac1bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccbf7fe640 1 -- 172.21.15.148:0/932649602 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39ac069e0 con 0x55c39a845670 2024-09-21T01:15:27.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.803+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/932649602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1c000 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fccb40e4a80 tx=0x7fccb4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8d35b60d50b9e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:27.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.804+0000 7fcca5ffb640 1 -- 172.21.15.148:0/932649602 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb401d040 con 0x55c39a845670 2024-09-21T01:15:27.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.804+0000 7fcca5ffb640 1 -- 172.21.15.148:0/932649602 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccb40accd0 con 0x55c39a845670 2024-09-21T01:15:27.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.804+0000 7fcca5ffb640 1 -- 172.21.15.148:0/932649602 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4098240 con 0x55c39a845670 2024-09-21T01:15:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 -- 172.21.15.148:0/932649602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 msgr2=0x55c39ac1c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 --2- 172.21.15.148:0/932649602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1c000 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fccb40e4a80 tx=0x7fccb4000bc0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 -- 172.21.15.148:0/932649602 shutdown_connections 2024-09-21T01:15:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 --2- 172.21.15.148:0/932649602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac1c000 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 --2- 172.21.15.148:0/932649602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac1a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 --2- 172.21.15.148:0/932649602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac1bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 -- 172.21.15.148:0/932649602 >> 172.21.15.148:0/932649602 conn(0x55c39a85a740 msgr2=0x55c39ac183d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 -- 172.21.15.148:0/932649602 shutdown_connections 2024-09-21T01:15:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 -- 172.21.15.148:0/932649602 wait complete. 2024-09-21T01:15:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 -- start start 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.805+0000 7fccccbcf740 1 Processor -- start 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac2ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac2f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccccbcf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac92be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccccbcf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fccc01ab850 con 0x55c39a845670 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccccbcf740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fccc01accc0 con 0x55c39a83d490 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccccbcf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fccc01abf20 con 0x55c39a866350 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccccbcf740 10 client.0 _ll_register_callbacks cb 0x7fccb8009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac2f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac2f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37552/0 (socket says 172.21.15.148:37552) 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3131517109 learned_addr learned my addr 172.21.15.148:0/3131517109 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbffff640 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac2ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccc4bf8640 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac92be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3131517109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 msgr2=0x55c39ac92be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac92be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3131517109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 msgr2=0x55c39ac2ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac2ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbf7fe640 1 -- 172.21.15.148:0/3131517109 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39ac93250 con 0x55c39a845670 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbffff640 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac2ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fccbf7fe640 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac2f3f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fccb40ad150 tx=0x7fccb40eaa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f2d5094f38efa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.806+0000 7fcc9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3131517109 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb401d070 con 0x55c39a845670 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3131517109 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fccb40ac620 con 0x55c39a845670 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fccccbcf740 1 -- 172.21.15.148:0/3131517109 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccb40accd0 con 0x55c39a845670 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3131517109 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fccb40eab00 con 0x55c39a845670 2024-09-21T01:15:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fccccbcf740 10 client.15738 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fccccbcf740 1 -- 172.21.15.148:0/3131517109 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c39ac93250 con 0x55c39a845670 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3131517109 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccb40accd0 con 0x55c39a845670 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3131517109 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7fccb40d0a90 con 0x55c39a845670 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fccccbcf740 10 client.15738 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fccccbcf740 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fccccbcf740 20 client.15738 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55c39a7fa080 0x55c39ac9c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fccccbcf740 4 client.15738 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.807+0000 7fccccbcf740 1 -- 172.21.15.148:0/3131517109 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c39ac17ee0 con 0x55c39a7fa080 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.808+0000 7fccbffff640 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55c39a7fa080 0x55c39ac9c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.808+0000 7fcc9f7fe640 10 client.15738 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.808+0000 7fccbffff640 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55c39a7fa080 0x55c39ac9c890 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=998b3c80a237e955 server_cookie=8cc8052b0c79a06 in_seq=0 out_seq=0 2024-09-21T01:15:27.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fcc9f7fe640 1 -- 172.21.15.148:0/3131517109 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c39ac17ee0 con 0x55c39a7fa080 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fcc9f7fe640 10 client.15738 handle_command_reply: tid=0 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 client.15738 shutdown 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 -- 172.21.15.148:0/3131517109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 msgr2=0x55c39ac2f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac2f3f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fccb40ad150 tx=0x7fccb40eaa10 comp rx=0 tx=0).stop 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 -- 172.21.15.148:0/3131517109 shutdown_connections 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55c39a7fa080 0x55c39ac9c890 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fcc9f7fe640 0 client.15738 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c39a845670 0x55c39ac2f3f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c39a866350 0x55c39ac92be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 --2- 172.21.15.148:0/3131517109 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c39a83d490 0x55c39ac2ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 -- 172.21.15.148:0/3131517109 >> 172.21.15.148:0/3131517109 conn(0x55c39a85a740 msgr2=0x55c39ac12510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 -- 172.21.15.148:0/3131517109 shutdown_connections 2024-09-21T01:15:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 1 -- 172.21.15.148:0/3131517109 wait complete. 2024-09-21T01:15:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.810+0000 7fccccbcf740 20 client.15738 trim_cache size 0 max 16384 2024-09-21T01:15:27.815 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:15:27.815 INFO:teuthology.orchestra.run.smithi148.stdout: "return_code": 0, 2024-09-21T01:15:27.815 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_tag": "e82118d3-734a-402a-a119-64146f305eb3", 2024-09-21T01:15:27.815 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": "asynchronous" 2024-09-21T01:15:27.815 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:15:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 -- 172.21.15.148:0/942204497 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcca80b6590 msgr2=0x7fcca80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcca80b6590 0x7fcca80b8aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009b80 tx=0x7fccb8004a40 comp rx=0 tx=0).stop 2024-09-21T01:15:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 -- 172.21.15.148:0/942204497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc01094d0 msgr2=0x7fccc019aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc01094d0 0x7fccc019aab0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c970 tx=0x7fccb400ce30 comp rx=0 tx=0).stop 2024-09-21T01:15:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 -- 172.21.15.148:0/942204497 shutdown_connections 2024-09-21T01:15:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fcca80b6590 0x7fcca80b8aa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc01094d0 0x7fccc019aab0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fccc0109e20 0x7fccc019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 --2- 172.21.15.148:0/942204497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc0103b90 0x7fccc019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 -- 172.21.15.148:0/942204497 >> 172.21.15.148:0/942204497 conn(0x7fccc00ff600 msgr2=0x7fccc0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.811+0000 7fccc665b640 1 -- 172.21.15.148:0/942204497 shutdown_connections 2024-09-21T01:15:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:27.812+0000 7fccc665b640 1 -- 172.21.15.148:0/942204497 wait complete. 2024-09-21T01:15:27.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:27 smithi181 ceph-mon[34811]: pgmap v382: 97 pgs: 97 active+clean; 1.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 860 KiB/s wr, 12 op/s 2024-09-21T01:15:27.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:27 smithi181 ceph-mon[34811]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T01:15:27.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:27 smithi157 ceph-mon[34140]: pgmap v382: 97 pgs: 97 active+clean; 1.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 860 KiB/s wr, 12 op/s 2024-09-21T01:15:27.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:27 smithi157 ceph-mon[34140]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T01:15:28.628 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:15:28.904 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:29.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.373+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/3183935132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c58102730 msgr2=0x7f9c58110560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.373+0000 7f9c5f4a1640 1 --2- 172.21.15.148:0/3183935132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c58102730 0x7f9c58110560 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009ca0 tx=0x7f9c5002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.373+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/3183935132 shutdown_connections 2024-09-21T01:15:29.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.373+0000 7f9c5f4a1640 1 --2- 172.21.15.148:0/3183935132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c58102730 0x7f9c58110560 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.373+0000 7f9c5f4a1640 1 --2- 172.21.15.148:0/3183935132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c58101de0 0x7f9c581021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.373+0000 7f9c5f4a1640 1 --2- 172.21.15.148:0/3183935132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c581086f0 0x7f9c58108b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.373+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/3183935132 >> 172.21.15.148:0/3183935132 conn(0x7f9c58077c60 msgr2=0x7f9c580780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.374+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/3183935132 shutdown_connections 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.374+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/3183935132 wait complete. 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.374+0000 7f9c5f4a1640 1 Processor -- start 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.374+0000 7f9c5f4a1640 1 -- start start 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5f4a1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c58101de0 0x7f9c5819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5f4a1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c58102730 0x7f9c5819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5f4a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c581086f0 0x7f9c5819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5f4a1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58113aa0 con 0x7f9c58102730 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5f4a1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58113920 con 0x7f9c58101de0 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5f4a1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58113c20 con 0x7f9c581086f0 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5ca3c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c58102730 0x7f9c5819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5ca3c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c58102730 0x7f9c5819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37570/0 (socket says 172.21.15.148:37570) 2024-09-21T01:15:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5ca3c640 1 -- 172.21.15.148:0/4190357153 learned_addr learned my addr 172.21.15.148:0/4190357153 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c58101de0 0x7f9c5819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5da3e640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c581086f0 0x7f9c5819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5ca3c640 1 -- 172.21.15.148:0/4190357153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c581086f0 msgr2=0x7f9c5819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c581086f0 0x7f9c5819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5ca3c640 1 -- 172.21.15.148:0/4190357153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c58101de0 msgr2=0x7f9c5819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c58101de0 0x7f9c5819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5ca3c640 1 -- 172.21.15.148:0/4190357153 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c581a03c0 con 0x7f9c58102730 2024-09-21T01:15:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5da3e640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c581086f0 0x7f9c5819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c58102730 0x7f9c5819aab0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00d740 tx=0x7f9c4c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.375+0000 7f9c4a7fc640 1 -- 172.21.15.148:0/4190357153 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c017070 con 0x7f9c58102730 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.376+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/4190357153 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c581a06b0 con 0x7f9c58102730 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.376+0000 7f9c4a7fc640 1 -- 172.21.15.148:0/4190357153 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c4c009cd0 con 0x7f9c58102730 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.376+0000 7f9c4a7fc640 1 -- 172.21.15.148:0/4190357153 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c003c20 con 0x7f9c58102730 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.376+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/4190357153 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c581a6ed0 con 0x7f9c58102730 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.378+0000 7f9c65a15740 1 Processor -- start 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.378+0000 7f9c65a15740 1 -- start start 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 0x564ff79b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75e41b0 0x564ff79b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c65a15740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564ff792ae50 con 0x564ff75ec390 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c65a15740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x564ff791a280 con 0x564ff760d070 2024-09-21T01:15:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c65a15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564ff791e090 con 0x564ff75e41b0 2024-09-21T01:15:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c4a7fc640 1 -- 172.21.15.148:0/4190357153 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f9c4c009820 con 0x7f9c58102730 2024-09-21T01:15:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c5d23d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75e41b0 0x564ff79b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c5d23d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75e41b0 0x564ff79b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:38302/0 (socket says 172.21.15.148:38302) 2024-09-21T01:15:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c5d23d640 1 -- 172.21.15.148:0/99117968 learned_addr learned my addr 172.21.15.148:0/99117968 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c5da3e640 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 0x564ff79b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.379+0000 7f9c5da3e640 1 -- 172.21.15.148:0/99117968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75e41b0 msgr2=0x564ff79b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.380+0000 7f9c5da3e640 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75e41b0 0x564ff79b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.380+0000 7f9c5da3e640 1 -- 172.21.15.148:0/99117968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 msgr2=0x564ff79b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.380+0000 7f9c5da3e640 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.380+0000 7f9c5da3e640 1 -- 172.21.15.148:0/99117968 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff7678650 con 0x564ff760d070 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.380+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.380+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75e41b0 0x564ff79b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.380+0000 7f9c4a7fc640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c440b6540 0x7f9c440b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.381+0000 7f9c4a7fc640 1 -- 172.21.15.148:0/4190357153 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f9c4c0e6c80 con 0x7f9c58102730 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.381+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c440b6540 0x7f9c440b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.381+0000 7f9c5da3e640 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 0x564ff79b4650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006010 tx=0x7f9c500099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=662fc8827d6c6e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.381+0000 7f9c437fe640 1 -- 172.21.15.148:0/99117968 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50031450 con 0x564ff760d070 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.381+0000 7f9c437fe640 1 -- 172.21.15.148:0/99117968 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c50036040 con 0x564ff760d070 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.381+0000 7f9c437fe640 1 -- 172.21.15.148:0/99117968 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c500043a0 con 0x564ff760d070 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.382+0000 7f9c65a15740 1 -- 172.21.15.148:0/99117968 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 msgr2=0x564ff79b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.382+0000 7f9c65a15740 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 0x564ff79b4650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006010 tx=0x7f9c500099c0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.382+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c440b6540 0x7f9c440b8a50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x564ff79b32d0 tx=0x7f9c5400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.382+0000 7f9c65a15740 1 -- 172.21.15.148:0/99117968 shutdown_connections 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.382+0000 7f9c65a15740 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.382+0000 7f9c65a15740 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75e41b0 0x564ff79b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.382+0000 7f9c65a15740 1 --2- 172.21.15.148:0/99117968 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 0x564ff79b4650 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.382+0000 7f9c65a15740 1 -- 172.21.15.148:0/99117968 >> 172.21.15.148:0/99117968 conn(0x564ff7601460 msgr2=0x564ff79b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.382+0000 7f9c65a15740 1 -- 172.21.15.148:0/99117968 shutdown_connections 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.382+0000 7f9c65a15740 1 -- 172.21.15.148:0/99117968 wait complete. 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.383+0000 7f9c65a15740 1 -- start start 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.383+0000 7f9c65a15740 1 Processor -- start 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.383+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff75e41b0 0x564ff79bfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.383+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79c0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.383+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff760d070 0x564ff79cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.383+0000 7f9c65a15740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564ff777b700 con 0x564ff75ec390 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.383+0000 7f9c65a15740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x564ff78b5110 con 0x564ff75e41b0 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.383+0000 7f9c65a15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564ff79c2dd0 con 0x564ff760d070 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5ca3c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79c0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c65a15740 10 client.0 _ll_register_callbacks cb 0x564ff78ce990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5ca3c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79c0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37580/0 (socket says 172.21.15.148:37580) 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5ca3c640 1 -- 172.21.15.148:0/3510591053 learned_addr learned my addr 172.21.15.148:0/3510591053 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff75e41b0 0x564ff79bfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5da3e640 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff760d070 0x564ff79cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5ca3c640 1 -- 172.21.15.148:0/3510591053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff760d070 msgr2=0x564ff79cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff760d070 0x564ff79cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5ca3c640 1 -- 172.21.15.148:0/3510591053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff75e41b0 msgr2=0x564ff79bfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff75e41b0 0x564ff79bfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5ca3c640 1 -- 172.21.15.148:0/3510591053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff78e2c40 con 0x564ff75ec390 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79c0260 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c000c00 tx=0x7f9c4c0a9470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548867d53c91a186 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c40ff9640 1 -- 172.21.15.148:0/3510591053 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c020030 con 0x564ff75ec390 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c40ff9640 1 -- 172.21.15.148:0/3510591053 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f9c4c094110 con 0x564ff75ec390 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.384+0000 7f9c65a15740 1 -- 172.21.15.148:0/3510591053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c50036040 con 0x564ff75ec390 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c40ff9640 1 -- 172.21.15.148:0/3510591053 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c4c0acbf0 con 0x564ff75ec390 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c65a15740 10 client.15750 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c65a15740 1 -- 172.21.15.148:0/3510591053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ff79ceb50 con 0x564ff75ec390 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c40ff9640 1 -- 172.21.15.148:0/3510591053 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c50036040 con 0x564ff75ec390 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c40ff9640 1 -- 172.21.15.148:0/3510591053 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f9c4c0d41f0 con 0x564ff75ec390 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c65a15740 10 client.15750 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c65a15740 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c65a15740 20 client.15750 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c65a15740 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564ff75cb9f0 0x564ff79d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c65a15740 4 client.15750 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c65a15740 1 -- 172.21.15.148:0/3510591053 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ff792cda0 con 0x564ff75cb9f0 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.385+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564ff75cb9f0 0x564ff79d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.386+0000 7f9c40ff9640 10 client.15750 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:29.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.386+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564ff75cb9f0 0x564ff79d2020 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f4fa0edac5f651a server_cookie=7d8b8ad6b263f02c in_seq=0 out_seq=0 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c40ff9640 1 -- 172.21.15.148:0/3510591053 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ff792cda0 con 0x564ff75cb9f0 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c40ff9640 10 client.15750 handle_command_reply: tid=0 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 client.15750 shutdown 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 -- 172.21.15.148:0/3510591053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 msgr2=0x564ff79c0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79c0260 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c000c00 tx=0x7f9c4c0a9470 comp rx=0 tx=0).stop 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 -- 172.21.15.148:0/3510591053 shutdown_connections 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564ff75cb9f0 0x564ff79d2020 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75ec390 0x564ff79c0260 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff760d070 0x564ff79cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 --2- 172.21.15.148:0/3510591053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff75e41b0 0x564ff79bfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 -- 172.21.15.148:0/3510591053 >> 172.21.15.148:0/3510591053 conn(0x564ff7601460 msgr2=0x564ff79b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c40ff9640 0 client.15750 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 -- 172.21.15.148:0/3510591053 shutdown_connections 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 1 -- 172.21.15.148:0/3510591053 wait complete. 2024-09-21T01:15:29.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.387+0000 7f9c65a15740 20 client.15750 trim_cache size 0 max 16384 2024-09-21T01:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.405+0000 7f9c65a15740 1 Processor -- start 2024-09-21T01:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.405+0000 7f9c65a15740 1 -- start start 2024-09-21T01:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.405+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.405+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75ec390 0x564ff79c1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.405+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 0x564ff79cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.405+0000 7f9c65a15740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581b1d20 con 0x564ff75e41b0 2024-09-21T01:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.405+0000 7f9c65a15740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581af5f0 con 0x564ff760d070 2024-09-21T01:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.405+0000 7f9c65a15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581ad440 con 0x564ff75ec390 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5d23d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5d23d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37588/0 (socket says 172.21.15.148:37588) 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5d23d640 1 -- 172.21.15.148:0/399121270 learned_addr learned my addr 172.21.15.148:0/399121270 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5da3e640 1 --2- 172.21.15.148:0/399121270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 0x564ff79cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/399121270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75ec390 0x564ff79c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5d23d640 1 -- 172.21.15.148:0/399121270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75ec390 msgr2=0x564ff79c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/399121270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75ec390 0x564ff79c1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5d23d640 1 -- 172.21.15.148:0/399121270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 msgr2=0x564ff79cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/399121270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 0x564ff79cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5d23d640 1 -- 172.21.15.148:0/399121270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff79b2e30 con 0x564ff75e41b0 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/399121270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79b6040 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x564ff79d27d0 tx=0x7f9c54019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebf03e422377bee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c42ffd640 1 -- 172.21.15.148:0/399121270 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54033070 con 0x564ff75e41b0 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c42ffd640 1 -- 172.21.15.148:0/399121270 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c5401bd80 con 0x564ff75e41b0 2024-09-21T01:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.406+0000 7f9c42ffd640 1 -- 172.21.15.148:0/399121270 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54028750 con 0x564ff75e41b0 2024-09-21T01:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.407+0000 7f9c65a15740 1 -- 172.21.15.148:0/399121270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 msgr2=0x564ff79b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.407+0000 7f9c65a15740 1 --2- 172.21.15.148:0/399121270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79b6040 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x564ff79d27d0 tx=0x7f9c54019000 comp rx=0 tx=0).stop 2024-09-21T01:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.407+0000 7f9c65a15740 1 -- 172.21.15.148:0/399121270 shutdown_connections 2024-09-21T01:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.407+0000 7f9c65a15740 1 --2- 172.21.15.148:0/399121270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff760d070 0x564ff79cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.407+0000 7f9c65a15740 1 --2- 172.21.15.148:0/399121270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff75ec390 0x564ff79c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.407+0000 7f9c65a15740 1 --2- 172.21.15.148:0/399121270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79b6040 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.407+0000 7f9c65a15740 1 -- 172.21.15.148:0/399121270 >> 172.21.15.148:0/399121270 conn(0x564ff7601460 msgr2=0x564ff79c1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.408+0000 7f9c65a15740 1 -- 172.21.15.148:0/399121270 shutdown_connections 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.408+0000 7f9c65a15740 1 -- 172.21.15.148:0/399121270 wait complete. 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.408+0000 7f9c65a15740 1 -- start start 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.408+0000 7f9c65a15740 1 Processor -- start 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.408+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79c4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.408+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff75ec390 0x564ff79c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c65a15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff760d070 0x564ff7a3ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c65a15740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581adab0 con 0x564ff75e41b0 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c65a15740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581aef20 con 0x564ff75ec390 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c65a15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9c581ae180 con 0x564ff760d070 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c65a15740 10 client.0 _ll_register_callbacks cb 0x7f9c4c004220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5d23d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5d23d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79c4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37596/0 (socket says 172.21.15.148:37596) 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5d23d640 1 -- 172.21.15.148:0/123771358 learned_addr learned my addr 172.21.15.148:0/123771358 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff75ec390 0x564ff79c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5da3e640 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff760d070 0x564ff7a3ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5d23d640 1 -- 172.21.15.148:0/123771358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff760d070 msgr2=0x564ff7a3ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff760d070 0x564ff7a3ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5d23d640 1 -- 172.21.15.148:0/123771358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff75ec390 msgr2=0x564ff79c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff75ec390 0x564ff79c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5d23d640 1 -- 172.21.15.148:0/123771358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff7a40380 con 0x564ff75e41b0 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c5d23d640 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79c4470 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9c54005060 tx=0x7f9c54005090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c0e6603da80f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c40ff9640 1 -- 172.21.15.148:0/123771358 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c540054b0 con 0x564ff75e41b0 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.409+0000 7f9c40ff9640 1 -- 172.21.15.148:0/123771358 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f9c5403a980 con 0x564ff75e41b0 2024-09-21T01:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c65a15740 1 -- 172.21.15.148:0/123771358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c5401bd80 con 0x564ff75e41b0 2024-09-21T01:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c40ff9640 1 -- 172.21.15.148:0/123771358 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c5403ab80 con 0x564ff75e41b0 2024-09-21T01:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c65a15740 10 client.15756 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c65a15740 1 -- 172.21.15.148:0/123771358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ff7a3bf70 con 0x564ff75e41b0 2024-09-21T01:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c40ff9640 1 -- 172.21.15.148:0/123771358 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c5401bd80 con 0x564ff75e41b0 2024-09-21T01:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c40ff9640 1 -- 172.21.15.148:0/123771358 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f9c5402e4b0 con 0x564ff75e41b0 2024-09-21T01:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c65a15740 10 client.15756 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c65a15740 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c65a15740 20 client.15756 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c65a15740 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564ff75a0da0 0x564ff7a3e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c65a15740 4 client.15756 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c65a15740 1 -- 172.21.15.148:0/123771358 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564ff7928850 con 0x564ff75a0da0 2024-09-21T01:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.410+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564ff75a0da0 0x564ff7a3e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c40ff9640 10 client.15756 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:29.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c5ca3c640 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564ff75a0da0 0x564ff7a3e730 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d2603b600e4ecd0 server_cookie=1cea23892bde018f in_seq=0 out_seq=0 2024-09-21T01:15:29.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c40ff9640 1 -- 172.21.15.148:0/123771358 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x564ff7928850 con 0x564ff75a0da0 2024-09-21T01:15:29.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c40ff9640 10 client.15756 handle_command_reply: tid=0 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c65a15740 1 client.15756 shutdown 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c65a15740 1 -- 172.21.15.148:0/123771358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 msgr2=0x564ff79c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c65a15740 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79c4470 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9c54005060 tx=0x7f9c54005090 comp rx=0 tx=0).stop 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c65a15740 1 -- 172.21.15.148:0/123771358 shutdown_connections 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c65a15740 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x564ff75a0da0 0x564ff7a3e730 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c65a15740 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ff760d070 0x564ff7a3ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.411+0000 7f9c65a15740 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ff75ec390 0x564ff79c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.412+0000 7f9c65a15740 1 --2- 172.21.15.148:0/123771358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ff75e41b0 0x564ff79c4470 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.412+0000 7f9c65a15740 1 -- 172.21.15.148:0/123771358 >> 172.21.15.148:0/123771358 conn(0x564ff7601460 msgr2=0x564ff79c1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.412+0000 7f9c40ff9640 0 client.15756 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.412+0000 7f9c65a15740 1 -- 172.21.15.148:0/123771358 shutdown_connections 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.412+0000 7f9c65a15740 1 -- 172.21.15.148:0/123771358 wait complete. 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.412+0000 7f9c65a15740 20 client.15756 trim_cache size 0 max 16384 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": { 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stdout: "e82118d3-734a-402a-a119-64146f305eb3": { 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stdout: "tag": "e82118d3-734a-402a-a119-64146f305eb3", 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stdout: "options": "recursive,force" 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:15:29.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_stats": { 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "e82118d3-734a-402a-a119-64146f305eb3": { 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:15:27.808460+0000", 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "0705e125-8af9-4cc6-98ec-fca2de415bde": { 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:14:45.199229+0000", 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:15:29.419 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: "7bf59ed6-eedb-4a06-a813-d8af8d9118b7": { 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:14:02.691995+0000", 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:15:29.420 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.412+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/4190357153 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c440b6540 msgr2=0x7f9c440b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.412+0000 7f9c5f4a1640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c440b6540 0x7f9c440b8a50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x564ff79b32d0 tx=0x7f9c5400a2d0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.412+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/4190357153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c58102730 msgr2=0x7f9c5819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.412+0000 7f9c5f4a1640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c58102730 0x7f9c5819aab0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00d740 tx=0x7f9c4c00db40 comp rx=0 tx=0).stop 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.413+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/4190357153 shutdown_connections 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.413+0000 7f9c5f4a1640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c440b6540 0x7f9c440b8a50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.413+0000 7f9c5f4a1640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c58102730 0x7f9c5819aab0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.413+0000 7f9c5f4a1640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c581086f0 0x7f9c5819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.413+0000 7f9c5f4a1640 1 --2- 172.21.15.148:0/4190357153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c58101de0 0x7f9c5819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.413+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/4190357153 >> 172.21.15.148:0/4190357153 conn(0x7f9c58077c60 msgr2=0x7f9c58106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.413+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/4190357153 shutdown_connections 2024-09-21T01:15:29.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:15:29.413+0000 7f9c5f4a1640 1 -- 172.21.15.148:0/4190357153 wait complete. 2024-09-21T01:15:29.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:29 smithi148 ceph-mon[31000]: scrub queued for path: / 2024-09-21T01:15:29.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:29 smithi148 ceph-mon[31000]: scrub summary: idle+waiting paths [/] 2024-09-21T01:15:29.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:29 smithi148 ceph-mon[31000]: scrub summary: active paths [/] 2024-09-21T01:15:29.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:29 smithi148 ceph-mon[31000]: scrub summary: active paths [/] 2024-09-21T01:15:29.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:29 smithi148 ceph-mon[31000]: scrub summary: idle+waiting paths [/] 2024-09-21T01:15:29.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:29 smithi148 ceph-mon[31000]: scrub summary: idle+waiting paths [/] 2024-09-21T01:15:29.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:29 smithi148 ceph-mon[31000]: pgmap v383: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-21T01:15:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:29 smithi181 ceph-mon[34811]: scrub queued for path: / 2024-09-21T01:15:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:29 smithi181 ceph-mon[34811]: scrub summary: idle+waiting paths [/] 2024-09-21T01:15:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:29 smithi181 ceph-mon[34811]: scrub summary: active paths [/] 2024-09-21T01:15:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:29 smithi181 ceph-mon[34811]: scrub summary: active paths [/] 2024-09-21T01:15:29.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:29 smithi181 ceph-mon[34811]: scrub summary: idle+waiting paths [/] 2024-09-21T01:15:29.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:29 smithi181 ceph-mon[34811]: scrub summary: idle+waiting paths [/] 2024-09-21T01:15:29.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:29 smithi181 ceph-mon[34811]: pgmap v383: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-21T01:15:29.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:29 smithi157 ceph-mon[34140]: scrub queued for path: / 2024-09-21T01:15:29.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:29 smithi157 ceph-mon[34140]: scrub summary: idle+waiting paths [/] 2024-09-21T01:15:29.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:29 smithi157 ceph-mon[34140]: scrub summary: active paths [/] 2024-09-21T01:15:29.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:29 smithi157 ceph-mon[34140]: scrub summary: active paths [/] 2024-09-21T01:15:29.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:29 smithi157 ceph-mon[34140]: scrub summary: idle+waiting paths [/] 2024-09-21T01:15:29.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:29 smithi157 ceph-mon[34140]: scrub summary: idle+waiting paths [/] 2024-09-21T01:15:29.991 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:29 smithi157 ceph-mon[34140]: pgmap v383: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-21T01:15:30.169 INFO:tasks.cephfs.filesystem:scrub status for tag:e82118d3-734a-402a-a119-64146f305eb3 - {'path': '/', 'tag': 'e82118d3-734a-402a-a119-64146f305eb3', 'options': 'recursive,force'} 2024-09-21T01:15:31.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:31 smithi148 ceph-mon[31000]: pgmap v384: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 858 KiB/s wr, 10 op/s 2024-09-21T01:15:31.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:31 smithi181 ceph-mon[34811]: pgmap v384: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 858 KiB/s wr, 10 op/s 2024-09-21T01:15:31.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:31 smithi157 ceph-mon[34140]: pgmap v384: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 858 KiB/s wr, 10 op/s 2024-09-21T01:15:33.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:33 smithi148 ceph-mon[31000]: pgmap v385: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 14 op/s 2024-09-21T01:15:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.957+0000 7f9579fad640 1 -- 172.21.15.148:0/3653516036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9574108300 msgr2=0x7f957410a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.957+0000 7f9579fad640 1 --2- 172.21.15.148:0/3653516036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9574108300 0x7f957410a810 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f956c009900 tx=0x7f956c02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.957+0000 7f9579fad640 1 -- 172.21.15.148:0/3653516036 shutdown_connections 2024-09-21T01:15:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.957+0000 7f9579fad640 1 --2- 172.21.15.148:0/3653516036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9574108300 0x7f957410a810 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.957+0000 7f9579fad640 1 --2- 172.21.15.148:0/3653516036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95741056e0 0x7f9574107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.957+0000 7f9579fad640 1 --2- 172.21.15.148:0/3653516036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9574102c80 0x7f95741050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.957+0000 7f9579fad640 1 -- 172.21.15.148:0/3653516036 >> 172.21.15.148:0/3653516036 conn(0x7f95740fd690 msgr2=0x7f95740ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.957+0000 7f9579fad640 1 -- 172.21.15.148:0/3653516036 shutdown_connections 2024-09-21T01:15:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.957+0000 7f9579fad640 1 -- 172.21.15.148:0/3653516036 wait complete. 2024-09-21T01:15:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.958+0000 7f9579fad640 1 Processor -- start 2024-09-21T01:15:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.958+0000 7f9579fad640 1 -- start start 2024-09-21T01:15:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.958+0000 7f9579fad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9574102c80 0x7f9574102140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f9579fad640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95741056e0 0x7f957419ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f9579fad640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9574108300 0x7f95741a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f9579fad640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f957410e260 con 0x7f9574102c80 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f9579fad640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f957410e0e0 con 0x7f95741056e0 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f9579fad640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f957410e3e0 con 0x7f9574108300 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f95737fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9574102c80 0x7f9574102140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f95737fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9574102c80 0x7f9574102140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37616/0 (socket says 172.21.15.148:37616) 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f95737fe640 1 -- 172.21.15.148:0/557668547 learned_addr learned my addr 172.21.15.148:0/557668547 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f9573fff640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9574108300 0x7f95741a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f9572ffd640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95741056e0 0x7f957419ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f95737fe640 1 -- 172.21.15.148:0/557668547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9574108300 msgr2=0x7f95741a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f95737fe640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9574108300 0x7f95741a11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f95737fe640 1 -- 172.21.15.148:0/557668547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95741056e0 msgr2=0x7f957419ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f95737fe640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95741056e0 0x7f957419ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f95737fe640 1 -- 172.21.15.148:0/557668547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95741a19e0 con 0x7f9574102c80 2024-09-21T01:15:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f95737fe640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9574102c80 0x7f9574102140 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f956400d770 tx=0x7f956400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.959+0000 7f9570ff9640 1 -- 172.21.15.148:0/557668547 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564017070 con 0x7f9574102c80 2024-09-21T01:15:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.960+0000 7f9570ff9640 1 -- 172.21.15.148:0/557668547 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95640054d0 con 0x7f9574102c80 2024-09-21T01:15:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.960+0000 7f9579fad640 1 -- 172.21.15.148:0/557668547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95741a1cd0 con 0x7f9574102c80 2024-09-21T01:15:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.960+0000 7f9570ff9640 1 -- 172.21.15.148:0/557668547 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564004c30 con 0x7f9574102c80 2024-09-21T01:15:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.960+0000 7f9579fad640 1 -- 172.21.15.148:0/557668547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95741a21d0 con 0x7f9574102c80 2024-09-21T01:15:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.962+0000 7f9580ffb740 1 Processor -- start 2024-09-21T01:15:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.962+0000 7f9580ffb740 1 -- start start 2024-09-21T01:15:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.962+0000 7f9570ff9640 1 -- 172.21.15.148:0/557668547 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f9564010460 con 0x7f9574102c80 2024-09-21T01:15:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.962+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329791b0 0x561b32d20e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d214c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329584d0 0x561b32d22010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f9580ffb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561b32c936f0 con 0x561b329502f0 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f9580ffb740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561b32c82b20 con 0x561b329791b0 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f9580ffb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b32c86930 con 0x561b329584d0 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f95737fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f95737fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d214c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37632/0 (socket says 172.21.15.148:37632) 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f95737fe640 1 -- 172.21.15.148:0/3490488722 learned_addr learned my addr 172.21.15.148:0/3490488722 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f9572ffd640 1 --2- 172.21.15.148:0/3490488722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329584d0 0x561b32d22010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f9573fff640 1 --2- 172.21.15.148:0/3490488722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329791b0 0x561b32d20e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f95737fe640 1 -- 172.21.15.148:0/3490488722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329584d0 msgr2=0x561b32d22010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f95737fe640 1 --2- 172.21.15.148:0/3490488722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329584d0 0x561b32d22010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f95737fe640 1 -- 172.21.15.148:0/3490488722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329791b0 msgr2=0x561b32d20e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f95737fe640 1 --2- 172.21.15.148:0/3490488722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329791b0 0x561b32d20e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f95737fe640 1 -- 172.21.15.148:0/3490488722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b32c48530 con 0x561b329502f0 2024-09-21T01:15:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f9570ff9640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f955c0b6510 0x7f955c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f95737fe640 1 --2- 172.21.15.148:0/3490488722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d214c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f95640eaef0 tx=0x7f95640ed820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dd9be398d7d5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.963+0000 7f9573fff640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f955c0b6510 0x7f955c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.964+0000 7f9559ffb640 1 -- 172.21.15.148:0/3490488722 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95640a9670 con 0x561b329502f0 2024-09-21T01:15:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.964+0000 7f9570ff9640 1 -- 172.21.15.148:0/557668547 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f95640e6dd0 con 0x7f9574102c80 2024-09-21T01:15:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.964+0000 7f9559ffb640 1 -- 172.21.15.148:0/3490488722 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95640acb30 con 0x561b329502f0 2024-09-21T01:15:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.964+0000 7f9559ffb640 1 -- 172.21.15.148:0/3490488722 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95640ac790 con 0x561b329502f0 2024-09-21T01:15:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 -- 172.21.15.148:0/3490488722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 msgr2=0x561b32d214c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 --2- 172.21.15.148:0/3490488722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d214c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f95640eaef0 tx=0x7f95640ed820 comp rx=0 tx=0).stop 2024-09-21T01:15:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9573fff640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f955c0b6510 0x7f955c0b8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f956c006010 tx=0x7f956c0314c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 -- 172.21.15.148:0/3490488722 shutdown_connections 2024-09-21T01:15:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 --2- 172.21.15.148:0/3490488722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d214c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 --2- 172.21.15.148:0/3490488722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329584d0 0x561b32d22010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 --2- 172.21.15.148:0/3490488722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329791b0 0x561b32d20e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 -- 172.21.15.148:0/3490488722 >> 172.21.15.148:0/3490488722 conn(0x561b3296d300 msgr2=0x561b32d1c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 -- 172.21.15.148:0/3490488722 shutdown_connections 2024-09-21T01:15:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 -- 172.21.15.148:0/3490488722 wait complete. 2024-09-21T01:15:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 -- start start 2024-09-21T01:15:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.965+0000 7f9580ffb740 1 Processor -- start 2024-09-21T01:15:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d2ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d2f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 0x561b32d2fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9580ffb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561b32bbaab0 con 0x561b329502f0 2024-09-21T01:15:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9580ffb740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561b32c28730 con 0x561b329584d0 2024-09-21T01:15:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9580ffb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b32d22b30 con 0x561b329791b0 2024-09-21T01:15:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9580ffb740 10 client.0 _ll_register_callbacks cb 0x561b32c7c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f95737fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d2ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f95737fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d2ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37646/0 (socket says 172.21.15.148:37646) 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f95737fe640 1 -- 172.21.15.148:0/2920786473 learned_addr learned my addr 172.21.15.148:0/2920786473 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9572ffd640 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d2f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9573fff640 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 0x561b32d2fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9572ffd640 1 -- 172.21.15.148:0/2920786473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 msgr2=0x561b32d2fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9572ffd640 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 0x561b32d2fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9572ffd640 1 -- 172.21.15.148:0/2920786473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 msgr2=0x561b32d2ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9572ffd640 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d2ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9572ffd640 1 -- 172.21.15.148:0/2920786473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b329e4790 con 0x561b329584d0 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f95737fe640 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d2ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.966+0000 7f9573fff640 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 0x561b32d2fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9572ffd640 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d2f0d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9568005c40 tx=0x7f956800af80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68d8427d788b2491 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9552ffd640 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-09-21T01:15:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9552ffd640 1 -- 172.21.15.148:0/2920786473 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956800fd40 con 0x561b329584d0 2024-09-21T01:15:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9580ffb740 1 -- 172.21.15.148:0/2920786473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95640acb30 con 0x561b329584d0 2024-09-21T01:15:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9552ffd640 1 -- 172.21.15.148:0/2920786473 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f9568004b20 con 0x561b329584d0 2024-09-21T01:15:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9552ffd640 1 -- 172.21.15.148:0/2920786473 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9568003970 con 0x561b329584d0 2024-09-21T01:15:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9580ffb740 10 client.25385 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9580ffb740 1 -- 172.21.15.148:0/2920786473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561b32a5d620 con 0x561b329584d0 2024-09-21T01:15:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9552ffd640 1 -- 172.21.15.148:0/2920786473 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95640acb30 con 0x561b329584d0 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9552ffd640 1 -- 172.21.15.148:0/2920786473 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f9568024450 con 0x561b329584d0 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9580ffb740 10 client.25385 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9580ffb740 10 client.25385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.967+0000 7f9580ffb740 20 client.25385 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.968+0000 7f9580ffb740 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b32937d80 0x561b32d3c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.968+0000 7f9580ffb740 4 client.25385 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.968+0000 7f9580ffb740 1 -- 172.21.15.148:0/2920786473 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b32c95640 con 0x561b32937d80 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.968+0000 7f95737fe640 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b32937d80 0x561b32d3c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.968+0000 7f9552ffd640 10 client.25385 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.968+0000 7f95737fe640 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b32937d80 0x561b32d3c2b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccabdd4e9bf0869f server_cookie=8fd7f0679472d382 in_seq=0 out_seq=0 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9552ffd640 1 -- 172.21.15.148:0/2920786473 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b32c95640 con 0x561b32937d80 2024-09-21T01:15:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9552ffd640 10 client.25385 handle_command_reply: tid=0 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 client.25385 shutdown 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 -- 172.21.15.148:0/2920786473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 msgr2=0x561b32d2f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d2f0d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9568005c40 tx=0x7f956800af80 comp rx=0 tx=0).stop 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 -- 172.21.15.148:0/2920786473 shutdown_connections 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b32937d80 0x561b32d3c2b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 0x561b32d2fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d2f0d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 --2- 172.21.15.148:0/2920786473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d2ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9552ffd640 0 client.25385 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 -- 172.21.15.148:0/2920786473 >> 172.21.15.148:0/2920786473 conn(0x561b3296d300 msgr2=0x561b32d1aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 -- 172.21.15.148:0/2920786473 shutdown_connections 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 1 -- 172.21.15.148:0/2920786473 wait complete. 2024-09-21T01:15:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.969+0000 7f9580ffb740 20 client.25385 trim_cache size 0 max 16384 2024-09-21T01:15:33.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:33 smithi181 ceph-mon[34811]: pgmap v385: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 14 op/s 2024-09-21T01:15:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9580ffb740 1 Processor -- start 2024-09-21T01:15:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9580ffb740 1 -- start start 2024-09-21T01:15:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329502f0 0x561b32d1c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d28b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329791b0 0x561b32d29050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9580ffb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f95741ab5d0 con 0x561b329791b0 2024-09-21T01:15:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9580ffb740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f95741a8ea0 con 0x561b329584d0 2024-09-21T01:15:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9580ffb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f95741a6cf0 con 0x561b329502f0 2024-09-21T01:15:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9573fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329791b0 0x561b32d29050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9573fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329791b0 0x561b32d29050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37656/0 (socket says 172.21.15.148:37656) 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f9573fff640 1 -- 172.21.15.148:0/1513594722 learned_addr learned my addr 172.21.15.148:0/1513594722 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.984+0000 7f95737fe640 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329502f0 0x561b32d1c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f9572ffd640 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d28b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f9573fff640 1 -- 172.21.15.148:0/1513594722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329502f0 msgr2=0x561b32d1c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f9573fff640 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329502f0 0x561b32d1c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f9573fff640 1 -- 172.21.15.148:0/1513594722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 msgr2=0x561b32d28b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f9573fff640 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d28b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f9573fff640 1 -- 172.21.15.148:0/1513594722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b32d36ee0 con 0x561b329791b0 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f9572ffd640 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d28b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f95737fe640 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329502f0 0x561b32d1c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f9573fff640 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329791b0 0x561b32d29050 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f956c033000 tx=0x7f956c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3d53f07fb1b90f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f95597fa640 1 -- 172.21.15.148:0/1513594722 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c035040 con 0x561b329791b0 2024-09-21T01:15:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f95597fa640 1 -- 172.21.15.148:0/1513594722 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f956c003ca0 con 0x561b329791b0 2024-09-21T01:15:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.985+0000 7f95597fa640 1 -- 172.21.15.148:0/1513594722 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c03d7c0 con 0x561b329791b0 2024-09-21T01:15:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.986+0000 7f9580ffb740 1 -- 172.21.15.148:0/1513594722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329791b0 msgr2=0x561b32d29050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.986+0000 7f9580ffb740 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329791b0 0x561b32d29050 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f956c033000 tx=0x7f956c040000 comp rx=0 tx=0).stop 2024-09-21T01:15:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.986+0000 7f9580ffb740 1 -- 172.21.15.148:0/1513594722 shutdown_connections 2024-09-21T01:15:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.986+0000 7f9580ffb740 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329791b0 0x561b32d29050 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.986+0000 7f9580ffb740 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d28b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.986+0000 7f9580ffb740 1 --2- 172.21.15.148:0/1513594722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329502f0 0x561b32d1c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.986+0000 7f9580ffb740 1 -- 172.21.15.148:0/1513594722 >> 172.21.15.148:0/1513594722 conn(0x561b3296d300 msgr2=0x561b32d29800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.986+0000 7f9580ffb740 1 -- 172.21.15.148:0/1513594722 shutdown_connections 2024-09-21T01:15:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.986+0000 7f9580ffb740 1 -- 172.21.15.148:0/1513594722 wait complete. 2024-09-21T01:15:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.986+0000 7f9580ffb740 1 -- start start 2024-09-21T01:15:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f9580ffb740 1 Processor -- start 2024-09-21T01:15:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d366b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d35370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f9580ffb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 0x561b32d35910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f9580ffb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f95741a7360 con 0x561b329502f0 2024-09-21T01:15:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f9580ffb740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f95741a87d0 con 0x561b329584d0 2024-09-21T01:15:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f9580ffb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f95741a7a30 con 0x561b329791b0 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f9580ffb740 10 client.0 _ll_register_callbacks cb 0x7f956800aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f95737fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f95737fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d366b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37672/0 (socket says 172.21.15.148:37672) 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f95737fe640 1 -- 172.21.15.148:0/71851641 learned_addr learned my addr 172.21.15.148:0/71851641 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f9572ffd640 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d35370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.987+0000 7f9573fff640 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 0x561b32d35910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f95737fe640 1 -- 172.21.15.148:0/71851641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 msgr2=0x561b32d35910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f95737fe640 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 0x561b32d35910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f95737fe640 1 -- 172.21.15.148:0/71851641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 msgr2=0x561b32d35370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f95737fe640 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d35370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f95737fe640 1 -- 172.21.15.148:0/71851641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b32d360a0 con 0x561b329502f0 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f9572ffd640 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d35370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f95737fe640 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d366b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9564009610 tx=0x7f9564094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609fe9d4c2e30048 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f9552ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f9552ffd640 1 -- 172.21.15.148:0/71851641 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564020040 con 0x561b329502f0 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f9552ffd640 1 -- 172.21.15.148:0/71851641 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f95640e4960 con 0x561b329502f0 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f9580ffb740 1 -- 172.21.15.148:0/71851641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f956c003ca0 con 0x561b329502f0 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f9552ffd640 1 -- 172.21.15.148:0/71851641 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95640ac970 con 0x561b329502f0 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f9580ffb740 10 client.15774 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f9580ffb740 1 -- 172.21.15.148:0/71851641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561b32da6ce0 con 0x561b329502f0 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.988+0000 7f9552ffd640 1 -- 172.21.15.148:0/71851641 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f956c003ca0 con 0x561b329502f0 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.989+0000 7f9552ffd640 1 -- 172.21.15.148:0/71851641 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f95640ed0d0 con 0x561b329502f0 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.989+0000 7f9580ffb740 10 client.15774 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.989+0000 7f9580ffb740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.989+0000 7f9580ffb740 20 client.15774 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.989+0000 7f9580ffb740 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b3290d1c0 0x561b32da9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.989+0000 7f9580ffb740 4 client.15774 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:15:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.989+0000 7f9580ffb740 1 -- 172.21.15.148:0/71851641 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b32c910f0 con 0x561b3290d1c0 2024-09-21T01:15:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.989+0000 7f9572ffd640 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b3290d1c0 0x561b32da9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.989+0000 7f9552ffd640 10 client.15774 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.989+0000 7f9572ffd640 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b3290d1c0 0x561b32da9200 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44b7032183825944 server_cookie=6cc00bf8b5a55720 in_seq=0 out_seq=0 2024-09-21T01:15:33.998 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:33 smithi157 ceph-mon[34140]: pgmap v385: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 14 op/s 2024-09-21T01:15:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9552ffd640 1 -- 172.21.15.148:0/71851641 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b32c910f0 con 0x561b3290d1c0 2024-09-21T01:15:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9552ffd640 10 client.15774 handle_command_reply: tid=0 2024-09-21T01:15:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 client.15774 shutdown 2024-09-21T01:15:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 -- 172.21.15.148:0/71851641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 msgr2=0x561b32d366b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d366b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9564009610 tx=0x7f9564094040 comp rx=0 tx=0).stop 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 -- 172.21.15.148:0/71851641 shutdown_connections 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x561b3290d1c0 0x561b32da9200 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b329791b0 0x561b32d35910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9552ffd640 0 client.15774 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561b329584d0 0x561b32d35370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 --2- 172.21.15.148:0/71851641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b329502f0 0x561b32d366b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 -- 172.21.15.148:0/71851641 >> 172.21.15.148:0/71851641 conn(0x561b3296d300 msgr2=0x561b32d29800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 -- 172.21.15.148:0/71851641 shutdown_connections 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.997+0000 7f9580ffb740 1 -- 172.21.15.148:0/71851641 wait complete. 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9580ffb740 20 client.15774 trim_cache size 0 max 16384 2024-09-21T01:15:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-21T01:15:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-21T01:15:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-21T01:15:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-21T01:15:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 -- 172.21.15.148:0/557668547 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f955c0b6510 msgr2=0x7f955c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f955c0b6510 0x7f955c0b8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f956c006010 tx=0x7f956c0314c0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 -- 172.21.15.148:0/557668547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9574102c80 msgr2=0x7f9574102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9574102c80 0x7f9574102140 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f956400d770 tx=0x7f956400dc30 comp rx=0 tx=0).stop 2024-09-21T01:15:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 -- 172.21.15.148:0/557668547 shutdown_connections 2024-09-21T01:15:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f955c0b6510 0x7f955c0b8a20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9574108300 0x7f95741a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95741056e0 0x7f957419ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 --2- 172.21.15.148:0/557668547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9574102c80 0x7f9574102140 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 -- 172.21.15.148:0/557668547 >> 172.21.15.148:0/557668547 conn(0x7f95740fd690 msgr2=0x7f9574103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 -- 172.21.15.148:0/557668547 shutdown_connections 2024-09-21T01:15:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:33.998+0000 7f9579fad640 1 -- 172.21.15.148:0/557668547 wait complete. 2024-09-21T01:15:35.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:35 smithi148 ceph-mon[31000]: pgmap v386: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-21T01:15:35.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:35 smithi181 ceph-mon[34811]: pgmap v386: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-21T01:15:35.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:35 smithi157 ceph-mon[34140]: pgmap v386: 97 pgs: 97 active+clean; 1.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-21T01:15:37.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:37 smithi148 ceph-mon[31000]: pgmap v387: 97 pgs: 97 active+clean; 18 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.2 MiB/s wr, 16 op/s 2024-09-21T01:15:37.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:37 smithi148 ceph-mon[31000]: scrub summary: idle 2024-09-21T01:15:37.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:37 smithi181 ceph-mon[34811]: pgmap v387: 97 pgs: 97 active+clean; 18 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.2 MiB/s wr, 16 op/s 2024-09-21T01:15:37.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:37 smithi181 ceph-mon[34811]: scrub summary: idle 2024-09-21T01:15:37.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:37 smithi157 ceph-mon[34140]: pgmap v387: 97 pgs: 97 active+clean; 18 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.2 MiB/s wr, 16 op/s 2024-09-21T01:15:37.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:37 smithi157 ceph-mon[34140]: scrub summary: idle 2024-09-21T01:15:38.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:38 smithi148 ceph-mon[31000]: scrub summary: idle 2024-09-21T01:15:38.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:38 smithi181 ceph-mon[34811]: scrub summary: idle 2024-09-21T01:15:38.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:38 smithi157 ceph-mon[34140]: scrub summary: idle 2024-09-21T01:15:39.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:39 smithi148 ceph-mon[31000]: pgmap v388: 97 pgs: 97 active+clean; 58 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.9 MiB/s wr, 13 op/s 2024-09-21T01:15:39.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:39 smithi181 ceph-mon[34811]: pgmap v388: 97 pgs: 97 active+clean; 58 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.9 MiB/s wr, 13 op/s 2024-09-21T01:15:39.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:39 smithi157 ceph-mon[34140]: pgmap v388: 97 pgs: 97 active+clean; 58 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.9 MiB/s wr, 13 op/s 2024-09-21T01:15:41.782 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:41 smithi181 ceph-mon[34811]: pgmap v389: 97 pgs: 97 active+clean; 130 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 12 MiB/s wr, 14 op/s 2024-09-21T01:15:41.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:41 smithi157 ceph-mon[34140]: pgmap v389: 97 pgs: 97 active+clean; 130 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 12 MiB/s wr, 14 op/s 2024-09-21T01:15:41.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:41 smithi148 ceph-mon[31000]: pgmap v389: 97 pgs: 97 active+clean; 130 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 12 MiB/s wr, 14 op/s 2024-09-21T01:15:43.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:43 smithi148 ceph-mon[31000]: pgmap v390: 97 pgs: 97 active+clean; 206 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 19 MiB/s wr, 18 op/s 2024-09-21T01:15:43.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:43 smithi181 ceph-mon[34811]: pgmap v390: 97 pgs: 97 active+clean; 206 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 19 MiB/s wr, 18 op/s 2024-09-21T01:15:43.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:43 smithi157 ceph-mon[34140]: pgmap v390: 97 pgs: 97 active+clean; 206 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 19 MiB/s wr, 18 op/s 2024-09-21T01:15:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:45 smithi148 ceph-mon[31000]: pgmap v391: 97 pgs: 97 active+clean; 222 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 23 MiB/s wr, 15 op/s 2024-09-21T01:15:45.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:45 smithi181 ceph-mon[34811]: pgmap v391: 97 pgs: 97 active+clean; 222 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 23 MiB/s wr, 15 op/s 2024-09-21T01:15:45.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:45 smithi157 ceph-mon[34140]: pgmap v391: 97 pgs: 97 active+clean; 222 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 23 MiB/s wr, 15 op/s 2024-09-21T01:15:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.102+0000 7f99ba0de640 1 -- 172.21.15.148:0/3756835630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b406c070 msgr2=0x7f99b4106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.102+0000 7f99ba0de640 1 --2- 172.21.15.148:0/3756835630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b406c070 0x7f99b4106370 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009900 tx=0x7f99a402a410 comp rx=0 tx=0).stop 2024-09-21T01:15:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.102+0000 7f99ba0de640 1 -- 172.21.15.148:0/3756835630 shutdown_connections 2024-09-21T01:15:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.102+0000 7f99ba0de640 1 --2- 172.21.15.148:0/3756835630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b4109410 0x7f99b410b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.102+0000 7f99ba0de640 1 --2- 172.21.15.148:0/3756835630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99b41068b0 0x7f99b4108cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.102+0000 7f99ba0de640 1 --2- 172.21.15.148:0/3756835630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b406c070 0x7f99b4106370 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.102+0000 7f99ba0de640 1 -- 172.21.15.148:0/3756835630 >> 172.21.15.148:0/3756835630 conn(0x7f99b40fdf30 msgr2=0x7f99b41003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.102+0000 7f99ba0de640 1 -- 172.21.15.148:0/3756835630 shutdown_connections 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.102+0000 7f99ba0de640 1 -- 172.21.15.148:0/3756835630 wait complete. 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99ba0de640 1 Processor -- start 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99ba0de640 1 -- start start 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99ba0de640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b406c070 0x7f99b41039b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99ba0de640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b41068b0 0x7f99b4102270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99ba0de640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99b4109410 0x7f99b41027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99ba0de640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f99b410f340 con 0x7f99b41068b0 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99ba0de640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f99b410f1c0 con 0x7f99b4109410 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99ba0de640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f99b410f4c0 con 0x7f99b406c070 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b41068b0 0x7f99b4102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b41068b0 0x7f99b4102270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40034/0 (socket says 172.21.15.148:40034) 2024-09-21T01:15:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99abfff640 1 -- 172.21.15.148:0/2804293262 learned_addr learned my addr 172.21.15.148:0/2804293262 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99b37fe640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b406c070 0x7f99b41039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99b3fff640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99b4109410 0x7f99b41027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99abfff640 1 -- 172.21.15.148:0/2804293262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b406c070 msgr2=0x7f99b41039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99abfff640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b406c070 0x7f99b41039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99abfff640 1 -- 172.21.15.148:0/2804293262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99b4109410 msgr2=0x7f99b41027b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.103+0000 7f99abfff640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99b4109410 0x7f99b41027b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.104+0000 7f99abfff640 1 -- 172.21.15.148:0/2804293262 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b4102e50 con 0x7f99b41068b0 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.104+0000 7f99b3fff640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99b4109410 0x7f99b41027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.104+0000 7f99abfff640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b41068b0 0x7f99b4102270 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f999c00c970 tx=0x7f999c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.104+0000 7f99b17fa640 1 -- 172.21.15.148:0/2804293262 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c014070 con 0x7f99b41068b0 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.104+0000 7f99ba0de640 1 -- 172.21.15.148:0/2804293262 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b41a4040 con 0x7f99b41068b0 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.104+0000 7f99b17fa640 1 -- 172.21.15.148:0/2804293262 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c004440 con 0x7f99b41068b0 2024-09-21T01:15:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.104+0000 7f99ba0de640 1 -- 172.21.15.148:0/2804293262 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b41a44a0 con 0x7f99b41068b0 2024-09-21T01:15:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.104+0000 7f99b17fa640 1 -- 172.21.15.148:0/2804293262 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c003e50 con 0x7f99b41068b0 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.106+0000 7f99c104e740 1 Processor -- start 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99c104e740 1 -- start start 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99c104e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118cc1b0 0x55e111c73e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99c104e740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118a32f0 0x55e111c744c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99c104e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c75010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99c104e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e111be66f0 con 0x55e1118cc1b0 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99c104e740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55e111bd5b20 con 0x55e1118a32f0 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99c104e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e111bd9930 con 0x55e1118ab4d0 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99b3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118cc1b0 0x55e111c73e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99b3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118cc1b0 0x55e111c73e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40044/0 (socket says 172.21.15.148:40044) 2024-09-21T01:15:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99b3fff640 1 -- 172.21.15.148:0/3627117436 learned_addr learned my addr 172.21.15.148:0/3627117436 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99b37fe640 1 --2- 172.21.15.148:0/3627117436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118a32f0 0x55e111c744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99b17fa640 1 -- 172.21.15.148:0/2804293262 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f999c017070 con 0x7f99b41068b0 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99b3fff640 1 -- 172.21.15.148:0/3627117436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 msgr2=0x55e111c75010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99b3fff640 1 --2- 172.21.15.148:0/3627117436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c75010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99b3fff640 1 -- 172.21.15.148:0/3627117436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118a32f0 msgr2=0x55e111c744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99b3fff640 1 --2- 172.21.15.148:0/3627117436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118a32f0 0x55e111c744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.107+0000 7f99b3fff640 1 -- 172.21.15.148:0/3627117436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e111b9b530 con 0x55e1118cc1b0 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.108+0000 7f99b3fff640 1 --2- 172.21.15.148:0/3627117436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118cc1b0 0x55e111c73e50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f99ac008dd0 tx=0x7f99ac00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813b6bf8436f6dca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.108+0000 7f99a9ffb640 1 -- 172.21.15.148:0/3627117436 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00f830 con 0x55e1118cc1b0 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.108+0000 7f99a9ffb640 1 -- 172.21.15.148:0/3627117436 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99ac00de20 con 0x55e1118cc1b0 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.108+0000 7f99a9ffb640 1 -- 172.21.15.148:0/3627117436 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac018de0 con 0x55e1118cc1b0 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.108+0000 7f99b17fa640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f99a00b66b0 0x7f99a00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.108+0000 7f99b37fe640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f99a00b66b0 0x7f99a00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.108+0000 7f99b17fa640 1 -- 172.21.15.148:0/2804293262 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f999c0e7210 con 0x7f99b41068b0 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99c104e740 1 -- 172.21.15.148:0/3627117436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118cc1b0 msgr2=0x55e111c73e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99b37fe640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f99a00b66b0 0x7f99a00b8bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f99a4000c00 tx=0x7f99a4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99c104e740 1 --2- 172.21.15.148:0/3627117436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118cc1b0 0x55e111c73e50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f99ac008dd0 tx=0x7f99ac00d710 comp rx=0 tx=0).stop 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99c104e740 1 -- 172.21.15.148:0/3627117436 shutdown_connections 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99c104e740 1 --2- 172.21.15.148:0/3627117436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c75010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99c104e740 1 --2- 172.21.15.148:0/3627117436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118a32f0 0x55e111c744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99c104e740 1 --2- 172.21.15.148:0/3627117436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118cc1b0 0x55e111c73e50 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99c104e740 1 -- 172.21.15.148:0/3627117436 >> 172.21.15.148:0/3627117436 conn(0x55e1118c0300 msgr2=0x55e111c6f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99c104e740 1 -- 172.21.15.148:0/3627117436 shutdown_connections 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99c104e740 1 -- 172.21.15.148:0/3627117436 wait complete. 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.109+0000 7f99c104e740 1 -- start start 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99c104e740 1 Processor -- start 2024-09-21T01:15:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99c104e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118a32f0 0x55e111c7d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99c104e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118ab4d0 0x55e111c7dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99c104e740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118cc1b0 0x55e111c7e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99c104e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e111b0dab0 con 0x55e1118ab4d0 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99c104e740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55e111b7b730 con 0x55e1118cc1b0 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99c104e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e111c75b30 con 0x55e1118a32f0 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99c104e740 10 client.0 _ll_register_callbacks cb 0x55e111bcf6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118ab4d0 0x55e111c7dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118ab4d0 0x55e111c7dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40052/0 (socket says 172.21.15.148:40052) 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99abfff640 1 -- 172.21.15.148:0/1815872506 learned_addr learned my addr 172.21.15.148:0/1815872506 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99b37fe640 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118a32f0 0x55e111c7d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99b3fff640 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118cc1b0 0x55e111c7e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99abfff640 1 -- 172.21.15.148:0/1815872506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118a32f0 msgr2=0x55e111c7d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99abfff640 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118a32f0 0x55e111c7d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99abfff640 1 -- 172.21.15.148:0/1815872506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118cc1b0 msgr2=0x55e111c7e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99abfff640 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118cc1b0 0x55e111c7e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.110+0000 7f99abfff640 1 -- 172.21.15.148:0/1815872506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e111937790 con 0x55e1118ab4d0 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f99abfff640 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118ab4d0 0x55e111c7dd60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f999c0ad050 tx=0x7f999c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a91bee742d7a6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f9992ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f9992ffd640 1 -- 172.21.15.148:0/1815872506 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c094070 con 0x55e1118ab4d0 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f9992ffd640 1 -- 172.21.15.148:0/1815872506 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f999c094ae0 con 0x55e1118ab4d0 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f99c104e740 1 -- 172.21.15.148:0/1815872506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99ac00de20 con 0x55e1118ab4d0 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f9992ffd640 1 -- 172.21.15.148:0/1815872506 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f999c0ada50 con 0x55e1118ab4d0 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f99c104e740 10 client.15786 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f99c104e740 1 -- 172.21.15.148:0/1815872506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e1119b0620 con 0x55e1118ab4d0 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f9992ffd640 1 -- 172.21.15.148:0/1815872506 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99ac00de20 con 0x55e1118ab4d0 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f9992ffd640 1 -- 172.21.15.148:0/1815872506 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f999c0ac220 con 0x55e1118ab4d0 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f99c104e740 10 client.15786 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.111+0000 7f99c104e740 10 client.15786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.112+0000 7f99c104e740 20 client.15786 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.112+0000 7f99c104e740 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e11188ad80 0x55e111c8ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.112+0000 7f99c104e740 4 client.15786 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.112+0000 7f99c104e740 1 -- 172.21.15.148:0/1815872506 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e111be8640 con 0x55e11188ad80 2024-09-21T01:15:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.112+0000 7f99b37fe640 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e11188ad80 0x55e111c8ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.112+0000 7f9992ffd640 10 client.15786 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.112+0000 7f99b37fe640 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e11188ad80 0x55e111c8ae40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3eb71425d073f00 server_cookie=b96fe225db139c63 in_seq=0 out_seq=0 2024-09-21T01:15:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f9992ffd640 1 -- 172.21.15.148:0/1815872506 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e111be8640 con 0x55e11188ad80 2024-09-21T01:15:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f9992ffd640 10 client.15786 handle_command_reply: tid=0 2024-09-21T01:15:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f99c104e740 1 client.15786 shutdown 2024-09-21T01:15:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f99c104e740 1 -- 172.21.15.148:0/1815872506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118ab4d0 msgr2=0x55e111c7dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f99c104e740 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118ab4d0 0x55e111c7dd60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f999c0ad050 tx=0x7f999c003820 comp rx=0 tx=0).stop 2024-09-21T01:15:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f99c104e740 1 -- 172.21.15.148:0/1815872506 shutdown_connections 2024-09-21T01:15:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f99c104e740 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e11188ad80 0x55e111c8ae40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f99c104e740 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118ab4d0 0x55e111c7dd60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f9992ffd640 0 client.15786 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f99c104e740 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118cc1b0 0x55e111c7e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f99c104e740 1 --2- 172.21.15.148:0/1815872506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118a32f0 0x55e111c7d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.113+0000 7f99c104e740 1 -- 172.21.15.148:0/1815872506 >> 172.21.15.148:0/1815872506 conn(0x55e1118c0300 msgr2=0x55e111c6dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.114+0000 7f99c104e740 1 -- 172.21.15.148:0/1815872506 shutdown_connections 2024-09-21T01:15:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.114+0000 7f99c104e740 1 -- 172.21.15.148:0/1815872506 wait complete. 2024-09-21T01:15:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.114+0000 7f99c104e740 20 client.15786 trim_cache size 0 max 16384 2024-09-21T01:15:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.128+0000 7f99c104e740 1 Processor -- start 2024-09-21T01:15:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.128+0000 7f99c104e740 1 -- start start 2024-09-21T01:15:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99c104e740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e11188ad80 0x55e111c6f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99c104e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118a32f0 0x55e111c857b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99c104e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c73df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99c104e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41afa30 con 0x55e1118a32f0 2024-09-21T01:15:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99c104e740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41ad300 con 0x55e11188ad80 2024-09-21T01:15:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99c104e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41ab150 con 0x55e1118ab4d0 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118a32f0 0x55e111c857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118a32f0 0x55e111c857b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40054/0 (socket says 172.21.15.148:40054) 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99abfff640 1 -- 172.21.15.148:0/3270239893 learned_addr learned my addr 172.21.15.148:0/3270239893 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99b37fe640 1 --2- 172.21.15.148:0/3270239893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e11188ad80 0x55e111c6f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99b3fff640 1 --2- 172.21.15.148:0/3270239893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c73df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99abfff640 1 -- 172.21.15.148:0/3270239893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 msgr2=0x55e111c73df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99abfff640 1 --2- 172.21.15.148:0/3270239893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c73df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99abfff640 1 -- 172.21.15.148:0/3270239893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e11188ad80 msgr2=0x55e111c6f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99abfff640 1 --2- 172.21.15.148:0/3270239893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e11188ad80 0x55e111c6f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99abfff640 1 -- 172.21.15.148:0/3270239893 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e111c7d000 con 0x55e1118a32f0 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99b37fe640 1 --2- 172.21.15.148:0/3270239893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e11188ad80 0x55e111c6f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.129+0000 7f99abfff640 1 --2- 172.21.15.148:0/3270239893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118a32f0 0x55e111c857b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f999c096e80 tx=0x7f999c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1fb69ab99d81fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.130+0000 7f99a97fa640 1 -- 172.21.15.148:0/3270239893 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c094070 con 0x55e1118a32f0 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.130+0000 7f99a97fa640 1 -- 172.21.15.148:0/3270239893 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c0e6040 con 0x55e1118a32f0 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.130+0000 7f99a97fa640 1 -- 172.21.15.148:0/3270239893 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c094ae0 con 0x55e1118a32f0 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.130+0000 7f99c104e740 1 -- 172.21.15.148:0/3270239893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118a32f0 msgr2=0x55e111c857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.130+0000 7f99c104e740 1 --2- 172.21.15.148:0/3270239893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118a32f0 0x55e111c857b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f999c096e80 tx=0x7f999c000bc0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 -- 172.21.15.148:0/3270239893 shutdown_connections 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 --2- 172.21.15.148:0/3270239893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1118a32f0 0x55e111c857b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 --2- 172.21.15.148:0/3270239893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c73df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 --2- 172.21.15.148:0/3270239893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e11188ad80 0x55e111c6f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 -- 172.21.15.148:0/3270239893 >> 172.21.15.148:0/3270239893 conn(0x55e1118c0300 msgr2=0x55e111c6dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 -- 172.21.15.148:0/3270239893 shutdown_connections 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 -- 172.21.15.148:0/3270239893 wait complete. 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 -- start start 2024-09-21T01:15:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 Processor -- start 2024-09-21T01:15:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e11188ad80 0x55e111c85030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118a32f0 0x55e111c856f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c83db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41ab7c0 con 0x55e11188ad80 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41acc30 con 0x55e1118a32f0 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.131+0000 7f99c104e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f99b41abe90 con 0x55e1118ab4d0 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99c104e740 10 client.0 _ll_register_callbacks cb 0x7f999c00c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e11188ad80 0x55e111c85030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b37fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e11188ad80 0x55e111c85030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40058/0 (socket says 172.21.15.148:40058) 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b37fe640 1 -- 172.21.15.148:0/3160417448 learned_addr learned my addr 172.21.15.148:0/3160417448 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99abfff640 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118a32f0 0x55e111c856f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b3fff640 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c83db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b37fe640 1 -- 172.21.15.148:0/3160417448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 msgr2=0x55e111c83db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b37fe640 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c83db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b37fe640 1 -- 172.21.15.148:0/3160417448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118a32f0 msgr2=0x55e111c856f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b37fe640 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118a32f0 0x55e111c856f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b37fe640 1 -- 172.21.15.148:0/3160417448 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e111c84540 con 0x55e11188ad80 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b3fff640 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c83db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99b37fe640 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e11188ad80 0x55e111c85030 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f99a4031500 tx=0x7f99a4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871c7b7021685482 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f9992ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f9992ffd640 1 -- 172.21.15.148:0/3160417448 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4035040 con 0x55e11188ad80 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f9992ffd640 1 -- 172.21.15.148:0/3160417448 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f99a40035f0 con 0x55e11188ad80 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f99c104e740 1 -- 172.21.15.148:0/3160417448 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f999c0e6040 con 0x55e11188ad80 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.132+0000 7f9992ffd640 1 -- 172.21.15.148:0/3160417448 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f99a40037f0 con 0x55e11188ad80 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f99c104e740 10 client.15792 fetch_fsmap learned FSMap version 25 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f99c104e740 1 -- 172.21.15.148:0/3160417448 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e111c83420 con 0x55e11188ad80 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f9992ffd640 1 -- 172.21.15.148:0/3160417448 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c0e6040 con 0x55e11188ad80 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f9992ffd640 1 -- 172.21.15.148:0/3160417448 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f99a4050070 con 0x55e11188ad80 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f99c104e740 10 client.15792 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:15:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f99c104e740 10 client.15792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:15:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f99c104e740 20 client.15792 populate_metadata read hostname 'smithi148' 2024-09-21T01:15:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f99c104e740 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e1118cc1b0 0x55e111cf7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f99c104e740 4 client.15792 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:15:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f99c104e740 1 -- 172.21.15.148:0/3160417448 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e111be40f0 con 0x55e1118cc1b0 2024-09-21T01:15:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.133+0000 7f99abfff640 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e1118cc1b0 0x55e111cf7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.134+0000 7f9992ffd640 10 client.15792 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.134+0000 7f99abfff640 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e1118cc1b0 0x55e111cf7da0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97e7399cbb5465be server_cookie=d3eeef9207ac6015 in_seq=0 out_seq=0 2024-09-21T01:15:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f9992ffd640 1 -- 172.21.15.148:0/3160417448 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e111be40f0 con 0x55e1118cc1b0 2024-09-21T01:15:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f9992ffd640 10 client.15792 handle_command_reply: tid=0 2024-09-21T01:15:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 client.15792 shutdown 2024-09-21T01:15:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 -- 172.21.15.148:0/3160417448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e11188ad80 msgr2=0x55e111c85030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e11188ad80 0x55e111c85030 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f99a4031500 tx=0x7f99a4009260 comp rx=0 tx=0).stop 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 -- 172.21.15.148:0/3160417448 shutdown_connections 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e1118cc1b0 0x55e111cf7da0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e1118ab4d0 0x55e111c83db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f9992ffd640 0 client.15792 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e1118a32f0 0x55e111c856f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 --2- 172.21.15.148:0/3160417448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e11188ad80 0x55e111c85030 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 -- 172.21.15.148:0/3160417448 >> 172.21.15.148:0/3160417448 conn(0x55e1118c0300 msgr2=0x55e111c6fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 -- 172.21.15.148:0/3160417448 shutdown_connections 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 1 -- 172.21.15.148:0/3160417448 wait complete. 2024-09-21T01:15:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.141+0000 7f99c104e740 20 client.15792 trim_cache size 0 max 16384 2024-09-21T01:15:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-21T01:15:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-21T01:15:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-21T01:15:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 -- 172.21.15.148:0/2804293262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f99a00b66b0 msgr2=0x7f99a00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f99a00b66b0 0x7f99a00b8bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f99a4000c00 tx=0x7f99a4031400 comp rx=0 tx=0).stop 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 -- 172.21.15.148:0/2804293262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b41068b0 msgr2=0x7f99b4102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b41068b0 0x7f99b4102270 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f999c00c970 tx=0x7f999c00ce30 comp rx=0 tx=0).stop 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 -- 172.21.15.148:0/2804293262 shutdown_connections 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f99a00b66b0 0x7f99a00b8bc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99b41068b0 0x7f99b4102270 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99b4109410 0x7f99b41027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 --2- 172.21.15.148:0/2804293262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99b406c070 0x7f99b41039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 -- 172.21.15.148:0/2804293262 >> 172.21.15.148:0/2804293262 conn(0x7f99b40fdf30 msgr2=0x7f99b4104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 -- 172.21.15.148:0/2804293262 shutdown_connections 2024-09-21T01:15:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:15:47.142+0000 7f99ba0de640 1 -- 172.21.15.148:0/2804293262 wait complete. 2024-09-21T01:15:47.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:47 smithi148 ceph-mon[31000]: pgmap v392: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 31 MiB/s wr, 20 op/s 2024-09-21T01:15:47.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:47 smithi181 ceph-mon[34811]: pgmap v392: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 31 MiB/s wr, 20 op/s 2024-09-21T01:15:47.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:47 smithi157 ceph-mon[34140]: pgmap v392: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 31 MiB/s wr, 20 op/s 2024-09-21T01:15:49.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:49 smithi148 ceph-mon[31000]: pgmap v393: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 30 MiB/s wr, 15 op/s 2024-09-21T01:15:49.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:49 smithi181 ceph-mon[34811]: pgmap v393: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 30 MiB/s wr, 15 op/s 2024-09-21T01:15:49.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:49 smithi157 ceph-mon[34140]: pgmap v393: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 30 MiB/s wr, 15 op/s 2024-09-21T01:15:51.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:51 smithi148 ceph-mon[31000]: pgmap v394: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 26 MiB/s wr, 14 op/s 2024-09-21T01:15:51.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:51 smithi181 ceph-mon[34811]: pgmap v394: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 26 MiB/s wr, 14 op/s 2024-09-21T01:15:51.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:51 smithi157 ceph-mon[34140]: pgmap v394: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 26 MiB/s wr, 14 op/s 2024-09-21T01:15:53.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:53 smithi148 ceph-mon[31000]: pgmap v395: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 20 MiB/s wr, 17 op/s 2024-09-21T01:15:53.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:53 smithi181 ceph-mon[34811]: pgmap v395: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 20 MiB/s wr, 17 op/s 2024-09-21T01:15:53.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:53 smithi157 ceph-mon[34140]: pgmap v395: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 20 MiB/s wr, 17 op/s 2024-09-21T01:15:55.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:55 smithi148 ceph-mon[31000]: pgmap v396: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 MiB/s wr, 12 op/s 2024-09-21T01:15:55.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:55 smithi181 ceph-mon[34811]: pgmap v396: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 MiB/s wr, 12 op/s 2024-09-21T01:15:55.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:55 smithi157 ceph-mon[34140]: pgmap v396: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 MiB/s wr, 12 op/s 2024-09-21T01:15:57.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:57 smithi148 ceph-mon[31000]: pgmap v397: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.4 MiB/s wr, 14 op/s 2024-09-21T01:15:57.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:57 smithi181 ceph-mon[34811]: pgmap v397: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.4 MiB/s wr, 14 op/s 2024-09-21T01:15:57.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:57 smithi157 ceph-mon[34140]: pgmap v397: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.4 MiB/s wr, 14 op/s 2024-09-21T01:15:59.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:15:59 smithi148 ceph-mon[31000]: pgmap v398: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-09-21T01:15:59.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:15:59 smithi181 ceph-mon[34811]: pgmap v398: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-09-21T01:15:59.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:15:59 smithi157 ceph-mon[34140]: pgmap v398: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-09-21T01:16:00.170 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:16:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.249+0000 7fc176141640 1 -- 172.21.15.148:0/2777872407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc170106820 msgr2=0x7fc170108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.249+0000 7fc176141640 1 --2- 172.21.15.148:0/2777872407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc170106820 0x7fc170108ca0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc164009900 tx=0x7fc16402a410 comp rx=0 tx=0).stop 2024-09-21T01:16:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.249+0000 7fc176141640 1 -- 172.21.15.148:0/2777872407 shutdown_connections 2024-09-21T01:16:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.249+0000 7fc176141640 1 --2- 172.21.15.148:0/2777872407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc170106820 0x7fc170108ca0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.249+0000 7fc176141640 1 --2- 172.21.15.148:0/2777872407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1701093e0 0x7fc17010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.249+0000 7fc176141640 1 --2- 172.21.15.148:0/2777872407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc17006b710 0x7fc1701062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.249+0000 7fc176141640 1 -- 172.21.15.148:0/2777872407 >> 172.21.15.148:0/2777872407 conn(0x7fc1700fdee0 msgr2=0x7fc170100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.249+0000 7fc176141640 1 -- 172.21.15.148:0/2777872407 shutdown_connections 2024-09-21T01:16:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.249+0000 7fc176141640 1 -- 172.21.15.148:0/2777872407 wait complete. 2024-09-21T01:16:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.250+0000 7fc176141640 1 Processor -- start 2024-09-21T01:16:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.250+0000 7fc176141640 1 -- start start 2024-09-21T01:16:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc176141640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc17006b710 0x7fc170199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc176141640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc170106820 0x7fc17019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc176141640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1701093e0 0x7fc17019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc176141640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc17010f2d0 con 0x7fc17006b710 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc176141640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc17010f150 con 0x7fc1701093e0 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc176141640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc17010f450 con 0x7fc170106820 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc17006b710 0x7fc170199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc17006b710 0x7fc170199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36150/0 (socket says 172.21.15.148:36150) 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16f7fe640 1 -- 172.21.15.148:0/926665617 learned_addr learned my addr 172.21.15.148:0/926665617 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16ffff640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1701093e0 0x7fc17019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16effd640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc170106820 0x7fc17019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16f7fe640 1 -- 172.21.15.148:0/926665617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc170106820 msgr2=0x7fc17019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16f7fe640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc170106820 0x7fc17019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16f7fe640 1 -- 172.21.15.148:0/926665617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1701093e0 msgr2=0x7fc17019b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16f7fe640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1701093e0 0x7fc17019b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16f7fe640 1 -- 172.21.15.148:0/926665617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17019b8d0 con 0x7fc17006b710 2024-09-21T01:16:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.251+0000 7fc16ffff640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1701093e0 0x7fc17019b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.252+0000 7fc16f7fe640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc17006b710 0x7fc170199f20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c920 tx=0x7fc16000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.252+0000 7fc16cff9640 1 -- 172.21.15.148:0/926665617 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160007c70 con 0x7fc17006b710 2024-09-21T01:16:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.252+0000 7fc176141640 1 -- 172.21.15.148:0/926665617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17019bbc0 con 0x7fc17006b710 2024-09-21T01:16:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.252+0000 7fc16cff9640 1 -- 172.21.15.148:0/926665617 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc160007e10 con 0x7fc17006b710 2024-09-21T01:16:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.252+0000 7fc16cff9640 1 -- 172.21.15.148:0/926665617 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160018820 con 0x7fc17006b710 2024-09-21T01:16:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.252+0000 7fc176141640 1 -- 172.21.15.148:0/926665617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1701a2340 con 0x7fc17006b710 2024-09-21T01:16:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc17d0ae740 1 Processor -- start 2024-09-21T01:16:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc17d0ae740 1 -- start start 2024-09-21T01:16:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe811b0 0x5568cc228e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe582f0 0x5568cc2294c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe604d0 0x5568cc22a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5568cc19b6f0 con 0x5568cbe811b0 2024-09-21T01:16:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5568cc18ab20 con 0x5568cbe582f0 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5568cc18e930 con 0x5568cbe604d0 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc16ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe811b0 0x5568cc228e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc16ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe811b0 0x5568cc228e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36166/0 (socket says 172.21.15.148:36166) 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.255+0000 7fc16ffff640 1 -- 172.21.15.148:0/1311650216 learned_addr learned my addr 172.21.15.148:0/1311650216 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc16effd640 1 --2- 172.21.15.148:0/1311650216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe604d0 0x5568cc22a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc16ffff640 1 -- 172.21.15.148:0/1311650216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe604d0 msgr2=0x5568cc22a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc16ffff640 1 --2- 172.21.15.148:0/1311650216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe604d0 0x5568cc22a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc16ffff640 1 -- 172.21.15.148:0/1311650216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe582f0 msgr2=0x5568cc2294c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc16ffff640 1 --2- 172.21.15.148:0/1311650216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe582f0 0x5568cc2294c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc16ffff640 1 -- 172.21.15.148:0/1311650216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568cc150530 con 0x5568cbe811b0 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc16ffff640 1 --2- 172.21.15.148:0/1311650216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe811b0 0x5568cc228e50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc16800f760 tx=0x7fc16800fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4357150507166c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc155ffb640 1 -- 172.21.15.148:0/1311650216 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168004d70 con 0x5568cbe811b0 2024-09-21T01:16:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc16cff9640 1 -- 172.21.15.148:0/926665617 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7fc16000f450 con 0x7fc17006b710 2024-09-21T01:16:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc155ffb640 1 -- 172.21.15.148:0/1311650216 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc16800ddd0 con 0x5568cbe811b0 2024-09-21T01:16:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.256+0000 7fc155ffb640 1 -- 172.21.15.148:0/1311650216 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168005990 con 0x5568cbe811b0 2024-09-21T01:16:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.257+0000 7fc16cff9640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc1580b6510 0x7fc1580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.257+0000 7fc16f7fe640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc1580b6510 0x7fc1580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.257+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1311650216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe811b0 msgr2=0x5568cc228e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.257+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/1311650216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe811b0 0x5568cc228e50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc16800f760 tx=0x7fc16800fc20 comp rx=0 tx=0).stop 2024-09-21T01:16:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.257+0000 7fc16cff9640 1 -- 172.21.15.148:0/926665617 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fc1600e73d0 con 0x7fc17006b710 2024-09-21T01:16:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.257+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1311650216 shutdown_connections 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.257+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/1311650216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe604d0 0x5568cc22a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.257+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/1311650216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe582f0 0x5568cc2294c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.257+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/1311650216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe811b0 0x5568cc228e50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.257+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1311650216 >> 172.21.15.148:0/1311650216 conn(0x5568cbe75300 msgr2=0x5568cc2248e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.258+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1311650216 shutdown_connections 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.258+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1311650216 wait complete. 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.258+0000 7fc16f7fe640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc1580b6510 0x7fc1580b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc1600aa7e0 tx=0x7fc16001bd10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.258+0000 7fc17d0ae740 1 -- start start 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.258+0000 7fc17d0ae740 1 Processor -- start 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe582f0 0x5568cc2325d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe604d0 0x5568cc232c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe811b0 0x5568cc233800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5568cc0c2ab0 con 0x5568cbe582f0 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5568cc130730 con 0x5568cbe811b0 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5568cc22ab30 con 0x5568cbe604d0 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc17d0ae740 10 client.0 _ll_register_callbacks cb 0x5568cc1846b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc16ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe582f0 0x5568cc2325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc16ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe582f0 0x5568cc2325d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36168/0 (socket says 172.21.15.148:36168) 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc16ffff640 1 -- 172.21.15.148:0/1050957917 learned_addr learned my addr 172.21.15.148:0/1050957917 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc16effd640 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe604d0 0x5568cc232c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc16ffff640 1 -- 172.21.15.148:0/1050957917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe604d0 msgr2=0x5568cc232c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc16ffff640 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe604d0 0x5568cc232c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc16ffff640 1 -- 172.21.15.148:0/1050957917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe811b0 msgr2=0x5568cc233800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc16ffff640 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe811b0 0x5568cc233800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.259+0000 7fc16ffff640 1 -- 172.21.15.148:0/1050957917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568cbeec790 con 0x5568cbe582f0 2024-09-21T01:16:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.260+0000 7fc16ffff640 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe582f0 0x5568cc2325d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc1680059a0 tx=0x7fc1680059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82e8d912fe97cbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.260+0000 7fc14effd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.260+0000 7fc14effd640 1 -- 172.21.15.148:0/1050957917 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16801d040 con 0x5568cbe582f0 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.260+0000 7fc14effd640 1 -- 172.21.15.148:0/1050957917 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fc168003c80 con 0x5568cbe582f0 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.260+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1050957917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc16800ddd0 con 0x5568cbe582f0 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.260+0000 7fc14effd640 1 -- 172.21.15.148:0/1050957917 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc168004a90 con 0x5568cbe582f0 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.260+0000 7fc17d0ae740 10 client.15804 fetch_fsmap learned FSMap version 25 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.260+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1050957917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5568cbf65620 con 0x5568cbe582f0 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.260+0000 7fc14effd640 1 -- 172.21.15.148:0/1050957917 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc16800ddd0 con 0x5568cbe582f0 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.260+0000 7fc14effd640 1 -- 172.21.15.148:0/1050957917 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7fc168004460 con 0x5568cbe582f0 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.261+0000 7fc17d0ae740 10 client.15804 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.261+0000 7fc17d0ae740 10 client.15804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.261+0000 7fc17d0ae740 20 client.15804 populate_metadata read hostname 'smithi148' 2024-09-21T01:16:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.261+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5568cbe3fd80 0x5568cc23fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.261+0000 7fc17d0ae740 4 client.15804 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:00.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.261+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1050957917 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568cc19d640 con 0x5568cbe3fd80 2024-09-21T01:16:00.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.261+0000 7fc16effd640 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5568cbe3fd80 0x5568cc23fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.261+0000 7fc14effd640 10 client.15804 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:00.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.261+0000 7fc16effd640 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5568cbe3fd80 0x5568cc23fa40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5d574f02ab65c7 server_cookie=9c6b5076213451bf in_seq=0 out_seq=0 2024-09-21T01:16:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.262+0000 7fc14effd640 1 -- 172.21.15.148:0/1050957917 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568cc19d640 con 0x5568cbe3fd80 2024-09-21T01:16:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.262+0000 7fc14effd640 10 client.15804 handle_command_reply: tid=0 2024-09-21T01:16:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.262+0000 7fc17d0ae740 1 client.15804 shutdown 2024-09-21T01:16:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1050957917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe582f0 msgr2=0x5568cc2325d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe582f0 0x5568cc2325d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc1680059a0 tx=0x7fc1680059d0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1050957917 shutdown_connections 2024-09-21T01:16:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5568cbe3fd80 0x5568cc23fa40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe811b0 0x5568cc233800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc14effd640 0 client.15804 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe604d0 0x5568cc232c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/1050957917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe582f0 0x5568cc2325d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1050957917 >> 172.21.15.148:0/1050957917 conn(0x5568cbe75300 msgr2=0x5568cc222ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1050957917 shutdown_connections 2024-09-21T01:16:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 1 -- 172.21.15.148:0/1050957917 wait complete. 2024-09-21T01:16:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.263+0000 7fc17d0ae740 20 client.15804 trim_cache size 0 max 16384 2024-09-21T01:16:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc17d0ae740 1 Processor -- start 2024-09-21T01:16:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc17d0ae740 1 -- start start 2024-09-21T01:16:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc2317d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc222ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 0x5568cc2233e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc1701ad660 con 0x5568cbe604d0 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc1701aaf30 con 0x5568cbe3fd80 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc1701a8d80 con 0x5568cbe582f0 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc16ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 0x5568cc2233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc16ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 0x5568cc2233e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36184/0 (socket says 172.21.15.148:36184) 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc16ffff640 1 -- 172.21.15.148:0/2098081535 learned_addr learned my addr 172.21.15.148:0/2098081535 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc16effd640 1 --2- 172.21.15.148:0/2098081535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc222ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.291+0000 7fc16ffff640 1 --2- 172.21.15.148:0/2098081535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc2317d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.292+0000 7fc16effd640 1 -- 172.21.15.148:0/2098081535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 msgr2=0x5568cc2317d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.292+0000 7fc16effd640 1 --2- 172.21.15.148:0/2098081535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc2317d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.292+0000 7fc16effd640 1 -- 172.21.15.148:0/2098081535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 msgr2=0x5568cc2233e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.292+0000 7fc16effd640 1 --2- 172.21.15.148:0/2098081535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 0x5568cc2233e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.292+0000 7fc16effd640 1 -- 172.21.15.148:0/2098081535 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568cc22aa10 con 0x5568cbe582f0 2024-09-21T01:16:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.292+0000 7fc16ffff640 1 --2- 172.21.15.148:0/2098081535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc2317d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.292+0000 7fc16effd640 1 --2- 172.21.15.148:0/2098081535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc222ea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc164006010 tx=0x7fc164009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a88717efd8735c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.292+0000 7fc1557fa640 1 -- 172.21.15.148:0/2098081535 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164035040 con 0x5568cbe582f0 2024-09-21T01:16:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.292+0000 7fc1557fa640 1 -- 172.21.15.148:0/2098081535 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1640035f0 con 0x5568cbe582f0 2024-09-21T01:16:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.292+0000 7fc1557fa640 1 -- 172.21.15.148:0/2098081535 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164045640 con 0x5568cbe582f0 2024-09-21T01:16:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.293+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2098081535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 msgr2=0x5568cc222ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.293+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/2098081535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc222ea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc164006010 tx=0x7fc164009260 comp rx=0 tx=0).stop 2024-09-21T01:16:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.293+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2098081535 shutdown_connections 2024-09-21T01:16:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.293+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/2098081535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 0x5568cc2233e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.293+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/2098081535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc222ea0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.293+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/2098081535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc2317d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.293+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2098081535 >> 172.21.15.148:0/2098081535 conn(0x5568cbe75300 msgr2=0x5568cc229e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.293+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2098081535 shutdown_connections 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.293+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2098081535 wait complete. 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.294+0000 7fc17d0ae740 1 -- start start 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.294+0000 7fc17d0ae740 1 Processor -- start 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc23a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc239450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc17d0ae740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 0x5568cc239b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc1701a93f0 con 0x5568cbe604d0 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc1701aa860 con 0x5568cbe3fd80 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc17d0ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc1701a9ac0 con 0x5568cbe582f0 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc17d0ae740 10 client.0 _ll_register_callbacks cb 0x7fc16800f5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc239450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc23a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc239450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.148:35174/0 (socket says 172.21.15.148:35174) 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc23a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:43908/0 (socket says 172.21.15.148:43908) 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16effd640 1 -- 172.21.15.148:0/2004603708 learned_addr learned my addr 172.21.15.148:0/2004603708 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16ffff640 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 0x5568cc239b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16ffff640 1 -- 172.21.15.148:0/2004603708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 msgr2=0x5568cc239450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16ffff640 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc239450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16ffff640 1 -- 172.21.15.148:0/2004603708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 msgr2=0x5568cc239b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16ffff640 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 0x5568cc239b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16ffff640 1 -- 172.21.15.148:0/2004603708 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568cc237f70 con 0x5568cbe3fd80 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16effd640 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc239450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc16ffff640 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc23a6a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc168006010 tx=0x7fc16800dc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd7af1542f0bd612 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.295+0000 7fc14effd640 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc14effd640 1 -- 172.21.15.148:0/2004603708 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168004c30 con 0x5568cbe3fd80 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc14effd640 1 -- 172.21.15.148:0/2004603708 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fc168004dd0 con 0x5568cbe3fd80 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2004603708 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1640035f0 con 0x5568cbe3fd80 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc14effd640 1 -- 172.21.15.148:0/2004603708 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc168004fd0 con 0x5568cbe3fd80 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc17d0ae740 10 client.25412 fetch_fsmap learned FSMap version 25 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2004603708 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5568cc2aa600 con 0x5568cbe3fd80 2024-09-21T01:16:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc14effd640 1 -- 172.21.15.148:0/2004603708 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1640035f0 con 0x5568cbe3fd80 2024-09-21T01:16:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc14effd640 1 -- 172.21.15.148:0/2004603708 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7fc168037070 con 0x5568cbe3fd80 2024-09-21T01:16:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc17d0ae740 10 client.25412 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:16:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc17d0ae740 10 client.25412 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc17d0ae740 20 client.25412 populate_metadata read hostname 'smithi148' 2024-09-21T01:16:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5568cbe811b0 0x5568cc2ace50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc17d0ae740 4 client.25412 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:16:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.296+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2004603708 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568cc1990f0 con 0x5568cbe811b0 2024-09-21T01:16:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.297+0000 7fc16effd640 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5568cbe811b0 0x5568cc2ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.297+0000 7fc14effd640 10 client.25412 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.297+0000 7fc16effd640 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5568cbe811b0 0x5568cc2ace50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a902e665d6bf4464 server_cookie=2e70206b4d011482 in_seq=0 out_seq=0 2024-09-21T01:16:00.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc14effd640 1 -- 172.21.15.148:0/2004603708 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568cc1990f0 con 0x5568cbe811b0 2024-09-21T01:16:00.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc14effd640 10 client.25412 handle_command_reply: tid=0 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 client.25412 shutdown 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2004603708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 msgr2=0x5568cc23a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc23a6a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc168006010 tx=0x7fc16800dc50 comp rx=0 tx=0).stop 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2004603708 shutdown_connections 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x5568cbe811b0 0x5568cc2ace50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568cbe604d0 0x5568cc239b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc14effd640 0 client.25412 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5568cbe582f0 0x5568cc239450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 --2- 172.21.15.148:0/2004603708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5568cbe3fd80 0x5568cc23a6a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2004603708 >> 172.21.15.148:0/2004603708 conn(0x5568cbe75300 msgr2=0x5568cc2317d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2004603708 shutdown_connections 2024-09-21T01:16:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.305+0000 7fc17d0ae740 1 -- 172.21.15.148:0/2004603708 wait complete. 2024-09-21T01:16:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc17d0ae740 20 client.25412 trim_cache size 0 max 16384 2024-09-21T01:16:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-21T01:16:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-21T01:16:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-21T01:16:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-21T01:16:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 -- 172.21.15.148:0/926665617 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc1580b6510 msgr2=0x7fc1580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc1580b6510 0x7fc1580b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc1600aa7e0 tx=0x7fc16001bd10 comp rx=0 tx=0).stop 2024-09-21T01:16:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 -- 172.21.15.148:0/926665617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc17006b710 msgr2=0x7fc170199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc17006b710 0x7fc170199f20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c920 tx=0x7fc16000cde0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 -- 172.21.15.148:0/926665617 shutdown_connections 2024-09-21T01:16:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc1580b6510 0x7fc1580b8a20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1701093e0 0x7fc17019b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc170106820 0x7fc17019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 --2- 172.21.15.148:0/926665617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc17006b710 0x7fc170199f20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 -- 172.21.15.148:0/926665617 >> 172.21.15.148:0/926665617 conn(0x7fc1700fdee0 msgr2=0x7fc170104c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 -- 172.21.15.148:0/926665617 shutdown_connections 2024-09-21T01:16:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-21T01:16:00.306+0000 7fc176141640 1 -- 172.21.15.148:0/926665617 wait complete. 2024-09-21T01:16:00.452 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.952+0000 7f59010eb640 1 -- 172.21.15.148:0/1251980493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58fc102650 msgr2=0x7f58fc102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.952+0000 7f59010eb640 1 --2- 172.21.15.148:0/1251980493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58fc102650 0x7f58fc102a60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009900 tx=0x7f58ec02a480 comp rx=0 tx=0).stop 2024-09-21T01:16:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.952+0000 7f59010eb640 1 -- 172.21.15.148:0/1251980493 shutdown_connections 2024-09-21T01:16:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.952+0000 7f59010eb640 1 --2- 172.21.15.148:0/1251980493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58fc110200 0x7f58fc112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.952+0000 7f59010eb640 1 --2- 172.21.15.148:0/1251980493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58fc102fa0 0x7f58fc10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.952+0000 7f59010eb640 1 --2- 172.21.15.148:0/1251980493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58fc102650 0x7f58fc102a60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.952+0000 7f59010eb640 1 -- 172.21.15.148:0/1251980493 >> 172.21.15.148:0/1251980493 conn(0x7f58fc079790 msgr2=0x7f58fc079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.952+0000 7f59010eb640 1 -- 172.21.15.148:0/1251980493 shutdown_connections 2024-09-21T01:16:00.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.952+0000 7f59010eb640 1 -- 172.21.15.148:0/1251980493 wait complete. 2024-09-21T01:16:00.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.953+0000 7f59010eb640 1 Processor -- start 2024-09-21T01:16:00.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.953+0000 7f59010eb640 1 -- start start 2024-09-21T01:16:00.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.953+0000 7f59010eb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58fc102650 0x7f58fc19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.953+0000 7f59010eb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58fc102fa0 0x7f58fc19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.953+0000 7f59010eb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58fc110200 0x7f58fc1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.953+0000 7f59010eb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc115ca0 con 0x7f58fc102650 2024-09-21T01:16:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.953+0000 7f59010eb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc115b20 con 0x7f58fc102fa0 2024-09-21T01:16:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.953+0000 7f59010eb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc115e20 con 0x7f58fc110200 2024-09-21T01:16:00.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58fc102650 0x7f58fc19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58fc102650 0x7f58fc19c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36222/0 (socket says 172.21.15.148:36222) 2024-09-21T01:16:00.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fad9d640 1 -- 172.21.15.148:0/2757263562 learned_addr learned my addr 172.21.15.148:0/2757263562 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:00.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fa59c640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58fc102fa0 0x7f58fc19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fb59e640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58fc110200 0x7f58fc1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fad9d640 1 -- 172.21.15.148:0/2757263562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58fc110200 msgr2=0x7f58fc1a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fad9d640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58fc110200 0x7f58fc1a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fad9d640 1 -- 172.21.15.148:0/2757263562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58fc102fa0 msgr2=0x7f58fc19cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fad9d640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58fc102fa0 0x7f58fc19cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fad9d640 1 -- 172.21.15.148:0/2757263562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc1a25a0 con 0x7f58fc102650 2024-09-21T01:16:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58fad9d640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58fc102650 0x7f58fc19c630 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f58ec005940 tx=0x7f58ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58e3fff640 1 -- 172.21.15.148:0/2757263562 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec03f030 con 0x7f58fc102650 2024-09-21T01:16:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f59010eb640 1 -- 172.21.15.148:0/2757263562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58fc1a2830 con 0x7f58fc102650 2024-09-21T01:16:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.954+0000 7f58e3fff640 1 -- 172.21.15.148:0/2757263562 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58ec003cb0 con 0x7f58fc102650 2024-09-21T01:16:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.955+0000 7f58e3fff640 1 -- 172.21.15.148:0/2757263562 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec035070 con 0x7f58fc102650 2024-09-21T01:16:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.955+0000 7f59010eb640 1 -- 172.21.15.148:0/2757263562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58fc1a8ff0 con 0x7f58fc102650 2024-09-21T01:16:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.957+0000 7f58e3fff640 1 -- 172.21.15.148:0/2757263562 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f58ec042030 con 0x7f58fc102650 2024-09-21T01:16:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.957+0000 7f590765f740 1 Processor -- start 2024-09-21T01:16:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.957+0000 7f590765f740 1 -- start start 2024-09-21T01:16:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f590765f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 0x55e18463a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f590765f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18463a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f590765f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184272390 0x55e18463acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f590765f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e1845b0e50 con 0x55e18426a1b0 2024-09-21T01:16:00.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f590765f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55e1845a0280 con 0x55e184272390 2024-09-21T01:16:00.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f590765f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e1845a4090 con 0x55e184293070 2024-09-21T01:16:00.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18463a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18463a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36232/0 (socket says 172.21.15.148:36232) 2024-09-21T01:16:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fad9d640 1 -- 172.21.15.148:0/2315810088 learned_addr learned my addr 172.21.15.148:0/2315810088 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58e3fff640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f58e40b6510 0x7f58e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fb59e640 1 --2- 172.21.15.148:0/2315810088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 0x55e18463a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fa59c640 1 --2- 172.21.15.148:0/2315810088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184272390 0x55e18463acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fb59e640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f58e40b6510 0x7f58e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58e3fff640 1 -- 172.21.15.148:0/2757263562 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f58ec107be0 con 0x7f58fc102650 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fad9d640 1 -- 172.21.15.148:0/2315810088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 msgr2=0x55e18463a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fad9d640 1 --2- 172.21.15.148:0/2315810088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 0x55e18463a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fad9d640 1 -- 172.21.15.148:0/2315810088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184272390 msgr2=0x55e18463acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fad9d640 1 --2- 172.21.15.148:0/2315810088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184272390 0x55e18463acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fad9d640 1 -- 172.21.15.148:0/2315810088 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1842fe650 con 0x55e18426a1b0 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.958+0000 7f58fb59e640 1 --2- 172.21.15.148:0/2315810088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 0x55e18463a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.959+0000 7f58fad9d640 1 --2- 172.21.15.148:0/2315810088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18463a7b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0caff0 tx=0x7f58ec02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de6636c897bf205 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.959+0000 7f58e17fa640 1 -- 172.21.15.148:0/2315810088 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec049070 con 0x55e18426a1b0 2024-09-21T01:16:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.959+0000 7f58fb59e640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f58e40b6510 0x7f58e40b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f58f4005fd0 tx=0x7f58f4004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.959+0000 7f58e17fa640 1 -- 172.21.15.148:0/2315810088 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58ec0cd890 con 0x55e18426a1b0 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.959+0000 7f58e17fa640 1 -- 172.21.15.148:0/2315810088 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec0d2880 con 0x55e18426a1b0 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.960+0000 7f590765f740 1 -- 172.21.15.148:0/2315810088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 msgr2=0x55e18463a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.960+0000 7f590765f740 1 --2- 172.21.15.148:0/2315810088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18463a7b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0caff0 tx=0x7f58ec02a480 comp rx=0 tx=0).stop 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.960+0000 7f590765f740 1 -- 172.21.15.148:0/2315810088 shutdown_connections 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.960+0000 7f590765f740 1 --2- 172.21.15.148:0/2315810088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18463a7b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.960+0000 7f590765f740 1 --2- 172.21.15.148:0/2315810088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184272390 0x55e18463acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.960+0000 7f590765f740 1 --2- 172.21.15.148:0/2315810088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 0x55e18463a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.960+0000 7f590765f740 1 -- 172.21.15.148:0/2315810088 >> 172.21.15.148:0/2315810088 conn(0x55e184287460 msgr2=0x55e184638160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.960+0000 7f590765f740 1 -- 172.21.15.148:0/2315810088 shutdown_connections 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.960+0000 7f590765f740 1 -- 172.21.15.148:0/2315810088 wait complete. 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.960+0000 7f590765f740 1 -- start start 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f590765f740 1 Processor -- start 2024-09-21T01:16:00.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f590765f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e18426a1b0 0x55e184645910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f590765f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184645e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f590765f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 0x55e1846463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f590765f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e184401700 con 0x55e184272390 2024-09-21T01:16:00.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f590765f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55e18453b110 con 0x55e184293070 2024-09-21T01:16:00.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f590765f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e1845b0e50 con 0x55e18426a1b0 2024-09-21T01:16:00.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f590765f740 10 client.0 _ll_register_callbacks cb 0x55e184554990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:00.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f58fa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184645e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f58fa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184645e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36244/0 (socket says 172.21.15.148:36244) 2024-09-21T01:16:00.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f58fa59c640 1 -- 172.21.15.148:0/1910096563 learned_addr learned my addr 172.21.15.148:0/1910096563 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f58fb59e640 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 0x55e1846463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f58fad9d640 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e18426a1b0 0x55e184645910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f58fa59c640 1 -- 172.21.15.148:0/1910096563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e18426a1b0 msgr2=0x55e184645910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f58fa59c640 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e18426a1b0 0x55e184645910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f58fa59c640 1 -- 172.21.15.148:0/1910096563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 msgr2=0x55e1846463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.961+0000 7f58fa59c640 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 0x55e1846463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f58fa59c640 1 -- 172.21.15.148:0/1910096563 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e184568c40 con 0x55e184272390 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f58fb59e640 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 0x55e1846463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f58fa59c640 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184645e50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f58f000bad0 tx=0x7f58f000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39e159850c20d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f58deff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f58deff5640 1 -- 172.21.15.148:0/1910096563 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0003e00 con 0x55e184272390 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f58deff5640 1 -- 172.21.15.148:0/1910096563 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f58f0005020 con 0x55e184272390 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f590765f740 1 -- 172.21.15.148:0/1910096563 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58ec0cd890 con 0x55e184272390 2024-09-21T01:16:00.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f58deff5640 1 -- 172.21.15.148:0/1910096563 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f58f0005220 con 0x55e184272390 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f590765f740 10 client.15822 fetch_fsmap learned FSMap version 25 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f590765f740 1 -- 172.21.15.148:0/1910096563 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e184654420 con 0x55e184272390 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f58deff5640 1 -- 172.21.15.148:0/1910096563 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58ec0cd890 con 0x55e184272390 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.962+0000 7f58deff5640 1 -- 172.21.15.148:0/1910096563 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f58f001b590 con 0x55e184272390 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.963+0000 7f590765f740 10 client.15822 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.963+0000 7f590765f740 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.963+0000 7f590765f740 20 client.15822 populate_metadata read hostname 'smithi148' 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.963+0000 7f590765f740 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e1842519f0 0x55e1846579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.963+0000 7f590765f740 4 client.15822 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.963+0000 7f590765f740 1 -- 172.21.15.148:0/1910096563 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1845b2da0 con 0x55e1842519f0 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.963+0000 7f58fad9d640 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e1842519f0 0x55e1846579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.963+0000 7f58deff5640 10 client.15822 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.963+0000 7f58fad9d640 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e1842519f0 0x55e1846579e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e1574ffad38e4e server_cookie=337a9d4c9ff055b7 in_seq=0 out_seq=0 2024-09-21T01:16:00.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f58deff5640 1 -- 172.21.15.148:0/1910096563 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1845b2da0 con 0x55e1842519f0 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f58deff5640 10 client.15822 handle_command_reply: tid=0 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 client.15822 shutdown 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 -- 172.21.15.148:0/1910096563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 msgr2=0x55e184645e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184645e50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f58f000bad0 tx=0x7f58f000bed0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 -- 172.21.15.148:0/1910096563 shutdown_connections 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e1842519f0 0x55e1846579e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184645e50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 0x55e1846463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f58deff5640 0 client.15822 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 --2- 172.21.15.148:0/1910096563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e18426a1b0 0x55e184645910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 -- 172.21.15.148:0/1910096563 >> 172.21.15.148:0/1910096563 conn(0x55e184287460 msgr2=0x55e18463d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 -- 172.21.15.148:0/1910096563 shutdown_connections 2024-09-21T01:16:00.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 1 -- 172.21.15.148:0/1910096563 wait complete. 2024-09-21T01:16:00.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.964+0000 7f590765f740 20 client.15822 trim_cache size 0 max 16384 2024-09-21T01:16:00.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f590765f740 1 Processor -- start 2024-09-21T01:16:00.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f590765f740 1 -- start start 2024-09-21T01:16:01.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f590765f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e18426a1b0 0x55e184651010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f590765f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184642b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f590765f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 0x55e184643040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f590765f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1af950 con 0x55e184272390 2024-09-21T01:16:01.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f590765f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1ad220 con 0x55e184293070 2024-09-21T01:16:01.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f590765f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1ab090 con 0x55e18426a1b0 2024-09-21T01:16:01.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f58fa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184642b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f58fa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184642b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36246/0 (socket says 172.21.15.148:36246) 2024-09-21T01:16:01.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f58fa59c640 1 -- 172.21.15.148:0/1572638931 learned_addr learned my addr 172.21.15.148:0/1572638931 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:01.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.998+0000 7f58fad9d640 1 --2- 172.21.15.148:0/1572638931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e18426a1b0 0x55e184651010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58fb59e640 1 --2- 172.21.15.148:0/1572638931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 0x55e184643040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58fa59c640 1 -- 172.21.15.148:0/1572638931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e18426a1b0 msgr2=0x55e184651010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:01.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58fa59c640 1 --2- 172.21.15.148:0/1572638931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e18426a1b0 0x55e184651010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58fa59c640 1 -- 172.21.15.148:0/1572638931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 msgr2=0x55e184643040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:01.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58fa59c640 1 --2- 172.21.15.148:0/1572638931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 0x55e184643040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58fa59c640 1 -- 172.21.15.148:0/1572638931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e184643e10 con 0x55e184272390 2024-09-21T01:16:01.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58fb59e640 1 --2- 172.21.15.148:0/1572638931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 0x55e184643040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:01.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58fa59c640 1 --2- 172.21.15.148:0/1572638931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184642b00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f58f001bb70 tx=0x7f58f00051b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e75a67d62417bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:01.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58e0ff9640 1 -- 172.21.15.148:0/1572638931 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f002b070 con 0x55e184272390 2024-09-21T01:16:01.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58e0ff9640 1 -- 172.21.15.148:0/1572638931 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58f0003e00 con 0x55e184272390 2024-09-21T01:16:01.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:00.999+0000 7f58e0ff9640 1 -- 172.21.15.148:0/1572638931 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f00048e0 con 0x55e184272390 2024-09-21T01:16:01.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.000+0000 7f590765f740 1 -- 172.21.15.148:0/1572638931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 msgr2=0x55e184642b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:01.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.000+0000 7f590765f740 1 --2- 172.21.15.148:0/1572638931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184642b00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f58f001bb70 tx=0x7f58f00051b0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.000+0000 7f590765f740 1 -- 172.21.15.148:0/1572638931 shutdown_connections 2024-09-21T01:16:01.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.000+0000 7f590765f740 1 --2- 172.21.15.148:0/1572638931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e184272390 0x55e184642b00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.000+0000 7f590765f740 1 --2- 172.21.15.148:0/1572638931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184293070 0x55e184643040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.000+0000 7f590765f740 1 --2- 172.21.15.148:0/1572638931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e18426a1b0 0x55e184651010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.000+0000 7f590765f740 1 -- 172.21.15.148:0/1572638931 >> 172.21.15.148:0/1572638931 conn(0x55e184287460 msgr2=0x55e184650900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:01.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.000+0000 7f590765f740 1 -- 172.21.15.148:0/1572638931 shutdown_connections 2024-09-21T01:16:01.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.000+0000 7f590765f740 1 -- 172.21.15.148:0/1572638931 wait complete. 2024-09-21T01:16:01.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f590765f740 1 -- start start 2024-09-21T01:16:01.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f590765f740 1 Processor -- start 2024-09-21T01:16:01.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f590765f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18464e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f590765f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184272390 0x55e1846494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f590765f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 0x55e184649a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f590765f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1ab6e0 con 0x55e18426a1b0 2024-09-21T01:16:01.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f590765f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1acb50 con 0x55e184272390 2024-09-21T01:16:01.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f590765f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1abdb0 con 0x55e184293070 2024-09-21T01:16:01.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f590765f740 10 client.0 _ll_register_callbacks cb 0x7f58f00040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:01.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f58fad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18464e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f58fad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18464e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36254/0 (socket says 172.21.15.148:36254) 2024-09-21T01:16:01.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f58fad9d640 1 -- 172.21.15.148:0/1381899263 learned_addr learned my addr 172.21.15.148:0/1381899263 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:01.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.001+0000 7f58fa59c640 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184272390 0x55e1846494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58fb59e640 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 0x55e184649a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58fad9d640 1 -- 172.21.15.148:0/1381899263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 msgr2=0x55e184649a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:01.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58fad9d640 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 0x55e184649a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58fad9d640 1 -- 172.21.15.148:0/1381899263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184272390 msgr2=0x55e1846494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58fad9d640 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184272390 0x55e1846494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58fad9d640 1 -- 172.21.15.148:0/1381899263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e18464a040 con 0x55e18426a1b0 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58fad9d640 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18464e010 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f58ec105740 tx=0x7f58ec032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de44719f45f0eb16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58deff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58deff5640 1 -- 172.21.15.148:0/1381899263 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec049040 con 0x55e18426a1b0 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58deff5640 1 -- 172.21.15.148:0/1381899263 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f58ec0b50c0 con 0x55e18426a1b0 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f590765f740 1 -- 172.21.15.148:0/1381899263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58f0003e00 con 0x55e18426a1b0 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f58deff5640 1 -- 172.21.15.148:0/1381899263 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f58ec0cd6d0 con 0x55e18426a1b0 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f590765f740 10 client.15828 fetch_fsmap learned FSMap version 25 2024-09-21T01:16:01.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.002+0000 7f590765f740 1 -- 172.21.15.148:0/1381899263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e1846c21a0 con 0x55e18426a1b0 2024-09-21T01:16:01.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.003+0000 7f58deff5640 1 -- 172.21.15.148:0/1381899263 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58f0003e00 con 0x55e18426a1b0 2024-09-21T01:16:01.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.003+0000 7f58deff5640 1 -- 172.21.15.148:0/1381899263 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f58ec0c9ff0 con 0x55e18426a1b0 2024-09-21T01:16:01.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.003+0000 7f590765f740 10 client.15828 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:16:01.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.003+0000 7f590765f740 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:01.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.003+0000 7f590765f740 20 client.15828 populate_metadata read hostname 'smithi148' 2024-09-21T01:16:01.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.003+0000 7f590765f740 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e184226da0 0x55e1846c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.003+0000 7f590765f740 4 client.15828 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:16:01.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.003+0000 7f590765f740 1 -- 172.21.15.148:0/1381899263 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e1845ae850 con 0x55e184226da0 2024-09-21T01:16:01.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.003+0000 7f58fa59c640 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e184226da0 0x55e1846c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f58fa59c640 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e184226da0 0x55e1846c4800 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ea7b3e72d8adf1c server_cookie=adebbd77681baaa2 in_seq=0 out_seq=0 2024-09-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f58deff5640 10 client.15828 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f58deff5640 1 -- 172.21.15.148:0/1381899263 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55e1845ae850 con 0x55e184226da0 2024-09-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f58deff5640 10 client.15828 handle_command_reply: tid=0 2024-09-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 client.15828 shutdown 2024-09-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 -- 172.21.15.148:0/1381899263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 msgr2=0x55e18464e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18464e010 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f58ec105740 tx=0x7f58ec032f60 comp rx=0 tx=0).stop 2024-09-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 -- 172.21.15.148:0/1381899263 shutdown_connections 2024-09-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55e184226da0 0x55e1846c4800 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e184293070 0x55e184649a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e184272390 0x55e1846494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 --2- 172.21.15.148:0/1381899263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e18426a1b0 0x55e18464e010 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 -- 172.21.15.148:0/1381899263 >> 172.21.15.148:0/1381899263 conn(0x55e184287460 msgr2=0x55e18463b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f58deff5640 0 client.15828 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 -- 172.21.15.148:0/1381899263 shutdown_connections 2024-09-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 1 -- 172.21.15.148:0/1381899263 wait complete. 2024-09-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.004+0000 7f590765f740 20 client.15828 trim_cache size 0 max 16384 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "no active scrubs running", 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": {}, 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_stats": { 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout: "e82118d3-734a-402a-a119-64146f305eb3": { 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:15:27.808460+0000", 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi148.stdout: "0705e125-8af9-4cc6-98ec-fca2de415bde": { 2024-09-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:14:45.199229+0000", 2024-09-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi148.stdout: "7bf59ed6-eedb-4a06-a813-d8af8d9118b7": { 2024-09-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi148.stdout: "start_time": "2024-09-21T01:14:02.691995+0000", 2024-09-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_passed": 0, 2024-09-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_failed": 0, 2024-09-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_skipped": 0 2024-09-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 -- 172.21.15.148:0/2757263562 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f58e40b6510 msgr2=0x7f58e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f58e40b6510 0x7f58e40b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f58f4005fd0 tx=0x7f58f4004ab0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 -- 172.21.15.148:0/2757263562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58fc102650 msgr2=0x7f58fc19c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58fc102650 0x7f58fc19c630 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f58ec005940 tx=0x7f58ec0042f0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 -- 172.21.15.148:0/2757263562 shutdown_connections 2024-09-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f58e40b6510 0x7f58e40b8a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58fc110200 0x7f58fc1a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58fc102fa0 0x7f58fc19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 --2- 172.21.15.148:0/2757263562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58fc102650 0x7f58fc19c630 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 -- 172.21.15.148:0/2757263562 >> 172.21.15.148:0/2757263562 conn(0x7f58fc079790 msgr2=0x7f58fc109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:01.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 -- 172.21.15.148:0/2757263562 shutdown_connections 2024-09-21T01:16:01.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:01.005+0000 7f59010eb640 1 -- 172.21.15.148:0/2757263562 wait complete. 2024-09-21T01:16:01.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:01 smithi148 ceph-mon[31000]: pgmap v399: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 857 KiB/s wr, 9 op/s 2024-09-21T01:16:01.882 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:16:01.883 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:16:01.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:01 smithi181 ceph-mon[34811]: pgmap v399: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 857 KiB/s wr, 9 op/s 2024-09-21T01:16:01.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:01 smithi157 ceph-mon[34140]: pgmap v399: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 857 KiB/s wr, 9 op/s 2024-09-21T01:16:02.148 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.649+0000 7fc73ed27640 1 -- 172.21.15.148:0/3279294475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7381049b0 msgr2=0x7fc738104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.649+0000 7fc73ed27640 1 --2- 172.21.15.148:0/3279294475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7381049b0 0x7fc738104dc0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009900 tx=0x7fc72c02a410 comp rx=0 tx=0).stop 2024-09-21T01:16:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.649+0000 7fc73ed27640 1 -- 172.21.15.148:0/3279294475 shutdown_connections 2024-09-21T01:16:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.649+0000 7fc73ed27640 1 --2- 172.21.15.148:0/3279294475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73810de10 0x7fc738110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.649+0000 7fc73ed27640 1 --2- 172.21.15.148:0/3279294475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc738105300 0x7fc73810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.649+0000 7fc73ed27640 1 --2- 172.21.15.148:0/3279294475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7381049b0 0x7fc738104dc0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:02.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.649+0000 7fc73ed27640 1 -- 172.21.15.148:0/3279294475 >> 172.21.15.148:0/3279294475 conn(0x7fc738079730 msgr2=0x7fc738079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.649+0000 7fc73ed27640 1 -- 172.21.15.148:0/3279294475 shutdown_connections 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.649+0000 7fc73ed27640 1 -- 172.21.15.148:0/3279294475 wait complete. 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.650+0000 7fc73ed27640 1 Processor -- start 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.650+0000 7fc73ed27640 1 -- start start 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.650+0000 7fc73ed27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7381049b0 0x7fc73819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.650+0000 7fc73ed27640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc738105300 0x7fc73819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.650+0000 7fc73ed27640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73810de10 0x7fc73819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.650+0000 7fc73ed27640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc738113a90 con 0x7fc738105300 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.650+0000 7fc73ed27640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc738113910 con 0x7fc73810de10 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.650+0000 7fc73ed27640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc738113c10 con 0x7fc7381049b0 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc737fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc738105300 0x7fc73819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc737fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc738105300 0x7fc73819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36270/0 (socket says 172.21.15.148:36270) 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc737fff640 1 -- 172.21.15.148:0/569259647 learned_addr learned my addr 172.21.15.148:0/569259647 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:02.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc73cac3640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7381049b0 0x7fc73819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc73d2c4640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73810de10 0x7fc73819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc737fff640 1 -- 172.21.15.148:0/569259647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7381049b0 msgr2=0x7fc73819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc737fff640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7381049b0 0x7fc73819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc737fff640 1 -- 172.21.15.148:0/569259647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73810de10 msgr2=0x7fc73819fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc737fff640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73810de10 0x7fc73819fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc737fff640 1 -- 172.21.15.148:0/569259647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7381a0470 con 0x7fc738105300 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc737fff640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc738105300 0x7fc73819ab60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc72400c970 tx=0x7fc72400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.651+0000 7fc735ffb640 1 -- 172.21.15.148:0/569259647 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724004220 con 0x7fc738105300 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.652+0000 7fc735ffb640 1 -- 172.21.15.148:0/569259647 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7240043c0 con 0x7fc738105300 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.652+0000 7fc73ed27640 1 -- 172.21.15.148:0/569259647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7381a0760 con 0x7fc738105300 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.652+0000 7fc735ffb640 1 -- 172.21.15.148:0/569259647 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724004a00 con 0x7fc738105300 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.652+0000 7fc73ed27640 1 -- 172.21.15.148:0/569259647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7381a0c50 con 0x7fc738105300 2024-09-21T01:16:02.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.653+0000 7fc73ed27640 1 -- 172.21.15.148:0/569259647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc738104dc0 con 0x7fc738105300 2024-09-21T01:16:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.654+0000 7fc735ffb640 1 -- 172.21.15.148:0/569259647 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7fc7240079b0 con 0x7fc738105300 2024-09-21T01:16:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.655+0000 7fc735ffb640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b6540 0x7fc7280b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.656+0000 7fc73cac3640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b6540 0x7fc7280b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.656+0000 7fc735ffb640 1 -- 172.21.15.148:0/569259647 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fc7240e73f0 con 0x7fc738105300 2024-09-21T01:16:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.656+0000 7fc73cac3640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b6540 0x7fc7280b8a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc72c000c00 tx=0x7fc72c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:02.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.659+0000 7fc735ffb640 1 -- 172.21.15.148:0/569259647 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc7381a0c50 con 0x7fc738105300 2024-09-21T01:16:02.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.883+0000 7fc73ed27640 1 -- 172.21.15.148:0/569259647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc738108f70 con 0x7fc738105300 2024-09-21T01:16:02.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.883+0000 7fc735ffb640 1 -- 172.21.15.148:0/569259647 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11927 (secure 0 0 0) 0x7fc724014030 con 0x7fc738105300 2024-09-21T01:16:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:16:02.885 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-21T01:15:07:196837+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:15:06.787318+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24646,24631]},"id":1}]} 2024-09-21T01:16:02.885 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-21T01:16:02.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 -- 172.21.15.148:0/569259647 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b6540 msgr2=0x7fc7280b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:02.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b6540 0x7fc7280b8a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc72c000c00 tx=0x7fc72c031400 comp rx=0 tx=0).stop 2024-09-21T01:16:02.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 -- 172.21.15.148:0/569259647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc738105300 msgr2=0x7fc73819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:02.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc738105300 0x7fc73819ab60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc72400c970 tx=0x7fc72400ce30 comp rx=0 tx=0).stop 2024-09-21T01:16:02.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 -- 172.21.15.148:0/569259647 shutdown_connections 2024-09-21T01:16:02.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7280b6540 0x7fc7280b8a50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:02.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc738105300 0x7fc73819ab60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:02.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73810de10 0x7fc73819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:02.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 --2- 172.21.15.148:0/569259647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7381049b0 0x7fc73819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:02.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 -- 172.21.15.148:0/569259647 >> 172.21.15.148:0/569259647 conn(0x7fc738079730 msgr2=0x7fc7381008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:02.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 -- 172.21.15.148:0/569259647 shutdown_connections 2024-09-21T01:16:02.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:02.886+0000 7fc73ed27640 1 -- 172.21.15.148:0/569259647 wait complete. 2024-09-21T01:16:03.517 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:16:03.790 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:03.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:03 smithi148 ceph-mon[31000]: pgmap v400: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 859 KiB/s wr, 12 op/s 2024-09-21T01:16:03.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:03 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/569259647' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:03.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:03 smithi181 ceph-mon[34811]: pgmap v400: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 859 KiB/s wr, 12 op/s 2024-09-21T01:16:03.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:03 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/569259647' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:03.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:03 smithi157 ceph-mon[34140]: pgmap v400: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 859 KiB/s wr, 12 op/s 2024-09-21T01:16:03.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:03 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/569259647' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:04.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.273+0000 7fadfe1bf640 1 -- 172.21.15.148:0/322396090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf8102a80 msgr2=0x7fadf8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.273+0000 7fadfe1bf640 1 --2- 172.21.15.148:0/322396090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf8102a80 0x7fadf8102e90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fade8009900 tx=0x7fade802a410 comp rx=0 tx=0).stop 2024-09-21T01:16:04.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.273+0000 7fadfe1bf640 1 -- 172.21.15.148:0/322396090 shutdown_connections 2024-09-21T01:16:04.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.273+0000 7fadfe1bf640 1 --2- 172.21.15.148:0/322396090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadf8108d10 0x7fadf810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.273+0000 7fadfe1bf640 1 --2- 172.21.15.148:0/322396090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf81083c0 0x7fadf81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.273+0000 7fadfe1bf640 1 --2- 172.21.15.148:0/322396090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf8102a80 0x7fadf8102e90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.273+0000 7fadfe1bf640 1 -- 172.21.15.148:0/322396090 >> 172.21.15.148:0/322396090 conn(0x7fadf8079740 msgr2=0x7fadf8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.273+0000 7fadfe1bf640 1 -- 172.21.15.148:0/322396090 shutdown_connections 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.273+0000 7fadfe1bf640 1 -- 172.21.15.148:0/322396090 wait complete. 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadfe1bf640 1 Processor -- start 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadfe1bf640 1 -- start start 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadfe1bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf8102a80 0x7fadf8104270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadfe1bf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadf81083c0 0x7fadf81047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadfe1bf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf8108d10 0x7fadf8104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadfe1bf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8112980 con 0x7fadf8102a80 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadfe1bf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8112800 con 0x7fadf81083c0 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadfe1bf640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8112b00 con 0x7fadf8108d10 2024-09-21T01:16:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadf77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf8102a80 0x7fadf8104270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadf77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf8102a80 0x7fadf8104270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36288/0 (socket says 172.21.15.148:36288) 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadf77fe640 1 -- 172.21.15.148:0/3657730760 learned_addr learned my addr 172.21.15.148:0/3657730760 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadeffff640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadf81083c0 0x7fadf81047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.274+0000 7fadf7fff640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf8108d10 0x7fadf8104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadf77fe640 1 -- 172.21.15.148:0/3657730760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf8108d10 msgr2=0x7fadf8104cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadf77fe640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf8108d10 0x7fadf8104cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadf77fe640 1 -- 172.21.15.148:0/3657730760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadf81083c0 msgr2=0x7fadf81047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadf77fe640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadf81083c0 0x7fadf81047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadf77fe640 1 -- 172.21.15.148:0/3657730760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf81a87c0 con 0x7fadf8102a80 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadf7fff640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf8108d10 0x7fadf8104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadf77fe640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf8102a80 0x7fadf8104270 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fade8005940 tx=0x7fade8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadf57fa640 1 -- 172.21.15.148:0/3657730760 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade803f030 con 0x7fadf8102a80 2024-09-21T01:16:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadfe1bf640 1 -- 172.21.15.148:0/3657730760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf81a8a50 con 0x7fadf8102a80 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadf57fa640 1 -- 172.21.15.148:0/3657730760 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade8003aa0 con 0x7fadf8102a80 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadf57fa640 1 -- 172.21.15.148:0/3657730760 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8035070 con 0x7fadf8102a80 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.275+0000 7fadfe1bf640 1 -- 172.21.15.148:0/3657730760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf81a8f80 con 0x7fadf8102a80 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fae04733740 1 Processor -- start 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fae04733740 1 -- start start 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fadf57fa640 1 -- 172.21.15.148:0/3657730760 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7fade8042030 con 0x7fadf8102a80 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fae04733740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7899070 0x5576b7c406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fae04733740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 0x5576b7c40be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fae04733740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7878390 0x5576b7c41120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fae04733740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5576b7bb6ea0 con 0x5576b7878390 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fae04733740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5576b7ba62d0 con 0x5576b7899070 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fae04733740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5576b7baa0e0 con 0x5576b78701b0 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fadeffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7878390 0x5576b7c41120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fadeffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7878390 0x5576b7c41120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36302/0 (socket says 172.21.15.148:36302) 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fadeffff640 1 -- 172.21.15.148:0/2689121339 learned_addr learned my addr 172.21.15.148:0/2689121339 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fadf77fe640 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 0x5576b7c40be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.278+0000 7fadf7fff640 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7899070 0x5576b7c406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadeffff640 1 -- 172.21.15.148:0/2689121339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 msgr2=0x5576b7c40be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadeffff640 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 0x5576b7c40be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadeffff640 1 -- 172.21.15.148:0/2689121339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7899070 msgr2=0x5576b7c406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadeffff640 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7899070 0x5576b7c406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadeffff640 1 -- 172.21.15.148:0/2689121339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b7904650 con 0x5576b7878390 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadf77fe640 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 0x5576b7c40be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadf7fff640 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7899070 0x5576b7c406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadf57fa640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fade40b6510 0x7fade40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadf7fff640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fade40b6510 0x7fade40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadf57fa640 1 -- 172.21.15.148:0/3657730760 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fade8107a80 con 0x7fadf8102a80 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadeffff640 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7878390 0x5576b7c41120 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fade000cb90 tx=0x7fade000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22de0654316b7758 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadedffb640 1 -- 172.21.15.148:0/2689121339 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0010630 con 0x5576b7878390 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadedffb640 1 -- 172.21.15.148:0/2689121339 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade0010c80 con 0x5576b7878390 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.279+0000 7fadedffb640 1 -- 172.21.15.148:0/2689121339 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade000fa70 con 0x5576b7878390 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.280+0000 7fae04733740 1 -- 172.21.15.148:0/2689121339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7878390 msgr2=0x5576b7c41120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.280+0000 7fadf7fff640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fade40b6510 0x7fade40b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fadf0005fd0 tx=0x7fadf0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.280+0000 7fae04733740 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7878390 0x5576b7c41120 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fade000cb90 tx=0x7fade000e720 comp rx=0 tx=0).stop 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.280+0000 7fae04733740 1 -- 172.21.15.148:0/2689121339 shutdown_connections 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.280+0000 7fae04733740 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7878390 0x5576b7c41120 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.280+0000 7fae04733740 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 0x5576b7c40be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.280+0000 7fae04733740 1 --2- 172.21.15.148:0/2689121339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7899070 0x5576b7c406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.280+0000 7fae04733740 1 -- 172.21.15.148:0/2689121339 >> 172.21.15.148:0/2689121339 conn(0x5576b788d460 msgr2=0x5576b7c3e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.280+0000 7fae04733740 1 -- 172.21.15.148:0/2689121339 shutdown_connections 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.280+0000 7fae04733740 1 -- 172.21.15.148:0/2689121339 wait complete. 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fae04733740 1 -- start start 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fae04733740 1 Processor -- start 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fae04733740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 0x5576b7c4bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fae04733740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7878390 0x5576b7c4c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fae04733740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7899070 0x5576b7c4c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fae04733740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5576b7a07700 con 0x5576b7899070 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fae04733740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x5576b7b41160 con 0x5576b7878390 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fae04733740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5576b7c4ee80 con 0x5576b78701b0 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fae04733740 10 client.0 _ll_register_callbacks cb 0x5576b7b5a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7899070 0x5576b7c4c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7899070 0x5576b7c4c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36310/0 (socket says 172.21.15.148:36310) 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.281+0000 7fadf7fff640 1 -- 172.21.15.148:0/1523361131 learned_addr learned my addr 172.21.15.148:0/1523361131 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadeffff640 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7878390 0x5576b7c4c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadf77fe640 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 0x5576b7c4bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadf7fff640 1 -- 172.21.15.148:0/1523361131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 msgr2=0x5576b7c4bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadf7fff640 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 0x5576b7c4bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadf7fff640 1 -- 172.21.15.148:0/1523361131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7878390 msgr2=0x5576b7c4c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadf7fff640 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7878390 0x5576b7c4c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadf7fff640 1 -- 172.21.15.148:0/1523361131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576b7b6ec90 con 0x5576b7899070 2024-09-21T01:16:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadf7fff640 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7899070 0x5576b7c4c700 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fadf0012850 tx=0x7fadf0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55358287037f293 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:16:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadd6ffd640 1 -- 172.21.15.148:0/1523361131 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0023070 con 0x5576b7899070 2024-09-21T01:16:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadd6ffd640 1 -- 172.21.15.148:0/1523361131 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fadf0011b60 con 0x5576b7899070 2024-09-21T01:16:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fae04733740 1 -- 172.21.15.148:0/1523361131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fade0010c80 con 0x5576b7899070 2024-09-21T01:16:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fadd6ffd640 1 -- 172.21.15.148:0/1523361131 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fadf002f050 con 0x5576b7899070 2024-09-21T01:16:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.282+0000 7fae04733740 10 client.15846 fetch_fsmap learned FSMap version 25 2024-09-21T01:16:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.283+0000 7fae04733740 1 -- 172.21.15.148:0/1523361131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5576b7c5aae0 con 0x5576b7899070 2024-09-21T01:16:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.283+0000 7fadd6ffd640 1 -- 172.21.15.148:0/1523361131 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade0010c80 con 0x5576b7899070 2024-09-21T01:16:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.283+0000 7fadd6ffd640 1 -- 172.21.15.148:0/1523361131 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7fadf000f040 con 0x5576b7899070 2024-09-21T01:16:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.283+0000 7fae04733740 10 client.15846 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:16:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.283+0000 7fae04733740 10 client.15846 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.283+0000 7fae04733740 20 client.15846 populate_metadata read hostname 'smithi148' 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.283+0000 7fae04733740 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5576b78579f0 0x5576b7c5dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.283+0000 7fae04733740 4 client.15846 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.283+0000 7fae04733740 1 -- 172.21.15.148:0/1523361131 --> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576b7bb8df0 con 0x5576b78579f0 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.283+0000 7fadf77fe640 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5576b78579f0 0x5576b7c5dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.284+0000 7fadf77fe640 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5576b78579f0 0x5576b7c5dff0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70a69c40d2202996 server_cookie=7bf3b5fe0a955ccf in_seq=0 out_seq=0 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.284+0000 7fadd6ffd640 10 client.15846 ms_handle_connect on v2:172.21.15.181:6836/3446561094 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.284+0000 7fadd6ffd640 1 -- 172.21.15.148:0/1523361131 <== mds.2 v2:172.21.15.181:6836/3446561094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576b7bb8df0 con 0x5576b78579f0 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.284+0000 7fadd6ffd640 10 client.15846 handle_command_reply: tid=0 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 client.15846 shutdown 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 -- 172.21.15.148:0/1523361131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7899070 msgr2=0x5576b7c4c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7899070 0x5576b7c4c700 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fadf0012850 tx=0x7fadf0004ab0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 -- 172.21.15.148:0/1523361131 shutdown_connections 2024-09-21T01:16:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5576b78579f0 0x5576b7c5dff0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b7899070 0x5576b7c4c700 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fadd6ffd640 0 client.15846 ms_handle_reset on v2:172.21.15.181:6836/3446561094 2024-09-21T01:16:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b7878390 0x5576b7c4c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 --2- 172.21.15.148:0/1523361131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78701b0 0x5576b7c4bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 -- 172.21.15.148:0/1523361131 >> 172.21.15.148:0/1523361131 conn(0x5576b788d460 msgr2=0x5576b7c43830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 -- 172.21.15.148:0/1523361131 shutdown_connections 2024-09-21T01:16:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 1 -- 172.21.15.148:0/1523361131 wait complete. 2024-09-21T01:16:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.285+0000 7fae04733740 20 client.15846 trim_cache size 0 max 16384 2024-09-21T01:16:04.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fae04733740 1 Processor -- start 2024-09-21T01:16:04.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fae04733740 1 -- start start 2024-09-21T01:16:04.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fae04733740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b788d460 0x5576b7c4d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fae04733740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78579f0 0x5576b7c48e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fae04733740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78701b0 0x5576b7c493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fae04733740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b3ec0 con 0x5576b78701b0 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fae04733740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b1790 con 0x5576b788d460 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fae04733740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81af5e0 con 0x5576b78579f0 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78701b0 0x5576b7c493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78701b0 0x5576b7c493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36326/0 (socket says 172.21.15.148:36326) 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fadf7fff640 1 -- 172.21.15.148:0/1497729347 learned_addr learned my addr 172.21.15.148:0/1497729347 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fadeffff640 1 --2- 172.21.15.148:0/1497729347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78579f0 0x5576b7c48e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.299+0000 7fadf77fe640 1 --2- 172.21.15.148:0/1497729347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b788d460 0x5576b7c4d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.300+0000 7fadf7fff640 1 -- 172.21.15.148:0/1497729347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78579f0 msgr2=0x5576b7c48e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.300+0000 7fadf7fff640 1 --2- 172.21.15.148:0/1497729347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78579f0 0x5576b7c48e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.300+0000 7fadf7fff640 1 -- 172.21.15.148:0/1497729347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b788d460 msgr2=0x5576b7c4d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.300+0000 7fadf7fff640 1 --2- 172.21.15.148:0/1497729347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b788d460 0x5576b7c4d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.300+0000 7fadf7fff640 1 -- 172.21.15.148:0/1497729347 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b7c3eaa0 con 0x5576b78701b0 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.300+0000 7fadf77fe640 1 --2- 172.21.15.148:0/1497729347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b788d460 0x5576b7c4d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.300+0000 7fadf7fff640 1 --2- 172.21.15.148:0/1497729347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78701b0 0x5576b7c493b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fadf00273b0 tx=0x7fadf00277b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d43944c4a6dcc59 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.300+0000 7faded7fa640 1 -- 172.21.15.148:0/1497729347 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0037020 con 0x5576b78701b0 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.300+0000 7faded7fa640 1 -- 172.21.15.148:0/1497729347 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf0011200 con 0x5576b78701b0 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.300+0000 7faded7fa640 1 -- 172.21.15.148:0/1497729347 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0023070 con 0x5576b78701b0 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.301+0000 7fae04733740 1 -- 172.21.15.148:0/1497729347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78701b0 msgr2=0x5576b7c493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.301+0000 7fae04733740 1 --2- 172.21.15.148:0/1497729347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78701b0 0x5576b7c493b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fadf00273b0 tx=0x7fadf00277b0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.301+0000 7fae04733740 1 -- 172.21.15.148:0/1497729347 shutdown_connections 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.301+0000 7fae04733740 1 --2- 172.21.15.148:0/1497729347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78701b0 0x5576b7c493b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.301+0000 7fae04733740 1 --2- 172.21.15.148:0/1497729347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b78579f0 0x5576b7c48e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.301+0000 7fae04733740 1 --2- 172.21.15.148:0/1497729347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b788d460 0x5576b7c4d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.301+0000 7fae04733740 1 -- 172.21.15.148:0/1497729347 >> 172.21.15.148:0/1497729347 conn(0x5576b7c39780 msgr2=0x5576b7c41f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.301+0000 7fae04733740 1 -- 172.21.15.148:0/1497729347 shutdown_connections 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.301+0000 7fae04733740 1 -- 172.21.15.148:0/1497729347 wait complete. 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.301+0000 7fae04733740 1 -- start start 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fae04733740 1 Processor -- start 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fae04733740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78579f0 0x5576b7c50410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fae04733740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b78701b0 0x5576b7c50950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fae04733740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b788d460 0x5576b7cc79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fae04733740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81afc50 con 0x5576b78579f0 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fae04733740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b10c0 con 0x5576b78701b0 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fae04733740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b0320 con 0x5576b788d460 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fae04733740 10 client.0 _ll_register_callbacks cb 0x7fadf0016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fadf77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78579f0 0x5576b7c50410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fadf77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78579f0 0x5576b7c50410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36330/0 (socket says 172.21.15.148:36330) 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.302+0000 7fadf77fe640 1 -- 172.21.15.148:0/622085383 learned_addr learned my addr 172.21.15.148:0/622085383 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadeffff640 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b78701b0 0x5576b7c50950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadf7fff640 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b788d460 0x5576b7cc79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadf77fe640 1 -- 172.21.15.148:0/622085383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b788d460 msgr2=0x5576b7cc79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadf77fe640 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b788d460 0x5576b7cc79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadf77fe640 1 -- 172.21.15.148:0/622085383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b78701b0 msgr2=0x5576b7c50950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadf77fe640 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b78701b0 0x5576b7c50950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadf77fe640 1 -- 172.21.15.148:0/622085383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576b7c511f0 con 0x5576b78579f0 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadeffff640 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b78701b0 0x5576b7c50950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadf77fe640 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78579f0 0x5576b7c50410 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fade8006010 tx=0x7fade802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a86e50b525c8ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:16:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadd6ffd640 1 -- 172.21.15.148:0/622085383 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8049040 con 0x5576b78579f0 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadd6ffd640 1 -- 172.21.15.148:0/622085383 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fade8003c50 con 0x5576b78579f0 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fae04733740 1 -- 172.21.15.148:0/622085383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf0011200 con 0x5576b78579f0 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fadd6ffd640 1 -- 172.21.15.148:0/622085383 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fade80cd730 con 0x5576b78579f0 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fae04733740 10 client.15852 fetch_fsmap learned FSMap version 25 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.303+0000 7fae04733740 1 -- 172.21.15.148:0/622085383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5576b7cc8fa0 con 0x5576b78579f0 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.304+0000 7fadd6ffd640 1 -- 172.21.15.148:0/622085383 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf0011200 con 0x5576b78579f0 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.304+0000 7fadd6ffd640 1 -- 172.21.15.148:0/622085383 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7fade80f10b0 con 0x5576b78579f0 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.304+0000 7fae04733740 10 client.15852 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.304+0000 7fae04733740 10 client.15852 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.304+0000 7fae04733740 20 client.15852 populate_metadata read hostname 'smithi148' 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.304+0000 7fae04733740 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5576b7878390 0x5576b7ccb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.304+0000 7fae04733740 4 client.15852 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.304+0000 7fae04733740 1 -- 172.21.15.148:0/622085383 --> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576b7bb48a0 con 0x5576b7878390 2024-09-21T01:16:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.304+0000 7fadeffff640 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5576b7878390 0x5576b7ccb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fadd6ffd640 10 client.15852 ms_handle_connect on v2:172.21.15.181:6836/3446561094 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fadeffff640 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5576b7878390 0x5576b7ccb760 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e5436097bfeb2f98 server_cookie=b7e1c2b7ade93aff in_seq=0 out_seq=0 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fadd6ffd640 1 -- 172.21.15.148:0/622085383 <== mds.2 v2:172.21.15.181:6836/3446561094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576b7bb48a0 con 0x5576b7878390 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fadd6ffd640 10 client.15852 handle_command_reply: tid=0 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 client.15852 shutdown 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 -- 172.21.15.148:0/622085383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78579f0 msgr2=0x5576b7c50410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78579f0 0x5576b7c50410 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fade8006010 tx=0x7fade802a410 comp rx=0 tx=0).stop 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 -- 172.21.15.148:0/622085383 shutdown_connections 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.181:6836/3446561094,v1:172.21.15.181:6837/3446561094] conn(0x5576b7878390 0x5576b7ccb760 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576b788d460 0x5576b7cc79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5576b78701b0 0x5576b7c50950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 --2- 172.21.15.148:0/622085383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576b78579f0 0x5576b7c50410 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 -- 172.21.15.148:0/622085383 >> 172.21.15.148:0/622085383 conn(0x5576b7c39780 msgr2=0x5576b7c46170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fadd6ffd640 0 client.15852 ms_handle_reset on v2:172.21.15.181:6836/3446561094 2024-09-21T01:16:04.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 -- 172.21.15.148:0/622085383 shutdown_connections 2024-09-21T01:16:04.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 1 -- 172.21.15.148:0/622085383 wait complete. 2024-09-21T01:16:04.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.305+0000 7fae04733740 20 client.15852 trim_cache size 0 max 16384 2024-09-21T01:16:04.316 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-21T01:16:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 -- 172.21.15.148:0/3657730760 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fade40b6510 msgr2=0x7fade40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fade40b6510 0x7fade40b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fadf0005fd0 tx=0x7fadf0009500 comp rx=0 tx=0).stop 2024-09-21T01:16:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 -- 172.21.15.148:0/3657730760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf8102a80 msgr2=0x7fadf8104270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf8102a80 0x7fadf8104270 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fade8005940 tx=0x7fade8004270 comp rx=0 tx=0).stop 2024-09-21T01:16:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 -- 172.21.15.148:0/3657730760 shutdown_connections 2024-09-21T01:16:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fade40b6510 0x7fade40b8a20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf8108d10 0x7fadf8104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fadf81083c0 0x7fadf81047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 --2- 172.21.15.148:0/3657730760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fadf8102a80 0x7fadf8104270 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 -- 172.21.15.148:0/3657730760 >> 172.21.15.148:0/3657730760 conn(0x7fadf8079740 msgr2=0x7fadf8101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 -- 172.21.15.148:0/3657730760 shutdown_connections 2024-09-21T01:16:04.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:04.306+0000 7fadfe1bf640 1 -- 172.21.15.148:0/3657730760 wait complete. 2024-09-21T01:16:05.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:16:05.307 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:05.513 INFO:tasks.workunit.client.0.smithi148.stdout:setting up random write file 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:done setting up random write file 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:starting fsync run 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0097s 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0062s 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0053s 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0061s 2024-09-21T01:16:05.514 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0068s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0062s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0071s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0068s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0059s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0064s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0065s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0065s 2024-09-21T01:16:05.515 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0067s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0072s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0068s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0067s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0070s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0070s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0004s fsync time: 0.0070s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0061s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0071s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0071s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0062s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0066s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0066s 2024-09-21T01:16:05.516 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0072s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0071s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0069s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0070s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0069s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0070s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0070s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0062s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-21T01:16:05.517 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-21T01:16:05.518 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0061s 2024-09-21T01:16:05.518 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0054s 2024-09-21T01:16:05.518 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-21T01:16:05.518 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0061s 2024-09-21T01:16:05.518 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-21T01:16:05.518 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-21T01:16:05.518 INFO:tasks.workunit.client.0.smithi148.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-21T01:16:05.518 INFO:tasks.workunit.client.0.smithi148.stdout:run done 61 fsyncs total, killing random writer 2024-09-21T01:16:05.518 INFO:tasks.workunit.client.0.smithi148.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-21T01:16:05.519 INFO:tasks.workunit.client.0.smithi148.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-21T01:16:05.519 INFO:tasks.workunit.client.0.smithi148.stderr:+ whereis lsof 2024-09-21T01:16:05.584 INFO:tasks.workunit.client.0.smithi148.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-21T01:16:05.584 INFO:tasks.workunit.client.0.smithi148.stderr:+ lsof 2024-09-21T01:16:05.606 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/ea4606587d6fef39d95c30325f7ce8bcbb7f241a028a5b93fcd44986edad130e/merged 2024-09-21T01:16:05.606 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.606 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/3b72783e46df8f97a0c8ebf99350956c56f087fd294b24958bf195ec7f64b3b7/merged 2024-09-21T01:16:05.606 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.606 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/b3d285f715ce06c9f26ece0bf7d61bc69f64c9e8b373b91a58051a0b2e7da48c/merged 2024-09-21T01:16:05.606 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.606 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/0739f2d4d2fb51758047c1bd0b55a19a5584d215c65813809bf684fbe219896f/merged 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d072ef10a62e5b4e75799d4f229b849dde83d39e444fb92b07342b933b139184/merged 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/458aee01f922a56378f44e8d7b670be0409158cecc714d036f8759f8970d3e24/merged 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/6509b8082a2e7fae541e4241a7694c823ff1d6e3dd3d2f5aede5c7fce8916948/merged 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/f28e995e596d836133a298ed81723f3aabf05b7bacd6e65ed5c97d86f7246809/merged 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/6212437a5a021c9186238d48039a520273441d7ed5027188c5168314d3ee8dd5/merged 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/200c3b106759dc014bedc6acfbe299b6d079d65f5205645dfc004f6ce0d84e44/merged 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/0a938071f9a5cae0e5843461a4fa65890dde4c2e07fedcea177b1c07ae4b9172/merged 2024-09-21T01:16:05.608 INFO:tasks.workunit.client.0.smithi148.stderr: Output information may be incomplete. 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-21T01:16:05.694 INFO:tasks.workunit.client.0.smithi148.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-21T01:16:05.695 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-09-21T01:16:05.696 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-21T01:16:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:pr/ttyS1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:pr/ttyS1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:pr/ttyS1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_preem 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_preem 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_preem 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:rcu_preem 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-21T01:16:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/0 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/0 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/0 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/0 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-21T01:16:05.699 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-21T01:16:05.700 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-21T01:16:05.701 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-21T01:16:05.702 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 39 root cwd unknown /proc/39/cwd (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 39 root rtd unknown /proc/39/root (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 39 root txt unknown /proc/39/exe (readlink: Permission denied) 2024-09-21T01:16:05.703 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 39 root NOFD /proc/39/fd (opendir: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-21T01:16:05.704 INFO:tasks.workunit.client.0.smithi148.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-21T01:16:05.705 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-09-21T01:16:05.706 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-21T01:16:05.707 INFO:tasks.workunit.client.0.smithi148.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-21T01:16:05.708 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:cpuhp/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:idle_inje 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:migration 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:migration 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:migration 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:migration 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:ksoftirqd 62 root NOFD /proc/62/fd (opendir: Permission denied) 2024-09-21T01:16:05.709 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 64 root cwd unknown /proc/64/cwd (readlink: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 64 root rtd unknown /proc/64/root (readlink: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 64 root txt unknown /proc/64/exe (readlink: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 64 root NOFD /proc/64/fd (opendir: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 66 root cwd unknown /proc/66/cwd (readlink: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 66 root rtd unknown /proc/66/root (readlink: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 66 root txt unknown /proc/66/exe (readlink: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 66 root NOFD /proc/66/fd (opendir: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 67 root cwd unknown /proc/67/cwd (readlink: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 67 root rtd unknown /proc/67/root (readlink: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 67 root txt unknown /proc/67/exe (readlink: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 67 root NOFD /proc/67/fd (opendir: Permission denied) 2024-09-21T01:16:05.710 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kdevtmpfs 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kdevtmpfs 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kdevtmpfs 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kdevtmpfs 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kauditd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kauditd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kauditd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-09-21T01:16:05.711 INFO:tasks.workunit.client.0.smithi148.stdout:kauditd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:khungtask 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:khungtask 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:khungtask 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:khungtask 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:oom_reape 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:oom_reape 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:oom_reape 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:oom_reape 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-09-21T01:16:05.712 INFO:tasks.workunit.client.0.smithi148.stdout:kcompactd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:kcompactd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:kcompactd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:kcompactd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:ksmd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:ksmd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:ksmd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:ksmd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:khugepage 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:khugepage 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:khugepage 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:khugepage 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-21T01:16:05.713 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-21T01:16:05.714 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-09-21T01:16:05.715 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:watchdogd 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:watchdogd 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:watchdogd 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:watchdogd 91 root NOFD /proc/91/fd (opendir: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 93 root cwd unknown /proc/93/cwd (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 93 root rtd unknown /proc/93/root (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 93 root txt unknown /proc/93/exe (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 93 root NOFD /proc/93/fd (opendir: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kswapd0 95 root cwd unknown /proc/95/cwd (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kswapd0 95 root rtd unknown /proc/95/root (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kswapd0 95 root txt unknown /proc/95/exe (readlink: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kswapd0 95 root NOFD /proc/95/fd (opendir: Permission denied) 2024-09-21T01:16:05.716 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 101 root cwd unknown /proc/101/cwd (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 101 root rtd unknown /proc/101/root (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 101 root txt unknown /proc/101/exe (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 101 root NOFD /proc/101/fd (opendir: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 109 root cwd unknown /proc/109/cwd (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 109 root rtd unknown /proc/109/root (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 109 root txt unknown /proc/109/exe (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 109 root NOFD /proc/109/fd (opendir: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 110 root cwd unknown /proc/110/cwd (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 110 root rtd unknown /proc/110/root (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 110 root txt unknown /proc/110/exe (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 110 root NOFD /proc/110/fd (opendir: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-09-21T01:16:05.717 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 114 root cwd unknown /proc/114/cwd (readlink: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 114 root rtd unknown /proc/114/root (readlink: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 114 root txt unknown /proc/114/exe (readlink: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 114 root NOFD /proc/114/fd (opendir: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 123 root cwd unknown /proc/123/cwd (readlink: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 123 root rtd unknown /proc/123/root (readlink: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 123 root txt unknown /proc/123/exe (readlink: Permission denied) 2024-09-21T01:16:05.718 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 123 root NOFD /proc/123/fd (opendir: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 236 root cwd unknown /proc/236/cwd (readlink: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 236 root rtd unknown /proc/236/root (readlink: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 236 root txt unknown /proc/236/exe (readlink: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 236 root NOFD /proc/236/fd (opendir: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 237 root cwd unknown /proc/237/cwd (readlink: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 237 root rtd unknown /proc/237/root (readlink: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 237 root txt unknown /proc/237/exe (readlink: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 237 root NOFD /proc/237/fd (opendir: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 239 root cwd unknown /proc/239/cwd (readlink: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 239 root rtd unknown /proc/239/root (readlink: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 239 root txt unknown /proc/239/exe (readlink: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 239 root NOFD /proc/239/fd (opendir: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 278 root cwd unknown /proc/278/cwd (readlink: Permission denied) 2024-09-21T01:16:05.719 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 278 root rtd unknown /proc/278/root (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 278 root txt unknown /proc/278/exe (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 278 root NOFD /proc/278/fd (opendir: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 282 root cwd unknown /proc/282/cwd (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 282 root rtd unknown /proc/282/root (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 282 root txt unknown /proc/282/exe (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 282 root NOFD /proc/282/fd (opendir: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 286 root cwd unknown /proc/286/cwd (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 286 root rtd unknown /proc/286/root (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 286 root txt unknown /proc/286/exe (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 286 root NOFD /proc/286/fd (opendir: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 296 root cwd unknown /proc/296/cwd (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 296 root rtd unknown /proc/296/root (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 296 root txt unknown /proc/296/exe (readlink: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 296 root NOFD /proc/296/fd (opendir: Permission denied) 2024-09-21T01:16:05.720 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 297 root cwd unknown /proc/297/cwd (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 297 root rtd unknown /proc/297/root (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 297 root txt unknown /proc/297/exe (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 297 root NOFD /proc/297/fd (opendir: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 347 root cwd unknown /proc/347/cwd (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 347 root rtd unknown /proc/347/root (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 347 root txt unknown /proc/347/exe (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 347 root NOFD /proc/347/fd (opendir: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 391 root cwd unknown /proc/391/cwd (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 391 root rtd unknown /proc/391/root (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 391 root txt unknown /proc/391/exe (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 391 root NOFD /proc/391/fd (opendir: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 430 root cwd unknown /proc/430/cwd (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 430 root rtd unknown /proc/430/root (readlink: Permission denied) 2024-09-21T01:16:05.721 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 430 root txt unknown /proc/430/exe (readlink: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 430 root NOFD /proc/430/fd (opendir: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 433 root cwd unknown /proc/433/cwd (readlink: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 433 root rtd unknown /proc/433/root (readlink: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 433 root txt unknown /proc/433/exe (readlink: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 433 root NOFD /proc/433/fd (opendir: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 434 root cwd unknown /proc/434/cwd (readlink: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 434 root rtd unknown /proc/434/root (readlink: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 434 root txt unknown /proc/434/exe (readlink: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 434 root NOFD /proc/434/fd (opendir: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 435 root cwd unknown /proc/435/cwd (readlink: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 435 root rtd unknown /proc/435/root (readlink: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 435 root txt unknown /proc/435/exe (readlink: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 435 root NOFD /proc/435/fd (opendir: Permission denied) 2024-09-21T01:16:05.722 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 437 root cwd unknown /proc/437/cwd (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 437 root rtd unknown /proc/437/root (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 437 root txt unknown /proc/437/exe (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 437 root NOFD /proc/437/fd (opendir: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 442 root cwd unknown /proc/442/cwd (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 442 root rtd unknown /proc/442/root (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 442 root txt unknown /proc/442/exe (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 442 root NOFD /proc/442/fd (opendir: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_0 449 root cwd unknown /proc/449/cwd (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_0 449 root rtd unknown /proc/449/root (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_0 449 root txt unknown /proc/449/exe (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_0 449 root NOFD /proc/449/fd (opendir: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-09-21T01:16:05.723 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_1 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_1 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_1 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_1 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_2 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_2 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_2 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-09-21T01:16:05.724 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_2 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_3 455 root cwd unknown /proc/455/cwd (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_3 455 root rtd unknown /proc/455/root (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_3 455 root txt unknown /proc/455/exe (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_3 455 root NOFD /proc/455/fd (opendir: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_4 459 root cwd unknown /proc/459/cwd (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_4 459 root rtd unknown /proc/459/root (readlink: Permission denied) 2024-09-21T01:16:05.725 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_4 459 root txt unknown /proc/459/exe (readlink: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_4 459 root NOFD /proc/459/fd (opendir: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_5 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_5 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_5 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_5 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-09-21T01:16:05.726 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_6 463 root cwd unknown /proc/463/cwd (readlink: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_6 463 root rtd unknown /proc/463/root (readlink: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_6 463 root txt unknown /proc/463/exe (readlink: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_6 463 root NOFD /proc/463/fd (opendir: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 464 root NOFD /proc/464/fd (opendir: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_7 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_7 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_7 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_7 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-09-21T01:16:05.727 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_8 467 root cwd unknown /proc/467/cwd (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_8 467 root rtd unknown /proc/467/root (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_8 467 root txt unknown /proc/467/exe (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_8 467 root NOFD /proc/467/fd (opendir: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 468 root cwd unknown /proc/468/cwd (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 468 root rtd unknown /proc/468/root (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 468 root txt unknown /proc/468/exe (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 468 root NOFD /proc/468/fd (opendir: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_9 469 root cwd unknown /proc/469/cwd (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_9 469 root rtd unknown /proc/469/root (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_9 469 root txt unknown /proc/469/exe (readlink: Permission denied) 2024-09-21T01:16:05.728 INFO:tasks.workunit.client.0.smithi148.stdout:scsi_eh_9 469 root NOFD /proc/469/fd (opendir: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 470 root cwd unknown /proc/470/cwd (readlink: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 470 root rtd unknown /proc/470/root (readlink: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 470 root txt unknown /proc/470/exe (readlink: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 470 root NOFD /proc/470/fd (opendir: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 471 root cwd unknown /proc/471/cwd (readlink: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 471 root rtd unknown /proc/471/root (readlink: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 471 root txt unknown /proc/471/exe (readlink: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 471 root NOFD /proc/471/fd (opendir: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 498 root cwd unknown /proc/498/cwd (readlink: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 498 root rtd unknown /proc/498/root (readlink: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 498 root txt unknown /proc/498/exe (readlink: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 498 root NOFD /proc/498/fd (opendir: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:jbd2/sda1 500 root cwd unknown /proc/500/cwd (readlink: Permission denied) 2024-09-21T01:16:05.729 INFO:tasks.workunit.client.0.smithi148.stdout:jbd2/sda1 500 root rtd unknown /proc/500/root (readlink: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:jbd2/sda1 500 root txt unknown /proc/500/exe (readlink: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:jbd2/sda1 500 root NOFD /proc/500/fd (opendir: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 501 root cwd unknown /proc/501/cwd (readlink: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 501 root rtd unknown /proc/501/root (readlink: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 501 root txt unknown /proc/501/exe (readlink: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 501 root NOFD /proc/501/fd (opendir: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-j 577 root cwd unknown /proc/577/cwd (readlink: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-j 577 root rtd unknown /proc/577/root (readlink: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-j 577 root txt unknown /proc/577/exe (readlink: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-j 577 root NOFD /proc/577/fd (opendir: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:ext4lazyi 587 root cwd unknown /proc/587/cwd (readlink: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:ext4lazyi 587 root rtd unknown /proc/587/root (readlink: Permission denied) 2024-09-21T01:16:05.730 INFO:tasks.workunit.client.0.smithi148.stdout:ext4lazyi 587 root txt unknown /proc/587/exe (readlink: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:ext4lazyi 587 root NOFD /proc/587/fd (opendir: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-u 593 root cwd unknown /proc/593/cwd (readlink: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-u 593 root rtd unknown /proc/593/root (readlink: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-u 593 root txt unknown /proc/593/exe (readlink: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-u 593 root NOFD /proc/593/fd (opendir: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 635 root cwd unknown /proc/635/cwd (readlink: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 635 root rtd unknown /proc/635/root (readlink: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 635 root txt unknown /proc/635/exe (readlink: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 635 root NOFD /proc/635/fd (opendir: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:kipmi0 644 root cwd unknown /proc/644/cwd (readlink: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:kipmi0 644 root rtd unknown /proc/644/root (readlink: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:kipmi0 644 root txt unknown /proc/644/exe (readlink: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:kipmi0 644 root NOFD /proc/644/fd (opendir: Permission denied) 2024-09-21T01:16:05.731 INFO:tasks.workunit.client.0.smithi148.stdout:rpcbind 664 rpc cwd unknown /proc/664/cwd (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:rpcbind 664 rpc rtd unknown /proc/664/root (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:rpcbind 664 rpc txt unknown /proc/664/exe (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:rpcbind 664 rpc NOFD /proc/664/fd (opendir: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 672 root cwd unknown /proc/672/cwd (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 672 root rtd unknown /proc/672/root (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 672 root txt unknown /proc/672/exe (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 672 root NOFD /proc/672/fd (opendir: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 673 root cwd unknown /proc/673/cwd (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 673 root rtd unknown /proc/673/root (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 673 root txt unknown /proc/673/exe (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 673 root NOFD /proc/673/fd (opendir: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 root cwd unknown /proc/674/cwd (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 root rtd unknown /proc/674/root (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 root txt unknown /proc/674/exe (readlink: Permission denied) 2024-09-21T01:16:05.732 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 root NOFD /proc/674/fd (opendir: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 675 auditd root cwd unknown /proc/674/task/675/cwd (readlink: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 675 auditd root rtd unknown /proc/674/task/675/root (readlink: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 675 auditd root txt unknown /proc/674/task/675/exe (readlink: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 675 auditd root NOFD /proc/674/task/675/fd (opendir: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 677 auditd root cwd unknown /proc/674/task/677/cwd (readlink: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 677 auditd root rtd unknown /proc/674/task/677/root (readlink: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 677 auditd root txt unknown /proc/674/task/677/exe (readlink: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:auditd 674 677 auditd root NOFD /proc/674/task/677/fd (opendir: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:sedispatc 676 root cwd unknown /proc/676/cwd (readlink: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:sedispatc 676 root rtd unknown /proc/676/root (readlink: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:sedispatc 676 root txt unknown /proc/676/exe (readlink: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:sedispatc 676 root NOFD /proc/676/fd (opendir: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:dbus-brok 718 dbus cwd unknown /proc/718/cwd (readlink: Permission denied) 2024-09-21T01:16:05.733 INFO:tasks.workunit.client.0.smithi148.stdout:dbus-brok 718 dbus rtd unknown /proc/718/root (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:dbus-brok 718 dbus txt unknown /proc/718/exe (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:dbus-brok 718 dbus NOFD /proc/718/fd (opendir: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:dbus-brok 719 dbus cwd unknown /proc/719/cwd (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:dbus-brok 719 dbus rtd unknown /proc/719/root (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:dbus-brok 719 dbus txt unknown /proc/719/exe (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:dbus-brok 719 dbus NOFD /proc/719/fd (opendir: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 root cwd unknown /proc/720/cwd (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 root rtd unknown /proc/720/root (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 root txt unknown /proc/720/exe (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 root NOFD /proc/720/fd (opendir: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 737 gmain root cwd unknown /proc/720/task/737/cwd (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 737 gmain root rtd unknown /proc/720/task/737/root (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 737 gmain root txt unknown /proc/720/task/737/exe (readlink: Permission denied) 2024-09-21T01:16:05.734 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 737 gmain root NOFD /proc/720/task/737/fd (opendir: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 738 gdbus root cwd unknown /proc/720/task/738/cwd (readlink: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 738 gdbus root rtd unknown /proc/720/task/738/root (readlink: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 738 gdbus root txt unknown /proc/720/task/738/exe (readlink: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:NetworkMa 720 738 gdbus root NOFD /proc/720/task/738/fd (opendir: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:irqbalanc 723 root cwd unknown /proc/723/cwd (readlink: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:irqbalanc 723 root rtd unknown /proc/723/root (readlink: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:irqbalanc 723 root txt unknown /proc/723/exe (readlink: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:irqbalanc 723 root NOFD /proc/723/fd (opendir: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:irqbalanc 723 730 gmain root cwd unknown /proc/723/task/730/cwd (readlink: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:irqbalanc 723 730 gmain root rtd unknown /proc/723/task/730/root (readlink: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:irqbalanc 723 730 gmain root txt unknown /proc/723/task/730/exe (readlink: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:irqbalanc 723 730 gmain root NOFD /proc/723/task/730/fd (opendir: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:lsmd 724 libstoragemgmt cwd unknown /proc/724/cwd (readlink: Permission denied) 2024-09-21T01:16:05.735 INFO:tasks.workunit.client.0.smithi148.stdout:lsmd 724 libstoragemgmt rtd unknown /proc/724/root (readlink: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:lsmd 724 libstoragemgmt txt unknown /proc/724/exe (readlink: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:lsmd 724 libstoragemgmt NOFD /proc/724/fd (opendir: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:mcelog 725 root cwd unknown /proc/725/cwd (readlink: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:mcelog 725 root rtd unknown /proc/725/root (readlink: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:mcelog 725 root txt unknown /proc/725/exe (readlink: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:mcelog 725 root NOFD /proc/725/fd (opendir: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:smartd 727 root cwd unknown /proc/727/cwd (readlink: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:smartd 727 root rtd unknown /proc/727/root (readlink: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:smartd 727 root txt unknown /proc/727/exe (readlink: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:smartd 727 root NOFD /proc/727/fd (opendir: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-l 729 root cwd unknown /proc/729/cwd (readlink: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-l 729 root rtd unknown /proc/729/root (readlink: Permission denied) 2024-09-21T01:16:05.736 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-l 729 root txt unknown /proc/729/exe (readlink: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:systemd-l 729 root NOFD /proc/729/fd (opendir: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 761 root cwd unknown /proc/761/cwd (readlink: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 761 root rtd unknown /proc/761/root (readlink: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 761 root txt unknown /proc/761/exe (readlink: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 761 root NOFD /proc/761/fd (opendir: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 root cwd unknown /proc/776/cwd (readlink: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 root rtd unknown /proc/776/root (readlink: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 root txt unknown /proc/776/exe (readlink: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 root NOFD /proc/776/fd (opendir: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 777 gssproxy root cwd unknown /proc/776/task/777/cwd (readlink: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 777 gssproxy root rtd unknown /proc/776/task/777/root (readlink: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 777 gssproxy root txt unknown /proc/776/task/777/exe (readlink: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 777 gssproxy root NOFD /proc/776/task/777/fd (opendir: Permission denied) 2024-09-21T01:16:05.737 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 778 gssproxy root cwd unknown /proc/776/task/778/cwd (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 778 gssproxy root rtd unknown /proc/776/task/778/root (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 778 gssproxy root txt unknown /proc/776/task/778/exe (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 778 gssproxy root NOFD /proc/776/task/778/fd (opendir: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 779 gssproxy root cwd unknown /proc/776/task/779/cwd (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 779 gssproxy root rtd unknown /proc/776/task/779/root (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 779 gssproxy root txt unknown /proc/776/task/779/exe (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 779 gssproxy root NOFD /proc/776/task/779/fd (opendir: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 780 gssproxy root cwd unknown /proc/776/task/780/cwd (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 780 gssproxy root rtd unknown /proc/776/task/780/root (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 780 gssproxy root txt unknown /proc/776/task/780/exe (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 780 gssproxy root NOFD /proc/776/task/780/fd (opendir: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 781 gssproxy root cwd unknown /proc/776/task/781/cwd (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 781 gssproxy root rtd unknown /proc/776/task/781/root (readlink: Permission denied) 2024-09-21T01:16:05.738 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 781 gssproxy root txt unknown /proc/776/task/781/exe (readlink: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:gssproxy 776 781 gssproxy root NOFD /proc/776/task/781/fd (opendir: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:atd 783 root cwd unknown /proc/783/cwd (readlink: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:atd 783 root rtd unknown /proc/783/root (readlink: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:atd 783 root txt unknown /proc/783/exe (readlink: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:atd 783 root NOFD /proc/783/fd (opendir: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:crond 785 root cwd unknown /proc/785/cwd (readlink: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:crond 785 root rtd unknown /proc/785/root (readlink: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:crond 785 root txt unknown /proc/785/exe (readlink: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:crond 785 root NOFD /proc/785/fd (opendir: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:nrpe 811 nrpe cwd unknown /proc/811/cwd (readlink: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:nrpe 811 nrpe rtd unknown /proc/811/root (readlink: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:nrpe 811 nrpe txt unknown /proc/811/exe (readlink: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:nrpe 811 nrpe NOFD /proc/811/fd (opendir: Permission denied) 2024-09-21T01:16:05.739 INFO:tasks.workunit.client.0.smithi148.stdout:agetty 1222 root cwd unknown /proc/1222/cwd (readlink: Permission denied) 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:agetty 1222 root rtd unknown /proc/1222/root (readlink: Permission denied) 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:agetty 1222 root txt unknown /proc/1222/exe (readlink: Permission denied) 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:agetty 1222 root NOFD /proc/1222/fd (opendir: Permission denied) 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:agetty 1227 root cwd unknown /proc/1227/cwd (readlink: Permission denied) 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:agetty 1227 root rtd unknown /proc/1227/root (readlink: Permission denied) 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:agetty 1227 root txt unknown /proc/1227/exe (readlink: Permission denied) 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:agetty 1227 root NOFD /proc/1227/fd (opendir: Permission denied) 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu cwd DIR 8,1 4096 2 / 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu DEL REG 8,1 2229 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-21T01:16:05.740 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu DEL REG 8,1 2232 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-21T01:16:05.741 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-21T01:16:05.742 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 1u unix 0x0000000000000000 0t0 20971 type=STREAM (CONNECTED) 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 2u unix 0x0000000000000000 0t0 20971 type=STREAM (CONNECTED) 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 3u unix 0x0000000000000000 0t0 20999 type=DGRAM (CONNECTED) 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 4u a_inode 0,14 0 3105 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 5u a_inode 0,14 0 3105 [signalfd] 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 6r a_inode 0,14 0 3105 inotify 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 7r DIR 0,25 0 3417 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 8u a_inode 0,14 0 3105 [timerfd] 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 9u a_inode 0,14 0 3105 [eventpoll:10,13] 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 10r REG 0,20 0 20988 /proc/3027/mountinfo 2024-09-21T01:16:05.743 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 11r a_inode 0,14 0 3105 inotify 2024-09-21T01:16:05.744 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 12u unix 0x0000000000000000 0t0 2003 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-21T01:16:05.745 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 13r a_inode 0,14 0 3105 inotify 2024-09-21T01:16:05.745 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 14r REG 0,20 0 4026532068 /proc/swaps 2024-09-21T01:16:05.745 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 15u netlink 0t0 21009 KOBJECT_UEVENT 2024-09-21T01:16:05.745 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 16u unix 0x0000000000000000 0t0 21014 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-21T01:16:05.745 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 17u unix 0x0000000000000000 0t0 21015 type=DGRAM (CONNECTED) 2024-09-21T01:16:05.745 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 18u unix 0x0000000000000000 0t0 21016 type=DGRAM (CONNECTED) 2024-09-21T01:16:05.745 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 19u unix 0x0000000000000000 0t0 21017 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-21T01:16:05.745 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 20u unix 0x0000000000000000 0t0 21019 type=STREAM (CONNECTED) 2024-09-21T01:16:05.745 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 3027 ubuntu 21u a_inode 0,14 0 3105 [timerfd] 2024-09-21T01:16:05.745 INFO:tasks.workunit.client.0.smithi148.stdout:(sd-pam) 3035 ubuntu cwd unknown /proc/3035/cwd (readlink: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:(sd-pam) 3035 ubuntu rtd unknown /proc/3035/root (readlink: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:(sd-pam) 3035 ubuntu txt unknown /proc/3035/exe (readlink: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:(sd-pam) 3035 ubuntu NOFD /proc/3035/fd (opendir: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 root cwd unknown /proc/4921/cwd (readlink: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 root rtd unknown /proc/4921/root (readlink: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 root txt unknown /proc/4921/exe (readlink: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 root NOFD /proc/4921/fd (opendir: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 4982 in:imjour root cwd unknown /proc/4921/task/4982/cwd (readlink: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 4982 in:imjour root rtd unknown /proc/4921/task/4982/root (readlink: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 4982 in:imjour root txt unknown /proc/4921/task/4982/exe (readlink: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 4982 in:imjour root NOFD /proc/4921/task/4982/fd (opendir: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 4983 rs:main root cwd unknown /proc/4921/task/4983/cwd (readlink: Permission denied) 2024-09-21T01:16:05.746 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 4983 rs:main root rtd unknown /proc/4921/task/4983/root (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 4983 rs:main root txt unknown /proc/4921/task/4983/exe (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:rsyslogd 4921 4983 rs:main root NOFD /proc/4921/task/4983/fd (opendir: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 18650 root cwd unknown /proc/18650/cwd (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 18650 root rtd unknown /proc/18650/root (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 18650 root txt unknown /proc/18650/exe (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 18650 root NOFD /proc/18650/fd (opendir: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 polkitd cwd unknown /proc/19213/cwd (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 polkitd rtd unknown /proc/19213/root (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 polkitd txt unknown /proc/19213/exe (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 polkitd NOFD /proc/19213/fd (opendir: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19215 gmain polkitd cwd unknown /proc/19213/task/19215/cwd (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19215 gmain polkitd rtd unknown /proc/19213/task/19215/root (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19215 gmain polkitd txt unknown /proc/19213/task/19215/exe (readlink: Permission denied) 2024-09-21T01:16:05.747 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19215 gmain polkitd NOFD /proc/19213/task/19215/fd (opendir: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19216 gdbus polkitd cwd unknown /proc/19213/task/19216/cwd (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19216 gdbus polkitd rtd unknown /proc/19213/task/19216/root (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19216 gdbus polkitd txt unknown /proc/19213/task/19216/exe (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19216 gdbus polkitd NOFD /proc/19213/task/19216/fd (opendir: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19217 JS\x20Hel polkitd cwd unknown /proc/19213/task/19217/cwd (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19217 JS\x20Hel polkitd rtd unknown /proc/19213/task/19217/root (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19217 JS\x20Hel polkitd txt unknown /proc/19213/task/19217/exe (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19217 JS\x20Hel polkitd NOFD /proc/19213/task/19217/fd (opendir: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19218 JS\x20Hel polkitd cwd unknown /proc/19213/task/19218/cwd (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19218 JS\x20Hel polkitd rtd unknown /proc/19213/task/19218/root (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19218 JS\x20Hel polkitd txt unknown /proc/19213/task/19218/exe (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19218 JS\x20Hel polkitd NOFD /proc/19213/task/19218/fd (opendir: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19219 JS\x20Hel polkitd cwd unknown /proc/19213/task/19219/cwd (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19219 JS\x20Hel polkitd rtd unknown /proc/19213/task/19219/root (readlink: Permission denied) 2024-09-21T01:16:05.748 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19219 JS\x20Hel polkitd txt unknown /proc/19213/task/19219/exe (readlink: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19219 JS\x20Hel polkitd NOFD /proc/19213/task/19219/fd (opendir: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19220 JS\x20Hel polkitd cwd unknown /proc/19213/task/19220/cwd (readlink: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19220 JS\x20Hel polkitd rtd unknown /proc/19213/task/19220/root (readlink: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19220 JS\x20Hel polkitd txt unknown /proc/19213/task/19220/exe (readlink: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19220 JS\x20Hel polkitd NOFD /proc/19213/task/19220/fd (opendir: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19221 JS\x20Hel polkitd cwd unknown /proc/19213/task/19221/cwd (readlink: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19221 JS\x20Hel polkitd rtd unknown /proc/19213/task/19221/root (readlink: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19221 JS\x20Hel polkitd txt unknown /proc/19213/task/19221/exe (readlink: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19221 JS\x20Hel polkitd NOFD /proc/19213/task/19221/fd (opendir: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19222 JS\x20Hel polkitd cwd unknown /proc/19213/task/19222/cwd (readlink: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19222 JS\x20Hel polkitd rtd unknown /proc/19213/task/19222/root (readlink: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19222 JS\x20Hel polkitd txt unknown /proc/19213/task/19222/exe (readlink: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19222 JS\x20Hel polkitd NOFD /proc/19213/task/19222/fd (opendir: Permission denied) 2024-09-21T01:16:05.749 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19223 JS\x20Hel polkitd cwd unknown /proc/19213/task/19223/cwd (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19223 JS\x20Hel polkitd rtd unknown /proc/19213/task/19223/root (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19223 JS\x20Hel polkitd txt unknown /proc/19213/task/19223/exe (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19223 JS\x20Hel polkitd NOFD /proc/19213/task/19223/fd (opendir: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19224 JS\x20Hel polkitd cwd unknown /proc/19213/task/19224/cwd (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19224 JS\x20Hel polkitd rtd unknown /proc/19213/task/19224/root (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19224 JS\x20Hel polkitd txt unknown /proc/19213/task/19224/exe (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19224 JS\x20Hel polkitd NOFD /proc/19213/task/19224/fd (opendir: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19225 polkitd polkitd cwd unknown /proc/19213/task/19225/cwd (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19225 polkitd polkitd rtd unknown /proc/19213/task/19225/root (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19225 polkitd polkitd txt unknown /proc/19213/task/19225/exe (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:polkitd 19213 19225 polkitd polkitd NOFD /proc/19213/task/19225/fd (opendir: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21121 root cwd unknown /proc/21121/cwd (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21121 root rtd unknown /proc/21121/root (readlink: Permission denied) 2024-09-21T01:16:05.750 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21121 root txt unknown /proc/21121/exe (readlink: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21121 root NOFD /proc/21121/fd (opendir: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21150 root cwd unknown /proc/21150/cwd (readlink: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21150 root rtd unknown /proc/21150/root (readlink: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21150 root txt unknown /proc/21150/exe (readlink: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21150 root NOFD /proc/21150/fd (opendir: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21179 root cwd unknown /proc/21179/cwd (readlink: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21179 root rtd unknown /proc/21179/root (readlink: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21179 root txt unknown /proc/21179/exe (readlink: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21179 root NOFD /proc/21179/fd (opendir: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21208 root cwd unknown /proc/21208/cwd (readlink: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21208 root rtd unknown /proc/21208/root (readlink: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21208 root txt unknown /proc/21208/exe (readlink: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21208 root NOFD /proc/21208/fd (opendir: Permission denied) 2024-09-21T01:16:05.751 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21237 root cwd unknown /proc/21237/cwd (readlink: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21237 root rtd unknown /proc/21237/root (readlink: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21237 root txt unknown /proc/21237/exe (readlink: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21237 root NOFD /proc/21237/fd (opendir: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21401 root cwd unknown /proc/21401/cwd (readlink: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21401 root rtd unknown /proc/21401/root (readlink: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21401 root txt unknown /proc/21401/exe (readlink: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21401 root NOFD /proc/21401/fd (opendir: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21402 root cwd unknown /proc/21402/cwd (readlink: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21402 root rtd unknown /proc/21402/root (readlink: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21402 root txt unknown /proc/21402/exe (readlink: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21402 root NOFD /proc/21402/fd (opendir: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21403 root cwd unknown /proc/21403/cwd (readlink: Permission denied) 2024-09-21T01:16:05.752 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21403 root rtd unknown /proc/21403/root (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21403 root txt unknown /proc/21403/exe (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21403 root NOFD /proc/21403/fd (opendir: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21404 root cwd unknown /proc/21404/cwd (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21404 root rtd unknown /proc/21404/root (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21404 root txt unknown /proc/21404/exe (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21404 root NOFD /proc/21404/fd (opendir: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21405 root cwd unknown /proc/21405/cwd (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21405 root rtd unknown /proc/21405/root (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21405 root txt unknown /proc/21405/exe (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21405 root NOFD /proc/21405/fd (opendir: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21406 root cwd unknown /proc/21406/cwd (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21406 root rtd unknown /proc/21406/root (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21406 root txt unknown /proc/21406/exe (readlink: Permission denied) 2024-09-21T01:16:05.753 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21406 root NOFD /proc/21406/fd (opendir: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21407 root cwd unknown /proc/21407/cwd (readlink: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21407 root rtd unknown /proc/21407/root (readlink: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21407 root txt unknown /proc/21407/exe (readlink: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21407 root NOFD /proc/21407/fd (opendir: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21408 root cwd unknown /proc/21408/cwd (readlink: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21408 root rtd unknown /proc/21408/root (readlink: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21408 root txt unknown /proc/21408/exe (readlink: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21408 root NOFD /proc/21408/fd (opendir: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21409 root cwd unknown /proc/21409/cwd (readlink: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21409 root rtd unknown /proc/21409/root (readlink: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21409 root txt unknown /proc/21409/exe (readlink: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 21409 root NOFD /proc/21409/fd (opendir: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:xfsaild/d 21410 root cwd unknown /proc/21410/cwd (readlink: Permission denied) 2024-09-21T01:16:05.754 INFO:tasks.workunit.client.0.smithi148.stdout:xfsaild/d 21410 root rtd unknown /proc/21410/root (readlink: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:xfsaild/d 21410 root txt unknown /proc/21410/exe (readlink: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:xfsaild/d 21410 root NOFD /proc/21410/fd (opendir: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 22343 root cwd unknown /proc/22343/cwd (readlink: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 22343 root rtd unknown /proc/22343/root (readlink: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 22343 root txt unknown /proc/22343/exe (readlink: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 22343 root NOFD /proc/22343/fd (opendir: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 22346 ubuntu cwd unknown /proc/22346/cwd (readlink: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 22346 ubuntu rtd unknown /proc/22346/root (readlink: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 22346 ubuntu txt unknown /proc/22346/exe (readlink: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 22346 ubuntu NOFD /proc/22346/fd (opendir: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:chronyd 22406 chrony cwd unknown /proc/22406/cwd (readlink: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:chronyd 22406 chrony rtd unknown /proc/22406/root (readlink: Permission denied) 2024-09-21T01:16:05.755 INFO:tasks.workunit.client.0.smithi148.stdout:chronyd 22406 chrony txt unknown /proc/22406/exe (readlink: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:chronyd 22406 chrony NOFD /proc/22406/fd (opendir: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:anacron 22560 root cwd unknown /proc/22560/cwd (readlink: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:anacron 22560 root rtd unknown /proc/22560/root (readlink: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:anacron 22560 root txt unknown /proc/22560/exe (readlink: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:anacron 22560 root NOFD /proc/22560/fd (opendir: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 22726 root cwd unknown /proc/22726/cwd (readlink: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 22726 root rtd unknown /proc/22726/root (readlink: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 22726 root txt unknown /proc/22726/exe (readlink: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 22726 root NOFD /proc/22726/fd (opendir: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-cras 22734 ceph cwd unknown /proc/22734/cwd (readlink: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-cras 22734 ceph rtd unknown /proc/22734/root (readlink: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-cras 22734 ceph txt unknown /proc/22734/exe (readlink: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-cras 22734 ceph NOFD /proc/22734/fd (opendir: Permission denied) 2024-09-21T01:16:05.756 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 24437 root cwd unknown /proc/24437/cwd (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 24437 root rtd unknown /proc/24437/root (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 24437 root txt unknown /proc/24437/exe (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 24437 root NOFD /proc/24437/fd (opendir: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 24438 root cwd unknown /proc/24438/cwd (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 24438 root rtd unknown /proc/24438/root (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 24438 root txt unknown /proc/24438/exe (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 24438 root NOFD /proc/24438/fd (opendir: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 29935 root cwd unknown /proc/29935/cwd (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 29935 root rtd unknown /proc/29935/root (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 29935 root txt unknown /proc/29935/exe (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 29935 root NOFD /proc/29935/fd (opendir: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 29988 root cwd unknown /proc/29988/cwd (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 29988 root rtd unknown /proc/29988/root (readlink: Permission denied) 2024-09-21T01:16:05.757 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 29988 root txt unknown /proc/29988/exe (readlink: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 29988 root NOFD /proc/29988/fd (opendir: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 30005 root cwd unknown /proc/30005/cwd (readlink: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 30005 root rtd unknown /proc/30005/root (readlink: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 30005 root txt unknown /proc/30005/exe (readlink: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 30005 root NOFD /proc/30005/fd (opendir: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 30006 root cwd unknown /proc/30006/cwd (readlink: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 30006 root rtd unknown /proc/30006/root (readlink: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 30006 root txt unknown /proc/30006/exe (readlink: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 30006 root NOFD /proc/30006/fd (opendir: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 30023 root cwd unknown /proc/30023/cwd (readlink: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 30023 root rtd unknown /proc/30023/root (readlink: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 30023 root txt unknown /proc/30023/exe (readlink: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 30023 root NOFD /proc/30023/fd (opendir: Permission denied) 2024-09-21T01:16:05.758 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 30265 root cwd unknown /proc/30265/cwd (readlink: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 30265 root rtd unknown /proc/30265/root (readlink: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 30265 root txt unknown /proc/30265/exe (readlink: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 30265 root NOFD /proc/30265/fd (opendir: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 30845 root cwd unknown /proc/30845/cwd (readlink: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 30845 root rtd unknown /proc/30845/root (readlink: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 30845 root txt unknown /proc/30845/exe (readlink: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 30845 root NOFD /proc/30845/fd (opendir: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 30945 root cwd unknown /proc/30945/cwd (readlink: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 30945 root rtd unknown /proc/30945/root (readlink: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 30945 root txt unknown /proc/30945/exe (readlink: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 30945 root NOFD /proc/30945/fd (opendir: Permission denied) 2024-09-21T01:16:05.759 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 30996 root cwd unknown /proc/30996/cwd (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 30996 root rtd unknown /proc/30996/root (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 30996 root txt unknown /proc/30996/exe (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 30996 root NOFD /proc/30996/fd (opendir: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 30998 root cwd unknown /proc/30998/cwd (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 30998 root rtd unknown /proc/30998/root (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 30998 root txt unknown /proc/30998/exe (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 30998 root NOFD /proc/30998/fd (opendir: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 ceph cwd unknown /proc/31000/cwd (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 ceph rtd unknown /proc/31000/root (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 ceph txt unknown /proc/31000/exe (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 ceph NOFD /proc/31000/fd (opendir: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31001 log ceph cwd unknown /proc/31000/task/31001/cwd (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31001 log ceph rtd unknown /proc/31000/task/31001/root (readlink: Permission denied) 2024-09-21T01:16:05.760 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31001 log ceph txt unknown /proc/31000/task/31001/exe (readlink: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31001 log ceph NOFD /proc/31000/task/31001/fd (opendir: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31002 service ceph cwd unknown /proc/31000/task/31002/cwd (readlink: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31002 service ceph rtd unknown /proc/31000/task/31002/root (readlink: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31002 service ceph txt unknown /proc/31000/task/31002/exe (readlink: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31002 service ceph NOFD /proc/31000/task/31002/fd (opendir: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31003 admin_soc ceph cwd unknown /proc/31000/task/31003/cwd (readlink: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31003 admin_soc ceph rtd unknown /proc/31000/task/31003/root (readlink: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31003 admin_soc ceph txt unknown /proc/31000/task/31003/exe (readlink: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31003 admin_soc ceph NOFD /proc/31000/task/31003/fd (opendir: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31004 signal_ha ceph cwd unknown /proc/31000/task/31004/cwd (readlink: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31004 signal_ha ceph rtd unknown /proc/31000/task/31004/root (readlink: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31004 signal_ha ceph txt unknown /proc/31000/task/31004/exe (readlink: Permission denied) 2024-09-21T01:16:05.761 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31004 signal_ha ceph NOFD /proc/31000/task/31004/fd (opendir: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31005 rocksdb:l ceph cwd unknown /proc/31000/task/31005/cwd (readlink: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31005 rocksdb:l ceph rtd unknown /proc/31000/task/31005/root (readlink: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31005 rocksdb:l ceph txt unknown /proc/31000/task/31005/exe (readlink: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31005 rocksdb:l ceph NOFD /proc/31000/task/31005/fd (opendir: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31006 rocksdb:h ceph cwd unknown /proc/31000/task/31006/cwd (readlink: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31006 rocksdb:h ceph rtd unknown /proc/31000/task/31006/root (readlink: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31006 rocksdb:h ceph txt unknown /proc/31000/task/31006/exe (readlink: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31006 rocksdb:h ceph NOFD /proc/31000/task/31006/fd (opendir: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31022 ceph-mon ceph cwd unknown /proc/31000/task/31022/cwd (readlink: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31022 ceph-mon ceph rtd unknown /proc/31000/task/31022/root (readlink: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31022 ceph-mon ceph txt unknown /proc/31000/task/31022/exe (readlink: Permission denied) 2024-09-21T01:16:05.762 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31022 ceph-mon ceph NOFD /proc/31000/task/31022/fd (opendir: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31023 fn_monsto ceph cwd unknown /proc/31000/task/31023/cwd (readlink: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31023 fn_monsto ceph rtd unknown /proc/31000/task/31023/root (readlink: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31023 fn_monsto ceph txt unknown /proc/31000/task/31023/exe (readlink: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31023 fn_monsto ceph NOFD /proc/31000/task/31023/fd (opendir: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31024 msgr-work ceph cwd unknown /proc/31000/task/31024/cwd (readlink: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31024 msgr-work ceph rtd unknown /proc/31000/task/31024/root (readlink: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31024 msgr-work ceph txt unknown /proc/31000/task/31024/exe (readlink: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31024 msgr-work ceph NOFD /proc/31000/task/31024/fd (opendir: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31025 msgr-work ceph cwd unknown /proc/31000/task/31025/cwd (readlink: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31025 msgr-work ceph rtd unknown /proc/31000/task/31025/root (readlink: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31025 msgr-work ceph txt unknown /proc/31000/task/31025/exe (readlink: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31025 msgr-work ceph NOFD /proc/31000/task/31025/fd (opendir: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31026 msgr-work ceph cwd unknown /proc/31000/task/31026/cwd (readlink: Permission denied) 2024-09-21T01:16:05.763 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31026 msgr-work ceph rtd unknown /proc/31000/task/31026/root (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31026 msgr-work ceph txt unknown /proc/31000/task/31026/exe (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31026 msgr-work ceph NOFD /proc/31000/task/31026/fd (opendir: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31027 OpHistory ceph cwd unknown /proc/31000/task/31027/cwd (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31027 OpHistory ceph rtd unknown /proc/31000/task/31027/root (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31027 OpHistory ceph txt unknown /proc/31000/task/31027/exe (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31027 OpHistory ceph NOFD /proc/31000/task/31027/fd (opendir: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31028 fin ceph cwd unknown /proc/31000/task/31028/cwd (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31028 fin ceph rtd unknown /proc/31000/task/31028/root (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31028 fin ceph txt unknown /proc/31000/task/31028/exe (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31028 fin ceph NOFD /proc/31000/task/31028/fd (opendir: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31029 safe_time ceph cwd unknown /proc/31000/task/31029/cwd (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31029 safe_time ceph rtd unknown /proc/31000/task/31029/root (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31029 safe_time ceph txt unknown /proc/31000/task/31029/exe (readlink: Permission denied) 2024-09-21T01:16:05.764 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31029 safe_time ceph NOFD /proc/31000/task/31029/fd (opendir: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31030 cpu_tp ceph cwd unknown /proc/31000/task/31030/cwd (readlink: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31030 cpu_tp ceph rtd unknown /proc/31000/task/31030/root (readlink: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31030 cpu_tp ceph txt unknown /proc/31000/task/31030/exe (readlink: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31030 cpu_tp ceph NOFD /proc/31000/task/31030/fd (opendir: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31031 cpu_tp ceph cwd unknown /proc/31000/task/31031/cwd (readlink: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31031 cpu_tp ceph rtd unknown /proc/31000/task/31031/root (readlink: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31031 cpu_tp ceph txt unknown /proc/31000/task/31031/exe (readlink: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31031 cpu_tp ceph NOFD /proc/31000/task/31031/fd (opendir: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31032 cpu_tp ceph cwd unknown /proc/31000/task/31032/cwd (readlink: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31032 cpu_tp ceph rtd unknown /proc/31000/task/31032/root (readlink: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31032 cpu_tp ceph txt unknown /proc/31000/task/31032/exe (readlink: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31032 cpu_tp ceph NOFD /proc/31000/task/31032/fd (opendir: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31033 cpu_tp ceph cwd unknown /proc/31000/task/31033/cwd (readlink: Permission denied) 2024-09-21T01:16:05.765 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31033 cpu_tp ceph rtd unknown /proc/31000/task/31033/root (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31033 cpu_tp ceph txt unknown /proc/31000/task/31033/exe (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31033 cpu_tp ceph NOFD /proc/31000/task/31033/fd (opendir: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31034 ms_dispat ceph cwd unknown /proc/31000/task/31034/cwd (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31034 ms_dispat ceph rtd unknown /proc/31000/task/31034/root (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31034 ms_dispat ceph txt unknown /proc/31000/task/31034/exe (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31034 ms_dispat ceph NOFD /proc/31000/task/31034/fd (opendir: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31035 ms_local ceph cwd unknown /proc/31000/task/31035/cwd (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31035 ms_local ceph rtd unknown /proc/31000/task/31035/root (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31035 ms_local ceph txt unknown /proc/31000/task/31035/exe (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31035 ms_local ceph NOFD /proc/31000/task/31035/fd (opendir: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31036 safe_time ceph cwd unknown /proc/31000/task/31036/cwd (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31036 safe_time ceph rtd unknown /proc/31000/task/31036/root (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31036 safe_time ceph txt unknown /proc/31000/task/31036/exe (readlink: Permission denied) 2024-09-21T01:16:05.766 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31036 safe_time ceph NOFD /proc/31000/task/31036/fd (opendir: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31037 ms_dispat ceph cwd unknown /proc/31000/task/31037/cwd (readlink: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31037 ms_dispat ceph rtd unknown /proc/31000/task/31037/root (readlink: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31037 ms_dispat ceph txt unknown /proc/31000/task/31037/exe (readlink: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31037 ms_dispat ceph NOFD /proc/31000/task/31037/fd (opendir: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31038 ms_local ceph cwd unknown /proc/31000/task/31038/cwd (readlink: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31038 ms_local ceph rtd unknown /proc/31000/task/31038/root (readlink: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31038 ms_local ceph txt unknown /proc/31000/task/31038/exe (readlink: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 31038 ms_local ceph NOFD /proc/31000/task/31038/fd (opendir: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 69760 rstore_co ceph cwd unknown /proc/31000/task/69760/cwd (readlink: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 69760 rstore_co ceph rtd unknown /proc/31000/task/69760/root (readlink: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 69760 rstore_co ceph txt unknown /proc/31000/task/69760/exe (readlink: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mon 31000 69760 rstore_co ceph NOFD /proc/31000/task/69760/fd (opendir: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 31228 root cwd unknown /proc/31228/cwd (readlink: Permission denied) 2024-09-21T01:16:05.767 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 31228 root rtd unknown /proc/31228/root (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 31228 root txt unknown /proc/31228/exe (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 31228 root NOFD /proc/31228/fd (opendir: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 31230 root cwd unknown /proc/31230/cwd (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 31230 root rtd unknown /proc/31230/root (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 31230 root txt unknown /proc/31230/exe (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 31230 root NOFD /proc/31230/fd (opendir: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 ceph cwd unknown /proc/31232/cwd (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 ceph rtd unknown /proc/31232/root (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 ceph txt unknown /proc/31232/exe (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 ceph NOFD /proc/31232/fd (opendir: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33312 log ceph cwd unknown /proc/31232/task/33312/cwd (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33312 log ceph rtd unknown /proc/31232/task/33312/root (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33312 log ceph txt unknown /proc/31232/task/33312/exe (readlink: Permission denied) 2024-09-21T01:16:05.768 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33312 log ceph NOFD /proc/31232/task/33312/fd (opendir: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33314 msgr-work ceph cwd unknown /proc/31232/task/33314/cwd (readlink: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33314 msgr-work ceph rtd unknown /proc/31232/task/33314/root (readlink: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33314 msgr-work ceph txt unknown /proc/31232/task/33314/exe (readlink: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33314 msgr-work ceph NOFD /proc/31232/task/33314/fd (opendir: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33315 msgr-work ceph cwd unknown /proc/31232/task/33315/cwd (readlink: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33315 msgr-work ceph rtd unknown /proc/31232/task/33315/root (readlink: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33315 msgr-work ceph txt unknown /proc/31232/task/33315/exe (readlink: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33315 msgr-work ceph NOFD /proc/31232/task/33315/fd (opendir: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33316 msgr-work ceph cwd unknown /proc/31232/task/33316/cwd (readlink: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33316 msgr-work ceph rtd unknown /proc/31232/task/33316/root (readlink: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33316 msgr-work ceph txt unknown /proc/31232/task/33316/exe (readlink: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33316 msgr-work ceph NOFD /proc/31232/task/33316/fd (opendir: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33320 service ceph cwd unknown /proc/31232/task/33320/cwd (readlink: Permission denied) 2024-09-21T01:16:05.769 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33320 service ceph rtd unknown /proc/31232/task/33320/root (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33320 service ceph txt unknown /proc/31232/task/33320/exe (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33320 service ceph NOFD /proc/31232/task/33320/fd (opendir: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33321 admin_soc ceph cwd unknown /proc/31232/task/33321/cwd (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33321 admin_soc ceph rtd unknown /proc/31232/task/33321/root (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33321 admin_soc ceph txt unknown /proc/31232/task/33321/exe (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33321 admin_soc ceph NOFD /proc/31232/task/33321/fd (opendir: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33322 ceph_time ceph cwd unknown /proc/31232/task/33322/cwd (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33322 ceph_time ceph rtd unknown /proc/31232/task/33322/root (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33322 ceph_time ceph txt unknown /proc/31232/task/33322/exe (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33322 ceph_time ceph NOFD /proc/31232/task/33322/fd (opendir: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33323 fn_anonym ceph cwd unknown /proc/31232/task/33323/cwd (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33323 fn_anonym ceph rtd unknown /proc/31232/task/33323/root (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33323 fn_anonym ceph txt unknown /proc/31232/task/33323/exe (readlink: Permission denied) 2024-09-21T01:16:05.770 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33323 fn_anonym ceph NOFD /proc/31232/task/33323/fd (opendir: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33324 signal_ha ceph cwd unknown /proc/31232/task/33324/cwd (readlink: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33324 signal_ha ceph rtd unknown /proc/31232/task/33324/root (readlink: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33324 signal_ha ceph txt unknown /proc/31232/task/33324/exe (readlink: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33324 signal_ha ceph NOFD /proc/31232/task/33324/fd (opendir: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33325 mgrsb-fin ceph cwd unknown /proc/31232/task/33325/cwd (readlink: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33325 mgrsb-fin ceph rtd unknown /proc/31232/task/33325/root (readlink: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33325 mgrsb-fin ceph txt unknown /proc/31232/task/33325/exe (readlink: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33325 mgrsb-fin ceph NOFD /proc/31232/task/33325/fd (opendir: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33326 ms_dispat ceph cwd unknown /proc/31232/task/33326/cwd (readlink: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33326 ms_dispat ceph rtd unknown /proc/31232/task/33326/root (readlink: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33326 ms_dispat ceph txt unknown /proc/31232/task/33326/exe (readlink: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33326 ms_dispat ceph NOFD /proc/31232/task/33326/fd (opendir: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33327 ms_local ceph cwd unknown /proc/31232/task/33327/cwd (readlink: Permission denied) 2024-09-21T01:16:05.771 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33327 ms_local ceph rtd unknown /proc/31232/task/33327/root (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33327 ms_local ceph txt unknown /proc/31232/task/33327/exe (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33327 ms_local ceph NOFD /proc/31232/task/33327/fd (opendir: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33328 io_contex ceph cwd unknown /proc/31232/task/33328/cwd (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33328 io_contex ceph rtd unknown /proc/31232/task/33328/root (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33328 io_contex ceph txt unknown /proc/31232/task/33328/exe (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33328 io_contex ceph NOFD /proc/31232/task/33328/fd (opendir: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33329 io_contex ceph cwd unknown /proc/31232/task/33329/cwd (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33329 io_contex ceph rtd unknown /proc/31232/task/33329/root (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33329 io_contex ceph txt unknown /proc/31232/task/33329/exe (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33329 io_contex ceph NOFD /proc/31232/task/33329/fd (opendir: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33330 safe_time ceph cwd unknown /proc/31232/task/33330/cwd (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33330 safe_time ceph rtd unknown /proc/31232/task/33330/root (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33330 safe_time ceph txt unknown /proc/31232/task/33330/exe (readlink: Permission denied) 2024-09-21T01:16:05.772 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33330 safe_time ceph NOFD /proc/31232/task/33330/fd (opendir: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33331 safe_time ceph cwd unknown /proc/31232/task/33331/cwd (readlink: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33331 safe_time ceph rtd unknown /proc/31232/task/33331/root (readlink: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33331 safe_time ceph txt unknown /proc/31232/task/33331/exe (readlink: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33331 safe_time ceph NOFD /proc/31232/task/33331/fd (opendir: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33332 safe_time ceph cwd unknown /proc/31232/task/33332/cwd (readlink: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33332 safe_time ceph rtd unknown /proc/31232/task/33332/root (readlink: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33332 safe_time ceph txt unknown /proc/31232/task/33332/exe (readlink: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33332 safe_time ceph NOFD /proc/31232/task/33332/fd (opendir: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33333 fn_anonym ceph cwd unknown /proc/31232/task/33333/cwd (readlink: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33333 fn_anonym ceph rtd unknown /proc/31232/task/33333/root (readlink: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33333 fn_anonym ceph txt unknown /proc/31232/task/33333/exe (readlink: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33333 fn_anonym ceph NOFD /proc/31232/task/33333/fd (opendir: Permission denied) 2024-09-21T01:16:05.773 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33334 flusher ceph cwd unknown /proc/31232/task/33334/cwd (readlink: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33334 flusher ceph rtd unknown /proc/31232/task/33334/root (readlink: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33334 flusher ceph txt unknown /proc/31232/task/33334/exe (readlink: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33334 flusher ceph NOFD /proc/31232/task/33334/fd (opendir: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33335 safe_time ceph cwd unknown /proc/31232/task/33335/cwd (readlink: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33335 safe_time ceph rtd unknown /proc/31232/task/33335/root (readlink: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33335 safe_time ceph txt unknown /proc/31232/task/33335/exe (readlink: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33335 safe_time ceph NOFD /proc/31232/task/33335/fd (opendir: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33446 OpHistory ceph cwd unknown /proc/31232/task/33446/cwd (readlink: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33446 OpHistory ceph rtd unknown /proc/31232/task/33446/root (readlink: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33446 OpHistory ceph txt unknown /proc/31232/task/33446/exe (readlink: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33446 OpHistory ceph NOFD /proc/31232/task/33446/fd (opendir: Permission denied) 2024-09-21T01:16:05.774 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33447 mgr-fin ceph cwd unknown /proc/31232/task/33447/cwd (readlink: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33447 mgr-fin ceph rtd unknown /proc/31232/task/33447/root (readlink: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33447 mgr-fin ceph txt unknown /proc/31232/task/33447/exe (readlink: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33447 mgr-fin ceph NOFD /proc/31232/task/33447/fd (opendir: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33448 ms_dispat ceph cwd unknown /proc/31232/task/33448/cwd (readlink: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33448 ms_dispat ceph rtd unknown /proc/31232/task/33448/root (readlink: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33448 ms_dispat ceph txt unknown /proc/31232/task/33448/exe (readlink: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33448 ms_dispat ceph NOFD /proc/31232/task/33448/fd (opendir: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33449 ms_local ceph cwd unknown /proc/31232/task/33449/cwd (readlink: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33449 ms_local ceph rtd unknown /proc/31232/task/33449/root (readlink: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33449 ms_local ceph txt unknown /proc/31232/task/33449/exe (readlink: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33449 ms_local ceph NOFD /proc/31232/task/33449/fd (opendir: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33450 safe_time ceph cwd unknown /proc/31232/task/33450/cwd (readlink: Permission denied) 2024-09-21T01:16:05.775 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33450 safe_time ceph rtd unknown /proc/31232/task/33450/root (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33450 safe_time ceph txt unknown /proc/31232/task/33450/exe (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33450 safe_time ceph NOFD /proc/31232/task/33450/fd (opendir: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33451 cmdfin ceph cwd unknown /proc/31232/task/33451/cwd (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33451 cmdfin ceph rtd unknown /proc/31232/task/33451/root (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33451 cmdfin ceph txt unknown /proc/31232/task/33451/exe (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33451 cmdfin ceph NOFD /proc/31232/task/33451/fd (opendir: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33455 io_contex ceph cwd unknown /proc/31232/task/33455/cwd (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33455 io_contex ceph rtd unknown /proc/31232/task/33455/root (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33455 io_contex ceph txt unknown /proc/31232/task/33455/exe (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33455 io_contex ceph NOFD /proc/31232/task/33455/fd (opendir: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33456 io_contex ceph cwd unknown /proc/31232/task/33456/cwd (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33456 io_contex ceph rtd unknown /proc/31232/task/33456/root (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33456 io_contex ceph txt unknown /proc/31232/task/33456/exe (readlink: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33456 io_contex ceph NOFD /proc/31232/task/33456/fd (opendir: Permission denied) 2024-09-21T01:16:05.776 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33457 ceph_time ceph cwd unknown /proc/31232/task/33457/cwd (readlink: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33457 ceph_time ceph rtd unknown /proc/31232/task/33457/root (readlink: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33457 ceph_time ceph txt unknown /proc/31232/task/33457/exe (readlink: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33457 ceph_time ceph NOFD /proc/31232/task/33457/fd (opendir: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33458 ms_dispat ceph cwd unknown /proc/31232/task/33458/cwd (readlink: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33458 ms_dispat ceph rtd unknown /proc/31232/task/33458/root (readlink: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33458 ms_dispat ceph txt unknown /proc/31232/task/33458/exe (readlink: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33458 ms_dispat ceph NOFD /proc/31232/task/33458/fd (opendir: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33459 ms_local ceph cwd unknown /proc/31232/task/33459/cwd (readlink: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33459 ms_local ceph rtd unknown /proc/31232/task/33459/root (readlink: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33459 ms_local ceph txt unknown /proc/31232/task/33459/exe (readlink: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33459 ms_local ceph NOFD /proc/31232/task/33459/fd (opendir: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33460 safe_time ceph cwd unknown /proc/31232/task/33460/cwd (readlink: Permission denied) 2024-09-21T01:16:05.777 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33460 safe_time ceph rtd unknown /proc/31232/task/33460/root (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33460 safe_time ceph txt unknown /proc/31232/task/33460/exe (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33460 safe_time ceph NOFD /proc/31232/task/33460/fd (opendir: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33461 safe_time ceph cwd unknown /proc/31232/task/33461/cwd (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33461 safe_time ceph rtd unknown /proc/31232/task/33461/root (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33461 safe_time ceph txt unknown /proc/31232/task/33461/exe (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33461 safe_time ceph NOFD /proc/31232/task/33461/fd (opendir: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33462 balancer ceph cwd unknown /proc/31232/task/33462/cwd (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33462 balancer ceph rtd unknown /proc/31232/task/33462/root (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33462 balancer ceph txt unknown /proc/31232/task/33462/exe (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33462 balancer ceph NOFD /proc/31232/task/33462/fd (opendir: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33463 m-fin-bal ceph cwd unknown /proc/31232/task/33463/cwd (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33463 m-fin-bal ceph rtd unknown /proc/31232/task/33463/root (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33463 m-fin-bal ceph txt unknown /proc/31232/task/33463/exe (readlink: Permission denied) 2024-09-21T01:16:05.778 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33463 m-fin-bal ceph NOFD /proc/31232/task/33463/fd (opendir: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33464 mgr-fin ceph cwd unknown /proc/31232/task/33464/cwd (readlink: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33464 mgr-fin ceph rtd unknown /proc/31232/task/33464/root (readlink: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33464 mgr-fin ceph txt unknown /proc/31232/task/33464/exe (readlink: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33464 mgr-fin ceph NOFD /proc/31232/task/33464/fd (opendir: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33465 mgr-fin ceph cwd unknown /proc/31232/task/33465/cwd (readlink: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33465 mgr-fin ceph rtd unknown /proc/31232/task/33465/root (readlink: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33465 mgr-fin ceph txt unknown /proc/31232/task/33465/exe (readlink: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33465 mgr-fin ceph NOFD /proc/31232/task/33465/fd (opendir: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33466 mgr-fin ceph cwd unknown /proc/31232/task/33466/cwd (readlink: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33466 mgr-fin ceph rtd unknown /proc/31232/task/33466/root (readlink: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33466 mgr-fin ceph txt unknown /proc/31232/task/33466/exe (readlink: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33466 mgr-fin ceph NOFD /proc/31232/task/33466/fd (opendir: Permission denied) 2024-09-21T01:16:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33467 mgr-fin ceph cwd unknown /proc/31232/task/33467/cwd (readlink: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33467 mgr-fin ceph rtd unknown /proc/31232/task/33467/root (readlink: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33467 mgr-fin ceph txt unknown /proc/31232/task/33467/exe (readlink: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33467 mgr-fin ceph NOFD /proc/31232/task/33467/fd (opendir: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33468 mgr-fin ceph cwd unknown /proc/31232/task/33468/cwd (readlink: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33468 mgr-fin ceph rtd unknown /proc/31232/task/33468/root (readlink: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33468 mgr-fin ceph txt unknown /proc/31232/task/33468/exe (readlink: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33468 mgr-fin ceph NOFD /proc/31232/task/33468/fd (opendir: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33469 mgr-fin ceph cwd unknown /proc/31232/task/33469/cwd (readlink: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33469 mgr-fin ceph rtd unknown /proc/31232/task/33469/root (readlink: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33469 mgr-fin ceph txt unknown /proc/31232/task/33469/exe (readlink: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33469 mgr-fin ceph NOFD /proc/31232/task/33469/fd (opendir: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33470 mgr-fin ceph cwd unknown /proc/31232/task/33470/cwd (readlink: Permission denied) 2024-09-21T01:16:05.780 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33470 mgr-fin ceph rtd unknown /proc/31232/task/33470/root (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33470 mgr-fin ceph txt unknown /proc/31232/task/33470/exe (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33470 mgr-fin ceph NOFD /proc/31232/task/33470/fd (opendir: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33471 mgr-fin ceph cwd unknown /proc/31232/task/33471/cwd (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33471 mgr-fin ceph rtd unknown /proc/31232/task/33471/root (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33471 mgr-fin ceph txt unknown /proc/31232/task/33471/exe (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33471 mgr-fin ceph NOFD /proc/31232/task/33471/fd (opendir: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33472 mgr-fin ceph cwd unknown /proc/31232/task/33472/cwd (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33472 mgr-fin ceph rtd unknown /proc/31232/task/33472/root (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33472 mgr-fin ceph txt unknown /proc/31232/task/33472/exe (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33472 mgr-fin ceph NOFD /proc/31232/task/33472/fd (opendir: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33473 mgr-fin ceph cwd unknown /proc/31232/task/33473/cwd (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33473 mgr-fin ceph rtd unknown /proc/31232/task/33473/root (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33473 mgr-fin ceph txt unknown /proc/31232/task/33473/exe (readlink: Permission denied) 2024-09-21T01:16:05.781 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33473 mgr-fin ceph NOFD /proc/31232/task/33473/fd (opendir: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33474 mgr-fin ceph cwd unknown /proc/31232/task/33474/cwd (readlink: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33474 mgr-fin ceph rtd unknown /proc/31232/task/33474/root (readlink: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33474 mgr-fin ceph txt unknown /proc/31232/task/33474/exe (readlink: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33474 mgr-fin ceph NOFD /proc/31232/task/33474/fd (opendir: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33475 mgr-fin ceph cwd unknown /proc/31232/task/33475/cwd (readlink: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33475 mgr-fin ceph rtd unknown /proc/31232/task/33475/root (readlink: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33475 mgr-fin ceph txt unknown /proc/31232/task/33475/exe (readlink: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33475 mgr-fin ceph NOFD /proc/31232/task/33475/fd (opendir: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33476 mgr-fin ceph cwd unknown /proc/31232/task/33476/cwd (readlink: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33476 mgr-fin ceph rtd unknown /proc/31232/task/33476/root (readlink: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33476 mgr-fin ceph txt unknown /proc/31232/task/33476/exe (readlink: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33476 mgr-fin ceph NOFD /proc/31232/task/33476/fd (opendir: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33477 mgr-fin ceph cwd unknown /proc/31232/task/33477/cwd (readlink: Permission denied) 2024-09-21T01:16:05.782 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33477 mgr-fin ceph rtd unknown /proc/31232/task/33477/root (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33477 mgr-fin ceph txt unknown /proc/31232/task/33477/exe (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33477 mgr-fin ceph NOFD /proc/31232/task/33477/fd (opendir: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33478 mgr-fin ceph cwd unknown /proc/31232/task/33478/cwd (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33478 mgr-fin ceph rtd unknown /proc/31232/task/33478/root (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33478 mgr-fin ceph txt unknown /proc/31232/task/33478/exe (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33478 mgr-fin ceph NOFD /proc/31232/task/33478/fd (opendir: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33479 cephadm ceph cwd unknown /proc/31232/task/33479/cwd (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33479 cephadm ceph rtd unknown /proc/31232/task/33479/root (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33479 cephadm ceph txt unknown /proc/31232/task/33479/exe (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33479 cephadm ceph NOFD /proc/31232/task/33479/fd (opendir: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33480 m-fin-cep ceph cwd unknown /proc/31232/task/33480/cwd (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33480 m-fin-cep ceph rtd unknown /proc/31232/task/33480/root (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33480 m-fin-cep ceph txt unknown /proc/31232/task/33480/exe (readlink: Permission denied) 2024-09-21T01:16:05.783 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33480 m-fin-cep ceph NOFD /proc/31232/task/33480/fd (opendir: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33481 mgr-fin ceph cwd unknown /proc/31232/task/33481/cwd (readlink: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33481 mgr-fin ceph rtd unknown /proc/31232/task/33481/root (readlink: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33481 mgr-fin ceph txt unknown /proc/31232/task/33481/exe (readlink: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33481 mgr-fin ceph NOFD /proc/31232/task/33481/fd (opendir: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33482 mgr-fin ceph cwd unknown /proc/31232/task/33482/cwd (readlink: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33482 mgr-fin ceph rtd unknown /proc/31232/task/33482/root (readlink: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33482 mgr-fin ceph txt unknown /proc/31232/task/33482/exe (readlink: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33482 mgr-fin ceph NOFD /proc/31232/task/33482/fd (opendir: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33483 cephadm ceph cwd unknown /proc/31232/task/33483/cwd (readlink: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33483 cephadm ceph rtd unknown /proc/31232/task/33483/root (readlink: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33483 cephadm ceph txt unknown /proc/31232/task/33483/exe (readlink: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33483 cephadm ceph NOFD /proc/31232/task/33483/fd (opendir: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33484 mgr-fin ceph cwd unknown /proc/31232/task/33484/cwd (readlink: Permission denied) 2024-09-21T01:16:05.784 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33484 mgr-fin ceph rtd unknown /proc/31232/task/33484/root (readlink: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33484 mgr-fin ceph txt unknown /proc/31232/task/33484/exe (readlink: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33484 mgr-fin ceph NOFD /proc/31232/task/33484/fd (opendir: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33485 mgr-fin ceph cwd unknown /proc/31232/task/33485/cwd (readlink: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33485 mgr-fin ceph rtd unknown /proc/31232/task/33485/root (readlink: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33485 mgr-fin ceph txt unknown /proc/31232/task/33485/exe (readlink: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33485 mgr-fin ceph NOFD /proc/31232/task/33485/fd (opendir: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33486 crash ceph cwd unknown /proc/31232/task/33486/cwd (readlink: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33486 crash ceph rtd unknown /proc/31232/task/33486/root (readlink: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33486 crash ceph txt unknown /proc/31232/task/33486/exe (readlink: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33486 crash ceph NOFD /proc/31232/task/33486/fd (opendir: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33487 m-fin-cra ceph cwd unknown /proc/31232/task/33487/cwd (readlink: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33487 m-fin-cra ceph rtd unknown /proc/31232/task/33487/root (readlink: Permission denied) 2024-09-21T01:16:05.785 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33487 m-fin-cra ceph txt unknown /proc/31232/task/33487/exe (readlink: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33487 m-fin-cra ceph NOFD /proc/31232/task/33487/fd (opendir: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33488 mgr-fin ceph cwd unknown /proc/31232/task/33488/cwd (readlink: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33488 mgr-fin ceph rtd unknown /proc/31232/task/33488/root (readlink: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33488 mgr-fin ceph txt unknown /proc/31232/task/33488/exe (readlink: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33488 mgr-fin ceph NOFD /proc/31232/task/33488/fd (opendir: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33489 mgr-fin ceph cwd unknown /proc/31232/task/33489/cwd (readlink: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33489 mgr-fin ceph rtd unknown /proc/31232/task/33489/root (readlink: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33489 mgr-fin ceph txt unknown /proc/31232/task/33489/exe (readlink: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33489 mgr-fin ceph NOFD /proc/31232/task/33489/fd (opendir: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33490 dashboard ceph cwd unknown /proc/31232/task/33490/cwd (readlink: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33490 dashboard ceph rtd unknown /proc/31232/task/33490/root (readlink: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33490 dashboard ceph txt unknown /proc/31232/task/33490/exe (readlink: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33490 dashboard ceph NOFD /proc/31232/task/33490/fd (opendir: Permission denied) 2024-09-21T01:16:05.786 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33491 m-fin-das ceph cwd unknown /proc/31232/task/33491/cwd (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33491 m-fin-das ceph rtd unknown /proc/31232/task/33491/root (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33491 m-fin-das ceph txt unknown /proc/31232/task/33491/exe (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33491 m-fin-das ceph NOFD /proc/31232/task/33491/fd (opendir: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33492 mgr-fin ceph cwd unknown /proc/31232/task/33492/cwd (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33492 mgr-fin ceph rtd unknown /proc/31232/task/33492/root (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33492 mgr-fin ceph txt unknown /proc/31232/task/33492/exe (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33492 mgr-fin ceph NOFD /proc/31232/task/33492/fd (opendir: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33493 devicehea ceph cwd unknown /proc/31232/task/33493/cwd (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33493 devicehea ceph rtd unknown /proc/31232/task/33493/root (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33493 devicehea ceph txt unknown /proc/31232/task/33493/exe (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33493 devicehea ceph NOFD /proc/31232/task/33493/fd (opendir: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33494 m-fin-dev ceph cwd unknown /proc/31232/task/33494/cwd (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33494 m-fin-dev ceph rtd unknown /proc/31232/task/33494/root (readlink: Permission denied) 2024-09-21T01:16:05.787 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33494 m-fin-dev ceph txt unknown /proc/31232/task/33494/exe (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33494 m-fin-dev ceph NOFD /proc/31232/task/33494/fd (opendir: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33495 mgr-fin ceph cwd unknown /proc/31232/task/33495/cwd (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33495 mgr-fin ceph rtd unknown /proc/31232/task/33495/root (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33495 mgr-fin ceph txt unknown /proc/31232/task/33495/exe (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33495 mgr-fin ceph NOFD /proc/31232/task/33495/fd (opendir: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33497 m-fin-ios ceph cwd unknown /proc/31232/task/33497/cwd (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33497 m-fin-ios ceph rtd unknown /proc/31232/task/33497/root (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33497 m-fin-ios ceph txt unknown /proc/31232/task/33497/exe (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33497 m-fin-ios ceph NOFD /proc/31232/task/33497/fd (opendir: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33498 mgr-fin ceph cwd unknown /proc/31232/task/33498/cwd (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33498 mgr-fin ceph rtd unknown /proc/31232/task/33498/root (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33498 mgr-fin ceph txt unknown /proc/31232/task/33498/exe (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33498 mgr-fin ceph NOFD /proc/31232/task/33498/fd (opendir: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33500 m-fin-nfs ceph cwd unknown /proc/31232/task/33500/cwd (readlink: Permission denied) 2024-09-21T01:16:05.788 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33500 m-fin-nfs ceph rtd unknown /proc/31232/task/33500/root (readlink: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33500 m-fin-nfs ceph txt unknown /proc/31232/task/33500/exe (readlink: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33500 m-fin-nfs ceph NOFD /proc/31232/task/33500/fd (opendir: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33501 mgr-fin ceph cwd unknown /proc/31232/task/33501/cwd (readlink: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33501 mgr-fin ceph rtd unknown /proc/31232/task/33501/root (readlink: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33501 mgr-fin ceph txt unknown /proc/31232/task/33501/exe (readlink: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33501 mgr-fin ceph NOFD /proc/31232/task/33501/fd (opendir: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33502 cephadm ceph cwd unknown /proc/31232/task/33502/cwd (readlink: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33502 cephadm ceph rtd unknown /proc/31232/task/33502/root (readlink: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33502 cephadm ceph txt unknown /proc/31232/task/33502/exe (readlink: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33502 cephadm ceph NOFD /proc/31232/task/33502/fd (opendir: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33503 mgr-fin ceph cwd unknown /proc/31232/task/33503/cwd (readlink: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33503 mgr-fin ceph rtd unknown /proc/31232/task/33503/root (readlink: Permission denied) 2024-09-21T01:16:05.789 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33503 mgr-fin ceph txt unknown /proc/31232/task/33503/exe (readlink: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33503 mgr-fin ceph NOFD /proc/31232/task/33503/fd (opendir: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33505 m-fin-orc ceph cwd unknown /proc/31232/task/33505/cwd (readlink: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33505 m-fin-orc ceph rtd unknown /proc/31232/task/33505/root (readlink: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33505 m-fin-orc ceph txt unknown /proc/31232/task/33505/exe (readlink: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33505 m-fin-orc ceph NOFD /proc/31232/task/33505/fd (opendir: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33506 mgr-fin ceph cwd unknown /proc/31232/task/33506/cwd (readlink: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33506 mgr-fin ceph rtd unknown /proc/31232/task/33506/root (readlink: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33506 mgr-fin ceph txt unknown /proc/31232/task/33506/exe (readlink: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33506 mgr-fin ceph NOFD /proc/31232/task/33506/fd (opendir: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33507 mgr-fin ceph cwd unknown /proc/31232/task/33507/cwd (readlink: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33507 mgr-fin ceph rtd unknown /proc/31232/task/33507/root (readlink: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33507 mgr-fin ceph txt unknown /proc/31232/task/33507/exe (readlink: Permission denied) 2024-09-21T01:16:05.790 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33507 mgr-fin ceph NOFD /proc/31232/task/33507/fd (opendir: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33508 pg_autosc ceph cwd unknown /proc/31232/task/33508/cwd (readlink: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33508 pg_autosc ceph rtd unknown /proc/31232/task/33508/root (readlink: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33508 pg_autosc ceph txt unknown /proc/31232/task/33508/exe (readlink: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33508 pg_autosc ceph NOFD /proc/31232/task/33508/fd (opendir: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33509 m-fin-pg_ ceph cwd unknown /proc/31232/task/33509/cwd (readlink: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33509 m-fin-pg_ ceph rtd unknown /proc/31232/task/33509/root (readlink: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33509 m-fin-pg_ ceph txt unknown /proc/31232/task/33509/exe (readlink: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33509 m-fin-pg_ ceph NOFD /proc/31232/task/33509/fd (opendir: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33510 progress ceph cwd unknown /proc/31232/task/33510/cwd (readlink: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33510 progress ceph rtd unknown /proc/31232/task/33510/root (readlink: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33510 progress ceph txt unknown /proc/31232/task/33510/exe (readlink: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33510 progress ceph NOFD /proc/31232/task/33510/fd (opendir: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33511 m-fin-pro ceph cwd unknown /proc/31232/task/33511/cwd (readlink: Permission denied) 2024-09-21T01:16:05.791 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33511 m-fin-pro ceph rtd unknown /proc/31232/task/33511/root (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33511 m-fin-pro ceph txt unknown /proc/31232/task/33511/exe (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33511 m-fin-pro ceph NOFD /proc/31232/task/33511/fd (opendir: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33515 io_contex ceph cwd unknown /proc/31232/task/33515/cwd (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33515 io_contex ceph rtd unknown /proc/31232/task/33515/root (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33515 io_contex ceph txt unknown /proc/31232/task/33515/exe (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33515 io_contex ceph NOFD /proc/31232/task/33515/fd (opendir: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33516 io_contex ceph cwd unknown /proc/31232/task/33516/cwd (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33516 io_contex ceph rtd unknown /proc/31232/task/33516/root (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33516 io_contex ceph txt unknown /proc/31232/task/33516/exe (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33516 io_contex ceph NOFD /proc/31232/task/33516/fd (opendir: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33517 ceph_time ceph cwd unknown /proc/31232/task/33517/cwd (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33517 ceph_time ceph rtd unknown /proc/31232/task/33517/root (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33517 ceph_time ceph txt unknown /proc/31232/task/33517/exe (readlink: Permission denied) 2024-09-21T01:16:05.792 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33517 ceph_time ceph NOFD /proc/31232/task/33517/fd (opendir: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33518 ms_dispat ceph cwd unknown /proc/31232/task/33518/cwd (readlink: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33518 ms_dispat ceph rtd unknown /proc/31232/task/33518/root (readlink: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33518 ms_dispat ceph txt unknown /proc/31232/task/33518/exe (readlink: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33518 ms_dispat ceph NOFD /proc/31232/task/33518/fd (opendir: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33519 ms_local ceph cwd unknown /proc/31232/task/33519/cwd (readlink: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33519 ms_local ceph rtd unknown /proc/31232/task/33519/root (readlink: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33519 ms_local ceph txt unknown /proc/31232/task/33519/exe (readlink: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33519 ms_local ceph NOFD /proc/31232/task/33519/fd (opendir: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33520 safe_time ceph cwd unknown /proc/31232/task/33520/cwd (readlink: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33520 safe_time ceph rtd unknown /proc/31232/task/33520/root (readlink: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33520 safe_time ceph txt unknown /proc/31232/task/33520/exe (readlink: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33520 safe_time ceph NOFD /proc/31232/task/33520/fd (opendir: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33521 safe_time ceph cwd unknown /proc/31232/task/33521/cwd (readlink: Permission denied) 2024-09-21T01:16:05.793 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33521 safe_time ceph rtd unknown /proc/31232/task/33521/root (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33521 safe_time ceph txt unknown /proc/31232/task/33521/exe (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33521 safe_time ceph NOFD /proc/31232/task/33521/fd (opendir: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33522 mgr-fin ceph cwd unknown /proc/31232/task/33522/cwd (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33522 mgr-fin ceph rtd unknown /proc/31232/task/33522/root (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33522 mgr-fin ceph txt unknown /proc/31232/task/33522/exe (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33522 mgr-fin ceph NOFD /proc/31232/task/33522/fd (opendir: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33524 m-fin-rbd ceph cwd unknown /proc/31232/task/33524/cwd (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33524 m-fin-rbd ceph rtd unknown /proc/31232/task/33524/root (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33524 m-fin-rbd ceph txt unknown /proc/31232/task/33524/exe (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33524 m-fin-rbd ceph NOFD /proc/31232/task/33524/fd (opendir: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33525 restful ceph cwd unknown /proc/31232/task/33525/cwd (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33525 restful ceph rtd unknown /proc/31232/task/33525/root (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33525 restful ceph txt unknown /proc/31232/task/33525/exe (readlink: Permission denied) 2024-09-21T01:16:05.794 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33525 restful ceph NOFD /proc/31232/task/33525/fd (opendir: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33526 m-fin-res ceph cwd unknown /proc/31232/task/33526/cwd (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33526 m-fin-res ceph rtd unknown /proc/31232/task/33526/root (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33526 m-fin-res ceph txt unknown /proc/31232/task/33526/exe (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33526 m-fin-res ceph NOFD /proc/31232/task/33526/fd (opendir: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33528 m-fin-sta ceph cwd unknown /proc/31232/task/33528/cwd (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33528 m-fin-sta ceph rtd unknown /proc/31232/task/33528/root (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33528 m-fin-sta ceph txt unknown /proc/31232/task/33528/exe (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33528 m-fin-sta ceph NOFD /proc/31232/task/33528/fd (opendir: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33529 mgr-fin ceph cwd unknown /proc/31232/task/33529/cwd (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33529 mgr-fin ceph rtd unknown /proc/31232/task/33529/root (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33529 mgr-fin ceph txt unknown /proc/31232/task/33529/exe (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33529 mgr-fin ceph NOFD /proc/31232/task/33529/fd (opendir: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33530 mgr-fin ceph cwd unknown /proc/31232/task/33530/cwd (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33530 mgr-fin ceph rtd unknown /proc/31232/task/33530/root (readlink: Permission denied) 2024-09-21T01:16:05.795 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33530 mgr-fin ceph txt unknown /proc/31232/task/33530/exe (readlink: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33530 mgr-fin ceph NOFD /proc/31232/task/33530/fd (opendir: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33531 mgr-fin ceph cwd unknown /proc/31232/task/33531/cwd (readlink: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33531 mgr-fin ceph rtd unknown /proc/31232/task/33531/root (readlink: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33531 mgr-fin ceph txt unknown /proc/31232/task/33531/exe (readlink: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33531 mgr-fin ceph NOFD /proc/31232/task/33531/fd (opendir: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33532 telemetry ceph cwd unknown /proc/31232/task/33532/cwd (readlink: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33532 telemetry ceph rtd unknown /proc/31232/task/33532/root (readlink: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33532 telemetry ceph txt unknown /proc/31232/task/33532/exe (readlink: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33532 telemetry ceph NOFD /proc/31232/task/33532/fd (opendir: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33533 m-fin-tel ceph cwd unknown /proc/31232/task/33533/cwd (readlink: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33533 m-fin-tel ceph rtd unknown /proc/31232/task/33533/root (readlink: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33533 m-fin-tel ceph txt unknown /proc/31232/task/33533/exe (readlink: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33533 m-fin-tel ceph NOFD /proc/31232/task/33533/fd (opendir: Permission denied) 2024-09-21T01:16:05.796 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33534 mgr-fin ceph cwd unknown /proc/31232/task/33534/cwd (readlink: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33534 mgr-fin ceph rtd unknown /proc/31232/task/33534/root (readlink: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33534 mgr-fin ceph txt unknown /proc/31232/task/33534/exe (readlink: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33534 mgr-fin ceph NOFD /proc/31232/task/33534/fd (opendir: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33535 mgr-fin ceph cwd unknown /proc/31232/task/33535/cwd (readlink: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33535 mgr-fin ceph rtd unknown /proc/31232/task/33535/root (readlink: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33535 mgr-fin ceph txt unknown /proc/31232/task/33535/exe (readlink: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33535 mgr-fin ceph NOFD /proc/31232/task/33535/fd (opendir: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33539 io_contex ceph cwd unknown /proc/31232/task/33539/cwd (readlink: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33539 io_contex ceph rtd unknown /proc/31232/task/33539/root (readlink: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33539 io_contex ceph txt unknown /proc/31232/task/33539/exe (readlink: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33539 io_contex ceph NOFD /proc/31232/task/33539/fd (opendir: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33540 io_contex ceph cwd unknown /proc/31232/task/33540/cwd (readlink: Permission denied) 2024-09-21T01:16:05.797 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33540 io_contex ceph rtd unknown /proc/31232/task/33540/root (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33540 io_contex ceph txt unknown /proc/31232/task/33540/exe (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33540 io_contex ceph NOFD /proc/31232/task/33540/fd (opendir: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33541 ceph_time ceph cwd unknown /proc/31232/task/33541/cwd (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33541 ceph_time ceph rtd unknown /proc/31232/task/33541/root (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33541 ceph_time ceph txt unknown /proc/31232/task/33541/exe (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33541 ceph_time ceph NOFD /proc/31232/task/33541/fd (opendir: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33542 ms_dispat ceph cwd unknown /proc/31232/task/33542/cwd (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33542 ms_dispat ceph rtd unknown /proc/31232/task/33542/root (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33542 ms_dispat ceph txt unknown /proc/31232/task/33542/exe (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33542 ms_dispat ceph NOFD /proc/31232/task/33542/fd (opendir: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33543 ms_local ceph cwd unknown /proc/31232/task/33543/cwd (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33543 ms_local ceph rtd unknown /proc/31232/task/33543/root (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33543 ms_local ceph txt unknown /proc/31232/task/33543/exe (readlink: Permission denied) 2024-09-21T01:16:05.798 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33543 ms_local ceph NOFD /proc/31232/task/33543/fd (opendir: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33544 safe_time ceph cwd unknown /proc/31232/task/33544/cwd (readlink: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33544 safe_time ceph rtd unknown /proc/31232/task/33544/root (readlink: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33544 safe_time ceph txt unknown /proc/31232/task/33544/exe (readlink: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33544 safe_time ceph NOFD /proc/31232/task/33544/fd (opendir: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33545 safe_time ceph cwd unknown /proc/31232/task/33545/cwd (readlink: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33545 safe_time ceph rtd unknown /proc/31232/task/33545/root (readlink: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33545 safe_time ceph txt unknown /proc/31232/task/33545/exe (readlink: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33545 safe_time ceph NOFD /proc/31232/task/33545/fd (opendir: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33546 mgr-fin ceph cwd unknown /proc/31232/task/33546/cwd (readlink: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33546 mgr-fin ceph rtd unknown /proc/31232/task/33546/root (readlink: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33546 mgr-fin ceph txt unknown /proc/31232/task/33546/exe (readlink: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33546 mgr-fin ceph NOFD /proc/31232/task/33546/fd (opendir: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33547 mgr-fin ceph cwd unknown /proc/31232/task/33547/cwd (readlink: Permission denied) 2024-09-21T01:16:05.799 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33547 mgr-fin ceph rtd unknown /proc/31232/task/33547/root (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33547 mgr-fin ceph txt unknown /proc/31232/task/33547/exe (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33547 mgr-fin ceph NOFD /proc/31232/task/33547/fd (opendir: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33548 mgr-fin ceph cwd unknown /proc/31232/task/33548/cwd (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33548 mgr-fin ceph rtd unknown /proc/31232/task/33548/root (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33548 mgr-fin ceph txt unknown /proc/31232/task/33548/exe (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33548 mgr-fin ceph NOFD /proc/31232/task/33548/fd (opendir: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33549 mgr-fin ceph cwd unknown /proc/31232/task/33549/cwd (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33549 mgr-fin ceph rtd unknown /proc/31232/task/33549/root (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33549 mgr-fin ceph txt unknown /proc/31232/task/33549/exe (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33549 mgr-fin ceph NOFD /proc/31232/task/33549/fd (opendir: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33550 mgr-fin ceph cwd unknown /proc/31232/task/33550/cwd (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33550 mgr-fin ceph rtd unknown /proc/31232/task/33550/root (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33550 mgr-fin ceph txt unknown /proc/31232/task/33550/exe (readlink: Permission denied) 2024-09-21T01:16:05.800 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33550 mgr-fin ceph NOFD /proc/31232/task/33550/fd (opendir: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33551 mgr-fin ceph cwd unknown /proc/31232/task/33551/cwd (readlink: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33551 mgr-fin ceph rtd unknown /proc/31232/task/33551/root (readlink: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33551 mgr-fin ceph txt unknown /proc/31232/task/33551/exe (readlink: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33551 mgr-fin ceph NOFD /proc/31232/task/33551/fd (opendir: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33552 mgr-fin ceph cwd unknown /proc/31232/task/33552/cwd (readlink: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33552 mgr-fin ceph rtd unknown /proc/31232/task/33552/root (readlink: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33552 mgr-fin ceph txt unknown /proc/31232/task/33552/exe (readlink: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33552 mgr-fin ceph NOFD /proc/31232/task/33552/fd (opendir: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33553 mgr-fin ceph cwd unknown /proc/31232/task/33553/cwd (readlink: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33553 mgr-fin ceph rtd unknown /proc/31232/task/33553/root (readlink: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33553 mgr-fin ceph txt unknown /proc/31232/task/33553/exe (readlink: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33553 mgr-fin ceph NOFD /proc/31232/task/33553/fd (opendir: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33554 mgr-fin ceph cwd unknown /proc/31232/task/33554/cwd (readlink: Permission denied) 2024-09-21T01:16:05.801 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33554 mgr-fin ceph rtd unknown /proc/31232/task/33554/root (readlink: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33554 mgr-fin ceph txt unknown /proc/31232/task/33554/exe (readlink: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33554 mgr-fin ceph NOFD /proc/31232/task/33554/fd (opendir: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33555 mgr-fin ceph cwd unknown /proc/31232/task/33555/cwd (readlink: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33555 mgr-fin ceph rtd unknown /proc/31232/task/33555/root (readlink: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33555 mgr-fin ceph txt unknown /proc/31232/task/33555/exe (readlink: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33555 mgr-fin ceph NOFD /proc/31232/task/33555/fd (opendir: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33556 mgr-fin ceph cwd unknown /proc/31232/task/33556/cwd (readlink: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33556 mgr-fin ceph rtd unknown /proc/31232/task/33556/root (readlink: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33556 mgr-fin ceph txt unknown /proc/31232/task/33556/exe (readlink: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33556 mgr-fin ceph NOFD /proc/31232/task/33556/fd (opendir: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33557 mgr-fin ceph cwd unknown /proc/31232/task/33557/cwd (readlink: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33557 mgr-fin ceph rtd unknown /proc/31232/task/33557/root (readlink: Permission denied) 2024-09-21T01:16:05.802 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33557 mgr-fin ceph txt unknown /proc/31232/task/33557/exe (readlink: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33557 mgr-fin ceph NOFD /proc/31232/task/33557/fd (opendir: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33559 m-fin-vol ceph cwd unknown /proc/31232/task/33559/cwd (readlink: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33559 m-fin-vol ceph rtd unknown /proc/31232/task/33559/root (readlink: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33559 m-fin-vol ceph txt unknown /proc/31232/task/33559/exe (readlink: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33559 m-fin-vol ceph NOFD /proc/31232/task/33559/fd (opendir: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33708 mgr-fin ceph cwd unknown /proc/31232/task/33708/cwd (readlink: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33708 mgr-fin ceph rtd unknown /proc/31232/task/33708/root (readlink: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33708 mgr-fin ceph txt unknown /proc/31232/task/33708/exe (readlink: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33708 mgr-fin ceph NOFD /proc/31232/task/33708/fd (opendir: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33709 mgr-fin ceph cwd unknown /proc/31232/task/33709/cwd (readlink: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33709 mgr-fin ceph rtd unknown /proc/31232/task/33709/root (readlink: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33709 mgr-fin ceph txt unknown /proc/31232/task/33709/exe (readlink: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33709 mgr-fin ceph NOFD /proc/31232/task/33709/fd (opendir: Permission denied) 2024-09-21T01:16:05.803 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33710 mgr-fin ceph cwd unknown /proc/31232/task/33710/cwd (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33710 mgr-fin ceph rtd unknown /proc/31232/task/33710/root (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33710 mgr-fin ceph txt unknown /proc/31232/task/33710/exe (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33710 mgr-fin ceph NOFD /proc/31232/task/33710/fd (opendir: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33711 mgr-fin ceph cwd unknown /proc/31232/task/33711/cwd (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33711 mgr-fin ceph rtd unknown /proc/31232/task/33711/root (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33711 mgr-fin ceph txt unknown /proc/31232/task/33711/exe (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33711 mgr-fin ceph NOFD /proc/31232/task/33711/fd (opendir: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33712 mgr-fin ceph cwd unknown /proc/31232/task/33712/cwd (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33712 mgr-fin ceph rtd unknown /proc/31232/task/33712/root (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33712 mgr-fin ceph txt unknown /proc/31232/task/33712/exe (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33712 mgr-fin ceph NOFD /proc/31232/task/33712/fd (opendir: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33713 mgr-fin ceph cwd unknown /proc/31232/task/33713/cwd (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33713 mgr-fin ceph rtd unknown /proc/31232/task/33713/root (readlink: Permission denied) 2024-09-21T01:16:05.804 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33713 mgr-fin ceph txt unknown /proc/31232/task/33713/exe (readlink: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33713 mgr-fin ceph NOFD /proc/31232/task/33713/fd (opendir: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33714 mgr-fin ceph cwd unknown /proc/31232/task/33714/cwd (readlink: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33714 mgr-fin ceph rtd unknown /proc/31232/task/33714/root (readlink: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33714 mgr-fin ceph txt unknown /proc/31232/task/33714/exe (readlink: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33714 mgr-fin ceph NOFD /proc/31232/task/33714/fd (opendir: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33715 mgr-fin ceph cwd unknown /proc/31232/task/33715/cwd (readlink: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33715 mgr-fin ceph rtd unknown /proc/31232/task/33715/root (readlink: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33715 mgr-fin ceph txt unknown /proc/31232/task/33715/exe (readlink: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33715 mgr-fin ceph NOFD /proc/31232/task/33715/fd (opendir: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33716 mgr-fin ceph cwd unknown /proc/31232/task/33716/cwd (readlink: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33716 mgr-fin ceph rtd unknown /proc/31232/task/33716/root (readlink: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33716 mgr-fin ceph txt unknown /proc/31232/task/33716/exe (readlink: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33716 mgr-fin ceph NOFD /proc/31232/task/33716/fd (opendir: Permission denied) 2024-09-21T01:16:05.805 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33717 mgr-fin ceph cwd unknown /proc/31232/task/33717/cwd (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33717 mgr-fin ceph rtd unknown /proc/31232/task/33717/root (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33717 mgr-fin ceph txt unknown /proc/31232/task/33717/exe (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33717 mgr-fin ceph NOFD /proc/31232/task/33717/fd (opendir: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33718 mgr-fin ceph cwd unknown /proc/31232/task/33718/cwd (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33718 mgr-fin ceph rtd unknown /proc/31232/task/33718/root (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33718 mgr-fin ceph txt unknown /proc/31232/task/33718/exe (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33718 mgr-fin ceph NOFD /proc/31232/task/33718/fd (opendir: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33720 mgr-fin ceph cwd unknown /proc/31232/task/33720/cwd (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33720 mgr-fin ceph rtd unknown /proc/31232/task/33720/root (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33720 mgr-fin ceph txt unknown /proc/31232/task/33720/exe (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33720 mgr-fin ceph NOFD /proc/31232/task/33720/fd (opendir: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33721 mgr-fin ceph cwd unknown /proc/31232/task/33721/cwd (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33721 mgr-fin ceph rtd unknown /proc/31232/task/33721/root (readlink: Permission denied) 2024-09-21T01:16:05.806 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33721 mgr-fin ceph txt unknown /proc/31232/task/33721/exe (readlink: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33721 mgr-fin ceph NOFD /proc/31232/task/33721/fd (opendir: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33722 mgr-fin ceph cwd unknown /proc/31232/task/33722/cwd (readlink: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33722 mgr-fin ceph rtd unknown /proc/31232/task/33722/root (readlink: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33722 mgr-fin ceph txt unknown /proc/31232/task/33722/exe (readlink: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33722 mgr-fin ceph NOFD /proc/31232/task/33722/fd (opendir: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33723 mgr-fin ceph cwd unknown /proc/31232/task/33723/cwd (readlink: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33723 mgr-fin ceph rtd unknown /proc/31232/task/33723/root (readlink: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33723 mgr-fin ceph txt unknown /proc/31232/task/33723/exe (readlink: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33723 mgr-fin ceph NOFD /proc/31232/task/33723/fd (opendir: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33724 mgr-fin ceph cwd unknown /proc/31232/task/33724/cwd (readlink: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33724 mgr-fin ceph rtd unknown /proc/31232/task/33724/root (readlink: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33724 mgr-fin ceph txt unknown /proc/31232/task/33724/exe (readlink: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33724 mgr-fin ceph NOFD /proc/31232/task/33724/fd (opendir: Permission denied) 2024-09-21T01:16:05.807 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33725 mgr-fin ceph cwd unknown /proc/31232/task/33725/cwd (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33725 mgr-fin ceph rtd unknown /proc/31232/task/33725/root (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33725 mgr-fin ceph txt unknown /proc/31232/task/33725/exe (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33725 mgr-fin ceph NOFD /proc/31232/task/33725/fd (opendir: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33726 mgr-fin ceph cwd unknown /proc/31232/task/33726/cwd (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33726 mgr-fin ceph rtd unknown /proc/31232/task/33726/root (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33726 mgr-fin ceph txt unknown /proc/31232/task/33726/exe (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33726 mgr-fin ceph NOFD /proc/31232/task/33726/fd (opendir: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33727 mgr-fin ceph cwd unknown /proc/31232/task/33727/cwd (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33727 mgr-fin ceph rtd unknown /proc/31232/task/33727/root (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33727 mgr-fin ceph txt unknown /proc/31232/task/33727/exe (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33727 mgr-fin ceph NOFD /proc/31232/task/33727/fd (opendir: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33728 mgr-fin ceph cwd unknown /proc/31232/task/33728/cwd (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33728 mgr-fin ceph rtd unknown /proc/31232/task/33728/root (readlink: Permission denied) 2024-09-21T01:16:05.808 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33728 mgr-fin ceph txt unknown /proc/31232/task/33728/exe (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33728 mgr-fin ceph NOFD /proc/31232/task/33728/fd (opendir: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33729 mgr-fin ceph cwd unknown /proc/31232/task/33729/cwd (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33729 mgr-fin ceph rtd unknown /proc/31232/task/33729/root (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33729 mgr-fin ceph txt unknown /proc/31232/task/33729/exe (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33729 mgr-fin ceph NOFD /proc/31232/task/33729/fd (opendir: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33730 mgr-fin ceph cwd unknown /proc/31232/task/33730/cwd (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33730 mgr-fin ceph rtd unknown /proc/31232/task/33730/root (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33730 mgr-fin ceph txt unknown /proc/31232/task/33730/exe (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 33730 mgr-fin ceph NOFD /proc/31232/task/33730/fd (opendir: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34444 dashboard ceph cwd unknown /proc/31232/task/34444/cwd (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34444 dashboard ceph rtd unknown /proc/31232/task/34444/root (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34444 dashboard ceph txt unknown /proc/31232/task/34444/exe (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34444 dashboard ceph NOFD /proc/31232/task/34444/fd (opendir: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34445 dashboard ceph cwd unknown /proc/31232/task/34445/cwd (readlink: Permission denied) 2024-09-21T01:16:05.809 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34445 dashboard ceph rtd unknown /proc/31232/task/34445/root (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34445 dashboard ceph txt unknown /proc/31232/task/34445/exe (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34445 dashboard ceph NOFD /proc/31232/task/34445/fd (opendir: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34446 dashboard ceph cwd unknown /proc/31232/task/34446/cwd (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34446 dashboard ceph rtd unknown /proc/31232/task/34446/root (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34446 dashboard ceph txt unknown /proc/31232/task/34446/exe (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34446 dashboard ceph NOFD /proc/31232/task/34446/fd (opendir: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34447 dashboard ceph cwd unknown /proc/31232/task/34447/cwd (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34447 dashboard ceph rtd unknown /proc/31232/task/34447/root (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34447 dashboard ceph txt unknown /proc/31232/task/34447/exe (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34447 dashboard ceph NOFD /proc/31232/task/34447/fd (opendir: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34448 dashboard ceph cwd unknown /proc/31232/task/34448/cwd (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34448 dashboard ceph rtd unknown /proc/31232/task/34448/root (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34448 dashboard ceph txt unknown /proc/31232/task/34448/exe (readlink: Permission denied) 2024-09-21T01:16:05.810 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34448 dashboard ceph NOFD /proc/31232/task/34448/fd (opendir: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34449 dashboard ceph cwd unknown /proc/31232/task/34449/cwd (readlink: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34449 dashboard ceph rtd unknown /proc/31232/task/34449/root (readlink: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34449 dashboard ceph txt unknown /proc/31232/task/34449/exe (readlink: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34449 dashboard ceph NOFD /proc/31232/task/34449/fd (opendir: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34450 dashboard ceph cwd unknown /proc/31232/task/34450/cwd (readlink: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34450 dashboard ceph rtd unknown /proc/31232/task/34450/root (readlink: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34450 dashboard ceph txt unknown /proc/31232/task/34450/exe (readlink: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34450 dashboard ceph NOFD /proc/31232/task/34450/fd (opendir: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34451 dashboard ceph cwd unknown /proc/31232/task/34451/cwd (readlink: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34451 dashboard ceph rtd unknown /proc/31232/task/34451/root (readlink: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34451 dashboard ceph txt unknown /proc/31232/task/34451/exe (readlink: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34451 dashboard ceph NOFD /proc/31232/task/34451/fd (opendir: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34452 dashboard ceph cwd unknown /proc/31232/task/34452/cwd (readlink: Permission denied) 2024-09-21T01:16:05.811 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34452 dashboard ceph rtd unknown /proc/31232/task/34452/root (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34452 dashboard ceph txt unknown /proc/31232/task/34452/exe (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34452 dashboard ceph NOFD /proc/31232/task/34452/fd (opendir: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34453 dashboard ceph cwd unknown /proc/31232/task/34453/cwd (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34453 dashboard ceph rtd unknown /proc/31232/task/34453/root (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34453 dashboard ceph txt unknown /proc/31232/task/34453/exe (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34453 dashboard ceph NOFD /proc/31232/task/34453/fd (opendir: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34454 dashboard ceph cwd unknown /proc/31232/task/34454/cwd (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34454 dashboard ceph rtd unknown /proc/31232/task/34454/root (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34454 dashboard ceph txt unknown /proc/31232/task/34454/exe (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34454 dashboard ceph NOFD /proc/31232/task/34454/fd (opendir: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34470 dashboard ceph cwd unknown /proc/31232/task/34470/cwd (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34470 dashboard ceph rtd unknown /proc/31232/task/34470/root (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34470 dashboard ceph txt unknown /proc/31232/task/34470/exe (readlink: Permission denied) 2024-09-21T01:16:05.812 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 34470 dashboard ceph NOFD /proc/31232/task/34470/fd (opendir: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50797 devicehea ceph cwd unknown /proc/31232/task/50797/cwd (readlink: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50797 devicehea ceph rtd unknown /proc/31232/task/50797/root (readlink: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50797 devicehea ceph txt unknown /proc/31232/task/50797/exe (readlink: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50797 devicehea ceph NOFD /proc/31232/task/50797/fd (opendir: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50801 io_contex ceph cwd unknown /proc/31232/task/50801/cwd (readlink: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50801 io_contex ceph rtd unknown /proc/31232/task/50801/root (readlink: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50801 io_contex ceph txt unknown /proc/31232/task/50801/exe (readlink: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50801 io_contex ceph NOFD /proc/31232/task/50801/fd (opendir: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50802 io_contex ceph cwd unknown /proc/31232/task/50802/cwd (readlink: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50802 io_contex ceph rtd unknown /proc/31232/task/50802/root (readlink: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50802 io_contex ceph txt unknown /proc/31232/task/50802/exe (readlink: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50802 io_contex ceph NOFD /proc/31232/task/50802/fd (opendir: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50803 ceph_time ceph cwd unknown /proc/31232/task/50803/cwd (readlink: Permission denied) 2024-09-21T01:16:05.813 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50803 ceph_time ceph rtd unknown /proc/31232/task/50803/root (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50803 ceph_time ceph txt unknown /proc/31232/task/50803/exe (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50803 ceph_time ceph NOFD /proc/31232/task/50803/fd (opendir: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50804 ms_dispat ceph cwd unknown /proc/31232/task/50804/cwd (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50804 ms_dispat ceph rtd unknown /proc/31232/task/50804/root (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50804 ms_dispat ceph txt unknown /proc/31232/task/50804/exe (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50804 ms_dispat ceph NOFD /proc/31232/task/50804/fd (opendir: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50805 ms_local ceph cwd unknown /proc/31232/task/50805/cwd (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50805 ms_local ceph rtd unknown /proc/31232/task/50805/root (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50805 ms_local ceph txt unknown /proc/31232/task/50805/exe (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50805 ms_local ceph NOFD /proc/31232/task/50805/fd (opendir: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50806 safe_time ceph cwd unknown /proc/31232/task/50806/cwd (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50806 safe_time ceph rtd unknown /proc/31232/task/50806/root (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50806 safe_time ceph txt unknown /proc/31232/task/50806/exe (readlink: Permission denied) 2024-09-21T01:16:05.814 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50806 safe_time ceph NOFD /proc/31232/task/50806/fd (opendir: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50807 safe_time ceph cwd unknown /proc/31232/task/50807/cwd (readlink: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50807 safe_time ceph rtd unknown /proc/31232/task/50807/root (readlink: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50807 safe_time ceph txt unknown /proc/31232/task/50807/exe (readlink: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mgr 31232 50807 safe_time ceph NOFD /proc/31232/task/50807/fd (opendir: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 32154 root cwd unknown /proc/32154/cwd (readlink: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 32154 root rtd unknown /proc/32154/root (readlink: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 32154 root txt unknown /proc/32154/exe (readlink: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 32154 root NOFD /proc/32154/fd (opendir: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 32264 root cwd unknown /proc/32264/cwd (readlink: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 32264 root rtd unknown /proc/32264/root (readlink: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 32264 root txt unknown /proc/32264/exe (readlink: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:systemd 32264 root NOFD /proc/32264/fd (opendir: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:(sd-pam) 32266 root cwd unknown /proc/32266/cwd (readlink: Permission denied) 2024-09-21T01:16:05.815 INFO:tasks.workunit.client.0.smithi148.stdout:(sd-pam) 32266 root rtd unknown /proc/32266/root (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:(sd-pam) 32266 root txt unknown /proc/32266/exe (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:(sd-pam) 32266 root NOFD /proc/32266/fd (opendir: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 33560 root cwd unknown /proc/33560/cwd (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 33560 root rtd unknown /proc/33560/root (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 33560 root txt unknown /proc/33560/exe (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 33560 root NOFD /proc/33560/fd (opendir: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 33563 root cwd unknown /proc/33563/cwd (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 33563 root rtd unknown /proc/33563/root (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 33563 root txt unknown /proc/33563/exe (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:sshd 33563 root NOFD /proc/33563/fd (opendir: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 36588 root cwd unknown /proc/36588/cwd (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 36588 root rtd unknown /proc/36588/root (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 36588 root txt unknown /proc/36588/exe (readlink: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 36588 root NOFD /proc/36588/fd (opendir: Permission denied) 2024-09-21T01:16:05.816 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 46418 root cwd unknown /proc/46418/cwd (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 46418 root rtd unknown /proc/46418/root (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 46418 root txt unknown /proc/46418/exe (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 46418 root NOFD /proc/46418/fd (opendir: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 46420 root cwd unknown /proc/46420/cwd (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 46420 root rtd unknown /proc/46420/root (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 46420 root txt unknown /proc/46420/exe (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 46420 root NOFD /proc/46420/fd (opendir: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 ceph cwd unknown /proc/46422/cwd (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 ceph rtd unknown /proc/46422/root (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 ceph txt unknown /proc/46422/exe (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 ceph NOFD /proc/46422/fd (opendir: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46423 log ceph cwd unknown /proc/46422/task/46423/cwd (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46423 log ceph rtd unknown /proc/46422/task/46423/root (readlink: Permission denied) 2024-09-21T01:16:05.817 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46423 log ceph txt unknown /proc/46422/task/46423/exe (readlink: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46423 log ceph NOFD /proc/46422/task/46423/fd (opendir: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46425 msgr-work ceph cwd unknown /proc/46422/task/46425/cwd (readlink: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46425 msgr-work ceph rtd unknown /proc/46422/task/46425/root (readlink: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46425 msgr-work ceph txt unknown /proc/46422/task/46425/exe (readlink: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46425 msgr-work ceph NOFD /proc/46422/task/46425/fd (opendir: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46426 msgr-work ceph cwd unknown /proc/46422/task/46426/cwd (readlink: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46426 msgr-work ceph rtd unknown /proc/46422/task/46426/root (readlink: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46426 msgr-work ceph txt unknown /proc/46422/task/46426/exe (readlink: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46426 msgr-work ceph NOFD /proc/46422/task/46426/fd (opendir: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46427 msgr-work ceph cwd unknown /proc/46422/task/46427/cwd (readlink: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46427 msgr-work ceph rtd unknown /proc/46422/task/46427/root (readlink: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46427 msgr-work ceph txt unknown /proc/46422/task/46427/exe (readlink: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46427 msgr-work ceph NOFD /proc/46422/task/46427/fd (opendir: Permission denied) 2024-09-21T01:16:05.818 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46431 service ceph cwd unknown /proc/46422/task/46431/cwd (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46431 service ceph rtd unknown /proc/46422/task/46431/root (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46431 service ceph txt unknown /proc/46422/task/46431/exe (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46431 service ceph NOFD /proc/46422/task/46431/fd (opendir: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46432 admin_soc ceph cwd unknown /proc/46422/task/46432/cwd (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46432 admin_soc ceph rtd unknown /proc/46422/task/46432/root (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46432 admin_soc ceph txt unknown /proc/46422/task/46432/exe (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46432 admin_soc ceph NOFD /proc/46422/task/46432/fd (opendir: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46696 signal_ha ceph cwd unknown /proc/46422/task/46696/cwd (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46696 signal_ha ceph rtd unknown /proc/46422/task/46696/root (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46696 signal_ha ceph txt unknown /proc/46422/task/46696/exe (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46696 signal_ha ceph NOFD /proc/46422/task/46696/fd (opendir: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46697 io_contex ceph cwd unknown /proc/46422/task/46697/cwd (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46697 io_contex ceph rtd unknown /proc/46422/task/46697/root (readlink: Permission denied) 2024-09-21T01:16:05.819 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46697 io_contex ceph txt unknown /proc/46422/task/46697/exe (readlink: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46697 io_contex ceph NOFD /proc/46422/task/46697/fd (opendir: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46698 io_contex ceph cwd unknown /proc/46422/task/46698/cwd (readlink: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46698 io_contex ceph rtd unknown /proc/46422/task/46698/root (readlink: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46698 io_contex ceph txt unknown /proc/46422/task/46698/exe (readlink: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46698 io_contex ceph NOFD /proc/46422/task/46698/fd (opendir: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46707 OpHistory ceph cwd unknown /proc/46422/task/46707/cwd (readlink: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46707 OpHistory ceph rtd unknown /proc/46422/task/46707/root (readlink: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46707 OpHistory ceph txt unknown /proc/46422/task/46707/exe (readlink: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46707 OpHistory ceph NOFD /proc/46422/task/46707/fd (opendir: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46708 ceph_time ceph cwd unknown /proc/46422/task/46708/cwd (readlink: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46708 ceph_time ceph rtd unknown /proc/46422/task/46708/root (readlink: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46708 ceph_time ceph txt unknown /proc/46422/task/46708/exe (readlink: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46708 ceph_time ceph NOFD /proc/46422/task/46708/fd (opendir: Permission denied) 2024-09-21T01:16:05.820 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46846 ceph-osd ceph cwd unknown /proc/46422/task/46846/cwd (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46846 ceph-osd ceph rtd unknown /proc/46422/task/46846/root (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46846 ceph-osd ceph txt unknown /proc/46422/task/46846/exe (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46846 ceph-osd ceph NOFD /proc/46422/task/46846/fd (opendir: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46847 safe_time ceph cwd unknown /proc/46422/task/46847/cwd (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46847 safe_time ceph rtd unknown /proc/46422/task/46847/root (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46847 safe_time ceph txt unknown /proc/46422/task/46847/exe (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46847 safe_time ceph NOFD /proc/46422/task/46847/fd (opendir: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46848 safe_time ceph cwd unknown /proc/46422/task/46848/cwd (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46848 safe_time ceph rtd unknown /proc/46422/task/46848/root (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46848 safe_time ceph txt unknown /proc/46422/task/46848/exe (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46848 safe_time ceph NOFD /proc/46422/task/46848/fd (opendir: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46849 safe_time ceph cwd unknown /proc/46422/task/46849/cwd (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46849 safe_time ceph rtd unknown /proc/46422/task/46849/root (readlink: Permission denied) 2024-09-21T01:16:05.821 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46849 safe_time ceph txt unknown /proc/46422/task/46849/exe (readlink: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46849 safe_time ceph NOFD /proc/46422/task/46849/fd (opendir: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46850 safe_time ceph cwd unknown /proc/46422/task/46850/cwd (readlink: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46850 safe_time ceph rtd unknown /proc/46422/task/46850/root (readlink: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46850 safe_time ceph txt unknown /proc/46422/task/46850/exe (readlink: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46850 safe_time ceph NOFD /proc/46422/task/46850/fd (opendir: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46851 fn_anonym ceph cwd unknown /proc/46422/task/46851/cwd (readlink: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46851 fn_anonym ceph rtd unknown /proc/46422/task/46851/root (readlink: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46851 fn_anonym ceph txt unknown /proc/46422/task/46851/exe (readlink: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46851 fn_anonym ceph NOFD /proc/46422/task/46851/fd (opendir: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46933 rocksdb:l ceph cwd unknown /proc/46422/task/46933/cwd (readlink: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46933 rocksdb:l ceph rtd unknown /proc/46422/task/46933/root (readlink: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46933 rocksdb:l ceph txt unknown /proc/46422/task/46933/exe (readlink: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46933 rocksdb:l ceph NOFD /proc/46422/task/46933/fd (opendir: Permission denied) 2024-09-21T01:16:05.822 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46934 rocksdb:l ceph cwd unknown /proc/46422/task/46934/cwd (readlink: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46934 rocksdb:l ceph rtd unknown /proc/46422/task/46934/root (readlink: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46934 rocksdb:l ceph txt unknown /proc/46422/task/46934/exe (readlink: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46934 rocksdb:l ceph NOFD /proc/46422/task/46934/fd (opendir: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46935 rocksdb:l ceph cwd unknown /proc/46422/task/46935/cwd (readlink: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46935 rocksdb:l ceph rtd unknown /proc/46422/task/46935/root (readlink: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46935 rocksdb:l ceph txt unknown /proc/46422/task/46935/exe (readlink: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46935 rocksdb:l ceph NOFD /proc/46422/task/46935/fd (opendir: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46936 rocksdb:h ceph cwd unknown /proc/46422/task/46936/cwd (readlink: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46936 rocksdb:h ceph rtd unknown /proc/46422/task/46936/root (readlink: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46936 rocksdb:h ceph txt unknown /proc/46422/task/46936/exe (readlink: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 46936 rocksdb:h ceph NOFD /proc/46422/task/46936/fd (opendir: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47371 bstore_ai ceph cwd unknown /proc/46422/task/47371/cwd (readlink: Permission denied) 2024-09-21T01:16:05.823 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47371 bstore_ai ceph rtd unknown /proc/46422/task/47371/root (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47371 bstore_ai ceph txt unknown /proc/46422/task/47371/exe (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47371 bstore_ai ceph NOFD /proc/46422/task/47371/fd (opendir: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47558 bstore_ai ceph cwd unknown /proc/46422/task/47558/cwd (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47558 bstore_ai ceph rtd unknown /proc/46422/task/47558/root (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47558 bstore_ai ceph txt unknown /proc/46422/task/47558/exe (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47558 bstore_ai ceph NOFD /proc/46422/task/47558/fd (opendir: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47740 ceph-osd ceph cwd unknown /proc/46422/task/47740/cwd (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47740 ceph-osd ceph rtd unknown /proc/46422/task/47740/root (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47740 ceph-osd ceph txt unknown /proc/46422/task/47740/exe (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47740 ceph-osd ceph NOFD /proc/46422/task/47740/fd (opendir: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47741 cfin ceph cwd unknown /proc/46422/task/47741/cwd (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47741 cfin ceph rtd unknown /proc/46422/task/47741/root (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47741 cfin ceph txt unknown /proc/46422/task/47741/exe (readlink: Permission denied) 2024-09-21T01:16:05.824 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47741 cfin ceph NOFD /proc/46422/task/47741/fd (opendir: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47742 bstore_kv ceph cwd unknown /proc/46422/task/47742/cwd (readlink: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47742 bstore_kv ceph rtd unknown /proc/46422/task/47742/root (readlink: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47742 bstore_kv ceph txt unknown /proc/46422/task/47742/exe (readlink: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47742 bstore_kv ceph NOFD /proc/46422/task/47742/fd (opendir: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47743 bstore_kv ceph cwd unknown /proc/46422/task/47743/cwd (readlink: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47743 bstore_kv ceph rtd unknown /proc/46422/task/47743/root (readlink: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47743 bstore_kv ceph txt unknown /proc/46422/task/47743/exe (readlink: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47743 bstore_kv ceph NOFD /proc/46422/task/47743/fd (opendir: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47744 bstore_me ceph cwd unknown /proc/46422/task/47744/cwd (readlink: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47744 bstore_me ceph rtd unknown /proc/46422/task/47744/root (readlink: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47744 bstore_me ceph txt unknown /proc/46422/task/47744/exe (readlink: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47744 bstore_me ceph NOFD /proc/46422/task/47744/fd (opendir: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47745 ms_dispat ceph cwd unknown /proc/46422/task/47745/cwd (readlink: Permission denied) 2024-09-21T01:16:05.825 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47745 ms_dispat ceph rtd unknown /proc/46422/task/47745/root (readlink: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47745 ms_dispat ceph txt unknown /proc/46422/task/47745/exe (readlink: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47745 ms_dispat ceph NOFD /proc/46422/task/47745/fd (opendir: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47746 ms_local ceph cwd unknown /proc/46422/task/47746/cwd (readlink: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47746 ms_local ceph rtd unknown /proc/46422/task/47746/root (readlink: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47746 ms_local ceph txt unknown /proc/46422/task/47746/exe (readlink: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47746 ms_local ceph NOFD /proc/46422/task/47746/fd (opendir: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47747 safe_time ceph cwd unknown /proc/46422/task/47747/cwd (readlink: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47747 safe_time ceph rtd unknown /proc/46422/task/47747/root (readlink: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47747 safe_time ceph txt unknown /proc/46422/task/47747/exe (readlink: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47747 safe_time ceph NOFD /proc/46422/task/47747/fd (opendir: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47748 safe_time ceph cwd unknown /proc/46422/task/47748/cwd (readlink: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47748 safe_time ceph rtd unknown /proc/46422/task/47748/root (readlink: Permission denied) 2024-09-21T01:16:05.826 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47748 safe_time ceph txt unknown /proc/46422/task/47748/exe (readlink: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47748 safe_time ceph NOFD /proc/46422/task/47748/fd (opendir: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47749 ms_dispat ceph cwd unknown /proc/46422/task/47749/cwd (readlink: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47749 ms_dispat ceph rtd unknown /proc/46422/task/47749/root (readlink: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47749 ms_dispat ceph txt unknown /proc/46422/task/47749/exe (readlink: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47749 ms_dispat ceph NOFD /proc/46422/task/47749/fd (opendir: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47750 ms_local ceph cwd unknown /proc/46422/task/47750/cwd (readlink: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47750 ms_local ceph rtd unknown /proc/46422/task/47750/root (readlink: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47750 ms_local ceph txt unknown /proc/46422/task/47750/exe (readlink: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47750 ms_local ceph NOFD /proc/46422/task/47750/fd (opendir: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47751 ms_dispat ceph cwd unknown /proc/46422/task/47751/cwd (readlink: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47751 ms_dispat ceph rtd unknown /proc/46422/task/47751/root (readlink: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47751 ms_dispat ceph txt unknown /proc/46422/task/47751/exe (readlink: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47751 ms_dispat ceph NOFD /proc/46422/task/47751/fd (opendir: Permission denied) 2024-09-21T01:16:05.827 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47752 ms_local ceph cwd unknown /proc/46422/task/47752/cwd (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47752 ms_local ceph rtd unknown /proc/46422/task/47752/root (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47752 ms_local ceph txt unknown /proc/46422/task/47752/exe (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47752 ms_local ceph NOFD /proc/46422/task/47752/fd (opendir: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47753 ms_dispat ceph cwd unknown /proc/46422/task/47753/cwd (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47753 ms_dispat ceph rtd unknown /proc/46422/task/47753/root (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47753 ms_dispat ceph txt unknown /proc/46422/task/47753/exe (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47753 ms_dispat ceph NOFD /proc/46422/task/47753/fd (opendir: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47754 ms_local ceph cwd unknown /proc/46422/task/47754/cwd (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47754 ms_local ceph rtd unknown /proc/46422/task/47754/root (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47754 ms_local ceph txt unknown /proc/46422/task/47754/exe (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47754 ms_local ceph NOFD /proc/46422/task/47754/fd (opendir: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47755 ms_dispat ceph cwd unknown /proc/46422/task/47755/cwd (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47755 ms_dispat ceph rtd unknown /proc/46422/task/47755/root (readlink: Permission denied) 2024-09-21T01:16:05.828 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47755 ms_dispat ceph txt unknown /proc/46422/task/47755/exe (readlink: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47755 ms_dispat ceph NOFD /proc/46422/task/47755/fd (opendir: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47756 ms_local ceph cwd unknown /proc/46422/task/47756/cwd (readlink: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47756 ms_local ceph rtd unknown /proc/46422/task/47756/root (readlink: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47756 ms_local ceph txt unknown /proc/46422/task/47756/exe (readlink: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47756 ms_local ceph NOFD /proc/46422/task/47756/fd (opendir: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47757 ms_dispat ceph cwd unknown /proc/46422/task/47757/cwd (readlink: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47757 ms_dispat ceph rtd unknown /proc/46422/task/47757/root (readlink: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47757 ms_dispat ceph txt unknown /proc/46422/task/47757/exe (readlink: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47757 ms_dispat ceph NOFD /proc/46422/task/47757/fd (opendir: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47758 ms_local ceph cwd unknown /proc/46422/task/47758/cwd (readlink: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47758 ms_local ceph rtd unknown /proc/46422/task/47758/root (readlink: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47758 ms_local ceph txt unknown /proc/46422/task/47758/exe (readlink: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47758 ms_local ceph NOFD /proc/46422/task/47758/fd (opendir: Permission denied) 2024-09-21T01:16:05.829 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47759 ms_dispat ceph cwd unknown /proc/46422/task/47759/cwd (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47759 ms_dispat ceph rtd unknown /proc/46422/task/47759/root (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47759 ms_dispat ceph txt unknown /proc/46422/task/47759/exe (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47759 ms_dispat ceph NOFD /proc/46422/task/47759/fd (opendir: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47760 ms_local ceph cwd unknown /proc/46422/task/47760/cwd (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47760 ms_local ceph rtd unknown /proc/46422/task/47760/root (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47760 ms_local ceph txt unknown /proc/46422/task/47760/exe (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47760 ms_local ceph NOFD /proc/46422/task/47760/fd (opendir: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47761 fn_anonym ceph cwd unknown /proc/46422/task/47761/cwd (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47761 fn_anonym ceph rtd unknown /proc/46422/task/47761/root (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47761 fn_anonym ceph txt unknown /proc/46422/task/47761/exe (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47761 fn_anonym ceph NOFD /proc/46422/task/47761/fd (opendir: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47762 finisher ceph cwd unknown /proc/46422/task/47762/cwd (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47762 finisher ceph rtd unknown /proc/46422/task/47762/root (readlink: Permission denied) 2024-09-21T01:16:05.830 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47762 finisher ceph txt unknown /proc/46422/task/47762/exe (readlink: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47762 finisher ceph NOFD /proc/46422/task/47762/fd (opendir: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47763 safe_time ceph cwd unknown /proc/46422/task/47763/cwd (readlink: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47763 safe_time ceph rtd unknown /proc/46422/task/47763/root (readlink: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47763 safe_time ceph txt unknown /proc/46422/task/47763/exe (readlink: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47763 safe_time ceph NOFD /proc/46422/task/47763/fd (opendir: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47764 safe_time ceph cwd unknown /proc/46422/task/47764/cwd (readlink: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47764 safe_time ceph rtd unknown /proc/46422/task/47764/root (readlink: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47764 safe_time ceph txt unknown /proc/46422/task/47764/exe (readlink: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47764 safe_time ceph NOFD /proc/46422/task/47764/fd (opendir: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47765 ceph-osd ceph cwd unknown /proc/46422/task/47765/cwd (readlink: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47765 ceph-osd ceph rtd unknown /proc/46422/task/47765/root (readlink: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47765 ceph-osd ceph txt unknown /proc/46422/task/47765/exe (readlink: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47765 ceph-osd ceph NOFD /proc/46422/task/47765/fd (opendir: Permission denied) 2024-09-21T01:16:05.831 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47766 osd_srv_a ceph cwd unknown /proc/46422/task/47766/cwd (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47766 osd_srv_a ceph rtd unknown /proc/46422/task/47766/root (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47766 osd_srv_a ceph txt unknown /proc/46422/task/47766/exe (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47766 osd_srv_a ceph NOFD /proc/46422/task/47766/fd (opendir: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47767 tp_osd_tp ceph cwd unknown /proc/46422/task/47767/cwd (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47767 tp_osd_tp ceph rtd unknown /proc/46422/task/47767/root (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47767 tp_osd_tp ceph txt unknown /proc/46422/task/47767/exe (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47767 tp_osd_tp ceph NOFD /proc/46422/task/47767/fd (opendir: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47768 tp_osd_tp ceph cwd unknown /proc/46422/task/47768/cwd (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47768 tp_osd_tp ceph rtd unknown /proc/46422/task/47768/root (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47768 tp_osd_tp ceph txt unknown /proc/46422/task/47768/exe (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47768 tp_osd_tp ceph NOFD /proc/46422/task/47768/fd (opendir: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47769 tp_osd_tp ceph cwd unknown /proc/46422/task/47769/cwd (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47769 tp_osd_tp ceph rtd unknown /proc/46422/task/47769/root (readlink: Permission denied) 2024-09-21T01:16:05.832 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47769 tp_osd_tp ceph txt unknown /proc/46422/task/47769/exe (readlink: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47769 tp_osd_tp ceph NOFD /proc/46422/task/47769/fd (opendir: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47770 tp_osd_tp ceph cwd unknown /proc/46422/task/47770/cwd (readlink: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47770 tp_osd_tp ceph rtd unknown /proc/46422/task/47770/root (readlink: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47770 tp_osd_tp ceph txt unknown /proc/46422/task/47770/exe (readlink: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47770 tp_osd_tp ceph NOFD /proc/46422/task/47770/fd (opendir: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47771 tp_osd_tp ceph cwd unknown /proc/46422/task/47771/cwd (readlink: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47771 tp_osd_tp ceph rtd unknown /proc/46422/task/47771/root (readlink: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47771 tp_osd_tp ceph txt unknown /proc/46422/task/47771/exe (readlink: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47771 tp_osd_tp ceph NOFD /proc/46422/task/47771/fd (opendir: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47772 tp_osd_tp ceph cwd unknown /proc/46422/task/47772/cwd (readlink: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47772 tp_osd_tp ceph rtd unknown /proc/46422/task/47772/root (readlink: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47772 tp_osd_tp ceph txt unknown /proc/46422/task/47772/exe (readlink: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47772 tp_osd_tp ceph NOFD /proc/46422/task/47772/fd (opendir: Permission denied) 2024-09-21T01:16:05.833 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47773 tp_osd_tp ceph cwd unknown /proc/46422/task/47773/cwd (readlink: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47773 tp_osd_tp ceph rtd unknown /proc/46422/task/47773/root (readlink: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47773 tp_osd_tp ceph txt unknown /proc/46422/task/47773/exe (readlink: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47773 tp_osd_tp ceph NOFD /proc/46422/task/47773/fd (opendir: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47774 tp_osd_tp ceph cwd unknown /proc/46422/task/47774/cwd (readlink: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47774 tp_osd_tp ceph rtd unknown /proc/46422/task/47774/root (readlink: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47774 tp_osd_tp ceph txt unknown /proc/46422/task/47774/exe (readlink: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47774 tp_osd_tp ceph NOFD /proc/46422/task/47774/fd (opendir: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47775 tp_osd_tp ceph cwd unknown /proc/46422/task/47775/cwd (readlink: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47775 tp_osd_tp ceph rtd unknown /proc/46422/task/47775/root (readlink: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47775 tp_osd_tp ceph txt unknown /proc/46422/task/47775/exe (readlink: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47775 tp_osd_tp ceph NOFD /proc/46422/task/47775/fd (opendir: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47776 tp_osd_tp ceph cwd unknown /proc/46422/task/47776/cwd (readlink: Permission denied) 2024-09-21T01:16:05.834 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47776 tp_osd_tp ceph rtd unknown /proc/46422/task/47776/root (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47776 tp_osd_tp ceph txt unknown /proc/46422/task/47776/exe (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47776 tp_osd_tp ceph NOFD /proc/46422/task/47776/fd (opendir: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47777 tp_osd_tp ceph cwd unknown /proc/46422/task/47777/cwd (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47777 tp_osd_tp ceph rtd unknown /proc/46422/task/47777/root (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47777 tp_osd_tp ceph txt unknown /proc/46422/task/47777/exe (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47777 tp_osd_tp ceph NOFD /proc/46422/task/47777/fd (opendir: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47778 tp_osd_tp ceph cwd unknown /proc/46422/task/47778/cwd (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47778 tp_osd_tp ceph rtd unknown /proc/46422/task/47778/root (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47778 tp_osd_tp ceph txt unknown /proc/46422/task/47778/exe (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47778 tp_osd_tp ceph NOFD /proc/46422/task/47778/fd (opendir: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47779 tp_osd_tp ceph cwd unknown /proc/46422/task/47779/cwd (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47779 tp_osd_tp ceph rtd unknown /proc/46422/task/47779/root (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47779 tp_osd_tp ceph txt unknown /proc/46422/task/47779/exe (readlink: Permission denied) 2024-09-21T01:16:05.835 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47779 tp_osd_tp ceph NOFD /proc/46422/task/47779/fd (opendir: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47780 tp_osd_tp ceph cwd unknown /proc/46422/task/47780/cwd (readlink: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47780 tp_osd_tp ceph rtd unknown /proc/46422/task/47780/root (readlink: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47780 tp_osd_tp ceph txt unknown /proc/46422/task/47780/exe (readlink: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47780 tp_osd_tp ceph NOFD /proc/46422/task/47780/fd (opendir: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47781 tp_osd_tp ceph cwd unknown /proc/46422/task/47781/cwd (readlink: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47781 tp_osd_tp ceph rtd unknown /proc/46422/task/47781/root (readlink: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47781 tp_osd_tp ceph txt unknown /proc/46422/task/47781/exe (readlink: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47781 tp_osd_tp ceph NOFD /proc/46422/task/47781/fd (opendir: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47782 tp_osd_tp ceph cwd unknown /proc/46422/task/47782/cwd (readlink: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47782 tp_osd_tp ceph rtd unknown /proc/46422/task/47782/root (readlink: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47782 tp_osd_tp ceph txt unknown /proc/46422/task/47782/exe (readlink: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47782 tp_osd_tp ceph NOFD /proc/46422/task/47782/fd (opendir: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47783 osd_srv_h ceph cwd unknown /proc/46422/task/47783/cwd (readlink: Permission denied) 2024-09-21T01:16:05.836 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47783 osd_srv_h ceph rtd unknown /proc/46422/task/47783/root (readlink: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47783 osd_srv_h ceph txt unknown /proc/46422/task/47783/exe (readlink: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 46422 47783 osd_srv_h ceph NOFD /proc/46422/task/47783/fd (opendir: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 47133 root cwd unknown /proc/47133/cwd (readlink: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 47133 root rtd unknown /proc/47133/root (readlink: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 47133 root txt unknown /proc/47133/exe (readlink: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 47133 root NOFD /proc/47133/fd (opendir: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 47161 root cwd unknown /proc/47161/cwd (readlink: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 47161 root rtd unknown /proc/47161/root (readlink: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 47161 root txt unknown /proc/47161/exe (readlink: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 47161 root NOFD /proc/47161/fd (opendir: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 52457 root cwd unknown /proc/52457/cwd (readlink: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 52457 root rtd unknown /proc/52457/root (readlink: Permission denied) 2024-09-21T01:16:05.837 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 52457 root txt unknown /proc/52457/exe (readlink: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 52457 root NOFD /proc/52457/fd (opendir: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 52517 root cwd unknown /proc/52517/cwd (readlink: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 52517 root rtd unknown /proc/52517/root (readlink: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 52517 root txt unknown /proc/52517/exe (readlink: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 52517 root NOFD /proc/52517/fd (opendir: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 52519 root cwd unknown /proc/52519/cwd (readlink: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 52519 root rtd unknown /proc/52519/root (readlink: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 52519 root txt unknown /proc/52519/exe (readlink: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 52519 root NOFD /proc/52519/fd (opendir: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 ceph cwd unknown /proc/52521/cwd (readlink: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 ceph rtd unknown /proc/52521/root (readlink: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 ceph txt unknown /proc/52521/exe (readlink: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 ceph NOFD /proc/52521/fd (opendir: Permission denied) 2024-09-21T01:16:05.838 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52522 log ceph cwd unknown /proc/52521/task/52522/cwd (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52522 log ceph rtd unknown /proc/52521/task/52522/root (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52522 log ceph txt unknown /proc/52521/task/52522/exe (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52522 log ceph NOFD /proc/52521/task/52522/fd (opendir: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52524 msgr-work ceph cwd unknown /proc/52521/task/52524/cwd (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52524 msgr-work ceph rtd unknown /proc/52521/task/52524/root (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52524 msgr-work ceph txt unknown /proc/52521/task/52524/exe (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52524 msgr-work ceph NOFD /proc/52521/task/52524/fd (opendir: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52525 msgr-work ceph cwd unknown /proc/52521/task/52525/cwd (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52525 msgr-work ceph rtd unknown /proc/52521/task/52525/root (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52525 msgr-work ceph txt unknown /proc/52521/task/52525/exe (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52525 msgr-work ceph NOFD /proc/52521/task/52525/fd (opendir: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52526 msgr-work ceph cwd unknown /proc/52521/task/52526/cwd (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52526 msgr-work ceph rtd unknown /proc/52521/task/52526/root (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52526 msgr-work ceph txt unknown /proc/52521/task/52526/exe (readlink: Permission denied) 2024-09-21T01:16:05.839 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52526 msgr-work ceph NOFD /proc/52521/task/52526/fd (opendir: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52530 service ceph cwd unknown /proc/52521/task/52530/cwd (readlink: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52530 service ceph rtd unknown /proc/52521/task/52530/root (readlink: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52530 service ceph txt unknown /proc/52521/task/52530/exe (readlink: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52530 service ceph NOFD /proc/52521/task/52530/fd (opendir: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52531 admin_soc ceph cwd unknown /proc/52521/task/52531/cwd (readlink: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52531 admin_soc ceph rtd unknown /proc/52521/task/52531/root (readlink: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52531 admin_soc ceph txt unknown /proc/52521/task/52531/exe (readlink: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52531 admin_soc ceph NOFD /proc/52521/task/52531/fd (opendir: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52811 signal_ha ceph cwd unknown /proc/52521/task/52811/cwd (readlink: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52811 signal_ha ceph rtd unknown /proc/52521/task/52811/root (readlink: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52811 signal_ha ceph txt unknown /proc/52521/task/52811/exe (readlink: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52811 signal_ha ceph NOFD /proc/52521/task/52811/fd (opendir: Permission denied) 2024-09-21T01:16:05.840 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52812 io_contex ceph cwd unknown /proc/52521/task/52812/cwd (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52812 io_contex ceph rtd unknown /proc/52521/task/52812/root (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52812 io_contex ceph txt unknown /proc/52521/task/52812/exe (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52812 io_contex ceph NOFD /proc/52521/task/52812/fd (opendir: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52813 io_contex ceph cwd unknown /proc/52521/task/52813/cwd (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52813 io_contex ceph rtd unknown /proc/52521/task/52813/root (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52813 io_contex ceph txt unknown /proc/52521/task/52813/exe (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52813 io_contex ceph NOFD /proc/52521/task/52813/fd (opendir: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52833 OpHistory ceph cwd unknown /proc/52521/task/52833/cwd (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52833 OpHistory ceph rtd unknown /proc/52521/task/52833/root (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52833 OpHistory ceph txt unknown /proc/52521/task/52833/exe (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52833 OpHistory ceph NOFD /proc/52521/task/52833/fd (opendir: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52834 ceph_time ceph cwd unknown /proc/52521/task/52834/cwd (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52834 ceph_time ceph rtd unknown /proc/52521/task/52834/root (readlink: Permission denied) 2024-09-21T01:16:05.841 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52834 ceph_time ceph txt unknown /proc/52521/task/52834/exe (readlink: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 52834 ceph_time ceph NOFD /proc/52521/task/52834/fd (opendir: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53043 ceph-osd ceph cwd unknown /proc/52521/task/53043/cwd (readlink: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53043 ceph-osd ceph rtd unknown /proc/52521/task/53043/root (readlink: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53043 ceph-osd ceph txt unknown /proc/52521/task/53043/exe (readlink: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53043 ceph-osd ceph NOFD /proc/52521/task/53043/fd (opendir: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53044 safe_time ceph cwd unknown /proc/52521/task/53044/cwd (readlink: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53044 safe_time ceph rtd unknown /proc/52521/task/53044/root (readlink: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53044 safe_time ceph txt unknown /proc/52521/task/53044/exe (readlink: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53044 safe_time ceph NOFD /proc/52521/task/53044/fd (opendir: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53045 safe_time ceph cwd unknown /proc/52521/task/53045/cwd (readlink: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53045 safe_time ceph rtd unknown /proc/52521/task/53045/root (readlink: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53045 safe_time ceph txt unknown /proc/52521/task/53045/exe (readlink: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53045 safe_time ceph NOFD /proc/52521/task/53045/fd (opendir: Permission denied) 2024-09-21T01:16:05.842 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53046 safe_time ceph cwd unknown /proc/52521/task/53046/cwd (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53046 safe_time ceph rtd unknown /proc/52521/task/53046/root (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53046 safe_time ceph txt unknown /proc/52521/task/53046/exe (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53046 safe_time ceph NOFD /proc/52521/task/53046/fd (opendir: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53047 safe_time ceph cwd unknown /proc/52521/task/53047/cwd (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53047 safe_time ceph rtd unknown /proc/52521/task/53047/root (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53047 safe_time ceph txt unknown /proc/52521/task/53047/exe (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53047 safe_time ceph NOFD /proc/52521/task/53047/fd (opendir: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53048 fn_anonym ceph cwd unknown /proc/52521/task/53048/cwd (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53048 fn_anonym ceph rtd unknown /proc/52521/task/53048/root (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53048 fn_anonym ceph txt unknown /proc/52521/task/53048/exe (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53048 fn_anonym ceph NOFD /proc/52521/task/53048/fd (opendir: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53124 rocksdb:l ceph cwd unknown /proc/52521/task/53124/cwd (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53124 rocksdb:l ceph rtd unknown /proc/52521/task/53124/root (readlink: Permission denied) 2024-09-21T01:16:05.843 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53124 rocksdb:l ceph txt unknown /proc/52521/task/53124/exe (readlink: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53124 rocksdb:l ceph NOFD /proc/52521/task/53124/fd (opendir: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53125 rocksdb:l ceph cwd unknown /proc/52521/task/53125/cwd (readlink: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53125 rocksdb:l ceph rtd unknown /proc/52521/task/53125/root (readlink: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53125 rocksdb:l ceph txt unknown /proc/52521/task/53125/exe (readlink: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53125 rocksdb:l ceph NOFD /proc/52521/task/53125/fd (opendir: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53126 rocksdb:l ceph cwd unknown /proc/52521/task/53126/cwd (readlink: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53126 rocksdb:l ceph rtd unknown /proc/52521/task/53126/root (readlink: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53126 rocksdb:l ceph txt unknown /proc/52521/task/53126/exe (readlink: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53126 rocksdb:l ceph NOFD /proc/52521/task/53126/fd (opendir: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53127 rocksdb:h ceph cwd unknown /proc/52521/task/53127/cwd (readlink: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53127 rocksdb:h ceph rtd unknown /proc/52521/task/53127/root (readlink: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53127 rocksdb:h ceph txt unknown /proc/52521/task/53127/exe (readlink: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53127 rocksdb:h ceph NOFD /proc/52521/task/53127/fd (opendir: Permission denied) 2024-09-21T01:16:05.844 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53526 bstore_ai ceph cwd unknown /proc/52521/task/53526/cwd (readlink: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53526 bstore_ai ceph rtd unknown /proc/52521/task/53526/root (readlink: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53526 bstore_ai ceph txt unknown /proc/52521/task/53526/exe (readlink: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53526 bstore_ai ceph NOFD /proc/52521/task/53526/fd (opendir: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53734 bstore_ai ceph cwd unknown /proc/52521/task/53734/cwd (readlink: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53734 bstore_ai ceph rtd unknown /proc/52521/task/53734/root (readlink: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53734 bstore_ai ceph txt unknown /proc/52521/task/53734/exe (readlink: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53734 bstore_ai ceph NOFD /proc/52521/task/53734/fd (opendir: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53916 ceph-osd ceph cwd unknown /proc/52521/task/53916/cwd (readlink: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53916 ceph-osd ceph rtd unknown /proc/52521/task/53916/root (readlink: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53916 ceph-osd ceph txt unknown /proc/52521/task/53916/exe (readlink: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53916 ceph-osd ceph NOFD /proc/52521/task/53916/fd (opendir: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53917 cfin ceph cwd unknown /proc/52521/task/53917/cwd (readlink: Permission denied) 2024-09-21T01:16:05.845 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53917 cfin ceph rtd unknown /proc/52521/task/53917/root (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53917 cfin ceph txt unknown /proc/52521/task/53917/exe (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53917 cfin ceph NOFD /proc/52521/task/53917/fd (opendir: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53918 bstore_kv ceph cwd unknown /proc/52521/task/53918/cwd (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53918 bstore_kv ceph rtd unknown /proc/52521/task/53918/root (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53918 bstore_kv ceph txt unknown /proc/52521/task/53918/exe (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53918 bstore_kv ceph NOFD /proc/52521/task/53918/fd (opendir: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53919 bstore_kv ceph cwd unknown /proc/52521/task/53919/cwd (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53919 bstore_kv ceph rtd unknown /proc/52521/task/53919/root (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53919 bstore_kv ceph txt unknown /proc/52521/task/53919/exe (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53919 bstore_kv ceph NOFD /proc/52521/task/53919/fd (opendir: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53920 bstore_me ceph cwd unknown /proc/52521/task/53920/cwd (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53920 bstore_me ceph rtd unknown /proc/52521/task/53920/root (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53920 bstore_me ceph txt unknown /proc/52521/task/53920/exe (readlink: Permission denied) 2024-09-21T01:16:05.846 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53920 bstore_me ceph NOFD /proc/52521/task/53920/fd (opendir: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53923 ms_dispat ceph cwd unknown /proc/52521/task/53923/cwd (readlink: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53923 ms_dispat ceph rtd unknown /proc/52521/task/53923/root (readlink: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53923 ms_dispat ceph txt unknown /proc/52521/task/53923/exe (readlink: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53923 ms_dispat ceph NOFD /proc/52521/task/53923/fd (opendir: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53924 ms_local ceph cwd unknown /proc/52521/task/53924/cwd (readlink: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53924 ms_local ceph rtd unknown /proc/52521/task/53924/root (readlink: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53924 ms_local ceph txt unknown /proc/52521/task/53924/exe (readlink: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53924 ms_local ceph NOFD /proc/52521/task/53924/fd (opendir: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53925 safe_time ceph cwd unknown /proc/52521/task/53925/cwd (readlink: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53925 safe_time ceph rtd unknown /proc/52521/task/53925/root (readlink: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53925 safe_time ceph txt unknown /proc/52521/task/53925/exe (readlink: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53925 safe_time ceph NOFD /proc/52521/task/53925/fd (opendir: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53926 safe_time ceph cwd unknown /proc/52521/task/53926/cwd (readlink: Permission denied) 2024-09-21T01:16:05.847 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53926 safe_time ceph rtd unknown /proc/52521/task/53926/root (readlink: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53926 safe_time ceph txt unknown /proc/52521/task/53926/exe (readlink: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53926 safe_time ceph NOFD /proc/52521/task/53926/fd (opendir: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53927 ms_dispat ceph cwd unknown /proc/52521/task/53927/cwd (readlink: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53927 ms_dispat ceph rtd unknown /proc/52521/task/53927/root (readlink: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53927 ms_dispat ceph txt unknown /proc/52521/task/53927/exe (readlink: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53927 ms_dispat ceph NOFD /proc/52521/task/53927/fd (opendir: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53928 ms_local ceph cwd unknown /proc/52521/task/53928/cwd (readlink: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53928 ms_local ceph rtd unknown /proc/52521/task/53928/root (readlink: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53928 ms_local ceph txt unknown /proc/52521/task/53928/exe (readlink: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53928 ms_local ceph NOFD /proc/52521/task/53928/fd (opendir: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53929 ms_dispat ceph cwd unknown /proc/52521/task/53929/cwd (readlink: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53929 ms_dispat ceph rtd unknown /proc/52521/task/53929/root (readlink: Permission denied) 2024-09-21T01:16:05.848 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53929 ms_dispat ceph txt unknown /proc/52521/task/53929/exe (readlink: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53929 ms_dispat ceph NOFD /proc/52521/task/53929/fd (opendir: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53930 ms_local ceph cwd unknown /proc/52521/task/53930/cwd (readlink: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53930 ms_local ceph rtd unknown /proc/52521/task/53930/root (readlink: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53930 ms_local ceph txt unknown /proc/52521/task/53930/exe (readlink: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53930 ms_local ceph NOFD /proc/52521/task/53930/fd (opendir: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53931 ms_dispat ceph cwd unknown /proc/52521/task/53931/cwd (readlink: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53931 ms_dispat ceph rtd unknown /proc/52521/task/53931/root (readlink: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53931 ms_dispat ceph txt unknown /proc/52521/task/53931/exe (readlink: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53931 ms_dispat ceph NOFD /proc/52521/task/53931/fd (opendir: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53932 ms_local ceph cwd unknown /proc/52521/task/53932/cwd (readlink: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53932 ms_local ceph rtd unknown /proc/52521/task/53932/root (readlink: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53932 ms_local ceph txt unknown /proc/52521/task/53932/exe (readlink: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53932 ms_local ceph NOFD /proc/52521/task/53932/fd (opendir: Permission denied) 2024-09-21T01:16:05.849 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53933 ms_dispat ceph cwd unknown /proc/52521/task/53933/cwd (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53933 ms_dispat ceph rtd unknown /proc/52521/task/53933/root (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53933 ms_dispat ceph txt unknown /proc/52521/task/53933/exe (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53933 ms_dispat ceph NOFD /proc/52521/task/53933/fd (opendir: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53934 ms_local ceph cwd unknown /proc/52521/task/53934/cwd (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53934 ms_local ceph rtd unknown /proc/52521/task/53934/root (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53934 ms_local ceph txt unknown /proc/52521/task/53934/exe (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53934 ms_local ceph NOFD /proc/52521/task/53934/fd (opendir: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53935 ms_dispat ceph cwd unknown /proc/52521/task/53935/cwd (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53935 ms_dispat ceph rtd unknown /proc/52521/task/53935/root (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53935 ms_dispat ceph txt unknown /proc/52521/task/53935/exe (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53935 ms_dispat ceph NOFD /proc/52521/task/53935/fd (opendir: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53936 ms_local ceph cwd unknown /proc/52521/task/53936/cwd (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53936 ms_local ceph rtd unknown /proc/52521/task/53936/root (readlink: Permission denied) 2024-09-21T01:16:05.850 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53936 ms_local ceph txt unknown /proc/52521/task/53936/exe (readlink: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53936 ms_local ceph NOFD /proc/52521/task/53936/fd (opendir: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53937 ms_dispat ceph cwd unknown /proc/52521/task/53937/cwd (readlink: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53937 ms_dispat ceph rtd unknown /proc/52521/task/53937/root (readlink: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53937 ms_dispat ceph txt unknown /proc/52521/task/53937/exe (readlink: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53937 ms_dispat ceph NOFD /proc/52521/task/53937/fd (opendir: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53938 ms_local ceph cwd unknown /proc/52521/task/53938/cwd (readlink: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53938 ms_local ceph rtd unknown /proc/52521/task/53938/root (readlink: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53938 ms_local ceph txt unknown /proc/52521/task/53938/exe (readlink: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53938 ms_local ceph NOFD /proc/52521/task/53938/fd (opendir: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53939 fn_anonym ceph cwd unknown /proc/52521/task/53939/cwd (readlink: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53939 fn_anonym ceph rtd unknown /proc/52521/task/53939/root (readlink: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53939 fn_anonym ceph txt unknown /proc/52521/task/53939/exe (readlink: Permission denied) 2024-09-21T01:16:05.851 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53939 fn_anonym ceph NOFD /proc/52521/task/53939/fd (opendir: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53940 finisher ceph cwd unknown /proc/52521/task/53940/cwd (readlink: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53940 finisher ceph rtd unknown /proc/52521/task/53940/root (readlink: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53940 finisher ceph txt unknown /proc/52521/task/53940/exe (readlink: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53940 finisher ceph NOFD /proc/52521/task/53940/fd (opendir: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53941 safe_time ceph cwd unknown /proc/52521/task/53941/cwd (readlink: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53941 safe_time ceph rtd unknown /proc/52521/task/53941/root (readlink: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53941 safe_time ceph txt unknown /proc/52521/task/53941/exe (readlink: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53941 safe_time ceph NOFD /proc/52521/task/53941/fd (opendir: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53942 safe_time ceph cwd unknown /proc/52521/task/53942/cwd (readlink: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53942 safe_time ceph rtd unknown /proc/52521/task/53942/root (readlink: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53942 safe_time ceph txt unknown /proc/52521/task/53942/exe (readlink: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53942 safe_time ceph NOFD /proc/52521/task/53942/fd (opendir: Permission denied) 2024-09-21T01:16:05.852 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53943 ceph-osd ceph cwd unknown /proc/52521/task/53943/cwd (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53943 ceph-osd ceph rtd unknown /proc/52521/task/53943/root (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53943 ceph-osd ceph txt unknown /proc/52521/task/53943/exe (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53943 ceph-osd ceph NOFD /proc/52521/task/53943/fd (opendir: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53944 osd_srv_a ceph cwd unknown /proc/52521/task/53944/cwd (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53944 osd_srv_a ceph rtd unknown /proc/52521/task/53944/root (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53944 osd_srv_a ceph txt unknown /proc/52521/task/53944/exe (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53944 osd_srv_a ceph NOFD /proc/52521/task/53944/fd (opendir: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53945 tp_osd_tp ceph cwd unknown /proc/52521/task/53945/cwd (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53945 tp_osd_tp ceph rtd unknown /proc/52521/task/53945/root (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53945 tp_osd_tp ceph txt unknown /proc/52521/task/53945/exe (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53945 tp_osd_tp ceph NOFD /proc/52521/task/53945/fd (opendir: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53946 tp_osd_tp ceph cwd unknown /proc/52521/task/53946/cwd (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53946 tp_osd_tp ceph rtd unknown /proc/52521/task/53946/root (readlink: Permission denied) 2024-09-21T01:16:05.853 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53946 tp_osd_tp ceph txt unknown /proc/52521/task/53946/exe (readlink: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53946 tp_osd_tp ceph NOFD /proc/52521/task/53946/fd (opendir: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53947 tp_osd_tp ceph cwd unknown /proc/52521/task/53947/cwd (readlink: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53947 tp_osd_tp ceph rtd unknown /proc/52521/task/53947/root (readlink: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53947 tp_osd_tp ceph txt unknown /proc/52521/task/53947/exe (readlink: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53947 tp_osd_tp ceph NOFD /proc/52521/task/53947/fd (opendir: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53948 tp_osd_tp ceph cwd unknown /proc/52521/task/53948/cwd (readlink: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53948 tp_osd_tp ceph rtd unknown /proc/52521/task/53948/root (readlink: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53948 tp_osd_tp ceph txt unknown /proc/52521/task/53948/exe (readlink: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53948 tp_osd_tp ceph NOFD /proc/52521/task/53948/fd (opendir: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53949 tp_osd_tp ceph cwd unknown /proc/52521/task/53949/cwd (readlink: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53949 tp_osd_tp ceph rtd unknown /proc/52521/task/53949/root (readlink: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53949 tp_osd_tp ceph txt unknown /proc/52521/task/53949/exe (readlink: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53949 tp_osd_tp ceph NOFD /proc/52521/task/53949/fd (opendir: Permission denied) 2024-09-21T01:16:05.854 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53950 tp_osd_tp ceph cwd unknown /proc/52521/task/53950/cwd (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53950 tp_osd_tp ceph rtd unknown /proc/52521/task/53950/root (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53950 tp_osd_tp ceph txt unknown /proc/52521/task/53950/exe (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53950 tp_osd_tp ceph NOFD /proc/52521/task/53950/fd (opendir: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53951 tp_osd_tp ceph cwd unknown /proc/52521/task/53951/cwd (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53951 tp_osd_tp ceph rtd unknown /proc/52521/task/53951/root (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53951 tp_osd_tp ceph txt unknown /proc/52521/task/53951/exe (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53951 tp_osd_tp ceph NOFD /proc/52521/task/53951/fd (opendir: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53952 tp_osd_tp ceph cwd unknown /proc/52521/task/53952/cwd (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53952 tp_osd_tp ceph rtd unknown /proc/52521/task/53952/root (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53952 tp_osd_tp ceph txt unknown /proc/52521/task/53952/exe (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53952 tp_osd_tp ceph NOFD /proc/52521/task/53952/fd (opendir: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53953 tp_osd_tp ceph cwd unknown /proc/52521/task/53953/cwd (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53953 tp_osd_tp ceph rtd unknown /proc/52521/task/53953/root (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53953 tp_osd_tp ceph txt unknown /proc/52521/task/53953/exe (readlink: Permission denied) 2024-09-21T01:16:05.855 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53953 tp_osd_tp ceph NOFD /proc/52521/task/53953/fd (opendir: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53954 tp_osd_tp ceph cwd unknown /proc/52521/task/53954/cwd (readlink: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53954 tp_osd_tp ceph rtd unknown /proc/52521/task/53954/root (readlink: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53954 tp_osd_tp ceph txt unknown /proc/52521/task/53954/exe (readlink: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53954 tp_osd_tp ceph NOFD /proc/52521/task/53954/fd (opendir: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53955 tp_osd_tp ceph cwd unknown /proc/52521/task/53955/cwd (readlink: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53955 tp_osd_tp ceph rtd unknown /proc/52521/task/53955/root (readlink: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53955 tp_osd_tp ceph txt unknown /proc/52521/task/53955/exe (readlink: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53955 tp_osd_tp ceph NOFD /proc/52521/task/53955/fd (opendir: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53956 tp_osd_tp ceph cwd unknown /proc/52521/task/53956/cwd (readlink: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53956 tp_osd_tp ceph rtd unknown /proc/52521/task/53956/root (readlink: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53956 tp_osd_tp ceph txt unknown /proc/52521/task/53956/exe (readlink: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53956 tp_osd_tp ceph NOFD /proc/52521/task/53956/fd (opendir: Permission denied) 2024-09-21T01:16:05.856 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53957 tp_osd_tp ceph cwd unknown /proc/52521/task/53957/cwd (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53957 tp_osd_tp ceph rtd unknown /proc/52521/task/53957/root (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53957 tp_osd_tp ceph txt unknown /proc/52521/task/53957/exe (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53957 tp_osd_tp ceph NOFD /proc/52521/task/53957/fd (opendir: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53958 tp_osd_tp ceph cwd unknown /proc/52521/task/53958/cwd (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53958 tp_osd_tp ceph rtd unknown /proc/52521/task/53958/root (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53958 tp_osd_tp ceph txt unknown /proc/52521/task/53958/exe (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53958 tp_osd_tp ceph NOFD /proc/52521/task/53958/fd (opendir: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53959 tp_osd_tp ceph cwd unknown /proc/52521/task/53959/cwd (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53959 tp_osd_tp ceph rtd unknown /proc/52521/task/53959/root (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53959 tp_osd_tp ceph txt unknown /proc/52521/task/53959/exe (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53959 tp_osd_tp ceph NOFD /proc/52521/task/53959/fd (opendir: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53960 tp_osd_tp ceph cwd unknown /proc/52521/task/53960/cwd (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53960 tp_osd_tp ceph rtd unknown /proc/52521/task/53960/root (readlink: Permission denied) 2024-09-21T01:16:05.857 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53960 tp_osd_tp ceph txt unknown /proc/52521/task/53960/exe (readlink: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53960 tp_osd_tp ceph NOFD /proc/52521/task/53960/fd (opendir: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53961 osd_srv_h ceph cwd unknown /proc/52521/task/53961/cwd (readlink: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53961 osd_srv_h ceph rtd unknown /proc/52521/task/53961/root (readlink: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53961 osd_srv_h ceph txt unknown /proc/52521/task/53961/exe (readlink: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 52521 53961 osd_srv_h ceph NOFD /proc/52521/task/53961/fd (opendir: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 53016 root cwd unknown /proc/53016/cwd (readlink: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 53016 root rtd unknown /proc/53016/root (readlink: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 53016 root txt unknown /proc/53016/exe (readlink: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 53016 root NOFD /proc/53016/fd (opendir: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 53055 root cwd unknown /proc/53055/cwd (readlink: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 53055 root rtd unknown /proc/53055/root (readlink: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 53055 root txt unknown /proc/53055/exe (readlink: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 53055 root NOFD /proc/53055/fd (opendir: Permission denied) 2024-09-21T01:16:05.858 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 53074 root cwd unknown /proc/53074/cwd (readlink: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 53074 root rtd unknown /proc/53074/root (readlink: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 53074 root txt unknown /proc/53074/exe (readlink: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 53074 root NOFD /proc/53074/fd (opendir: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 56446 root cwd unknown /proc/56446/cwd (readlink: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 56446 root rtd unknown /proc/56446/root (readlink: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 56446 root txt unknown /proc/56446/exe (readlink: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 56446 root NOFD /proc/56446/fd (opendir: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 59093 root cwd unknown /proc/59093/cwd (readlink: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 59093 root rtd unknown /proc/59093/root (readlink: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 59093 root txt unknown /proc/59093/exe (readlink: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 59093 root NOFD /proc/59093/fd (opendir: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 59095 root cwd unknown /proc/59095/cwd (readlink: Permission denied) 2024-09-21T01:16:05.859 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 59095 root rtd unknown /proc/59095/root (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 59095 root txt unknown /proc/59095/exe (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 59095 root NOFD /proc/59095/fd (opendir: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 ceph cwd unknown /proc/59097/cwd (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 ceph rtd unknown /proc/59097/root (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 ceph txt unknown /proc/59097/exe (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 ceph NOFD /proc/59097/fd (opendir: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59098 log ceph cwd unknown /proc/59097/task/59098/cwd (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59098 log ceph rtd unknown /proc/59097/task/59098/root (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59098 log ceph txt unknown /proc/59097/task/59098/exe (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59098 log ceph NOFD /proc/59097/task/59098/fd (opendir: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59100 msgr-work ceph cwd unknown /proc/59097/task/59100/cwd (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59100 msgr-work ceph rtd unknown /proc/59097/task/59100/root (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59100 msgr-work ceph txt unknown /proc/59097/task/59100/exe (readlink: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59100 msgr-work ceph NOFD /proc/59097/task/59100/fd (opendir: Permission denied) 2024-09-21T01:16:05.860 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59101 msgr-work ceph cwd unknown /proc/59097/task/59101/cwd (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59101 msgr-work ceph rtd unknown /proc/59097/task/59101/root (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59101 msgr-work ceph txt unknown /proc/59097/task/59101/exe (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59101 msgr-work ceph NOFD /proc/59097/task/59101/fd (opendir: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59102 msgr-work ceph cwd unknown /proc/59097/task/59102/cwd (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59102 msgr-work ceph rtd unknown /proc/59097/task/59102/root (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59102 msgr-work ceph txt unknown /proc/59097/task/59102/exe (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59102 msgr-work ceph NOFD /proc/59097/task/59102/fd (opendir: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59106 service ceph cwd unknown /proc/59097/task/59106/cwd (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59106 service ceph rtd unknown /proc/59097/task/59106/root (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59106 service ceph txt unknown /proc/59097/task/59106/exe (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59106 service ceph NOFD /proc/59097/task/59106/fd (opendir: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59107 admin_soc ceph cwd unknown /proc/59097/task/59107/cwd (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59107 admin_soc ceph rtd unknown /proc/59097/task/59107/root (readlink: Permission denied) 2024-09-21T01:16:05.861 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59107 admin_soc ceph txt unknown /proc/59097/task/59107/exe (readlink: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59107 admin_soc ceph NOFD /proc/59097/task/59107/fd (opendir: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59377 signal_ha ceph cwd unknown /proc/59097/task/59377/cwd (readlink: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59377 signal_ha ceph rtd unknown /proc/59097/task/59377/root (readlink: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59377 signal_ha ceph txt unknown /proc/59097/task/59377/exe (readlink: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59377 signal_ha ceph NOFD /proc/59097/task/59377/fd (opendir: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59378 io_contex ceph cwd unknown /proc/59097/task/59378/cwd (readlink: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59378 io_contex ceph rtd unknown /proc/59097/task/59378/root (readlink: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59378 io_contex ceph txt unknown /proc/59097/task/59378/exe (readlink: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59378 io_contex ceph NOFD /proc/59097/task/59378/fd (opendir: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59379 io_contex ceph cwd unknown /proc/59097/task/59379/cwd (readlink: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59379 io_contex ceph rtd unknown /proc/59097/task/59379/root (readlink: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59379 io_contex ceph txt unknown /proc/59097/task/59379/exe (readlink: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59379 io_contex ceph NOFD /proc/59097/task/59379/fd (opendir: Permission denied) 2024-09-21T01:16:05.862 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59393 OpHistory ceph cwd unknown /proc/59097/task/59393/cwd (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59393 OpHistory ceph rtd unknown /proc/59097/task/59393/root (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59393 OpHistory ceph txt unknown /proc/59097/task/59393/exe (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59393 OpHistory ceph NOFD /proc/59097/task/59393/fd (opendir: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59394 ceph_time ceph cwd unknown /proc/59097/task/59394/cwd (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59394 ceph_time ceph rtd unknown /proc/59097/task/59394/root (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59394 ceph_time ceph txt unknown /proc/59097/task/59394/exe (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59394 ceph_time ceph NOFD /proc/59097/task/59394/fd (opendir: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59401 ceph-osd ceph cwd unknown /proc/59097/task/59401/cwd (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59401 ceph-osd ceph rtd unknown /proc/59097/task/59401/root (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59401 ceph-osd ceph txt unknown /proc/59097/task/59401/exe (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59401 ceph-osd ceph NOFD /proc/59097/task/59401/fd (opendir: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59441 ceph-osd ceph cwd unknown /proc/59097/task/59441/cwd (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59441 ceph-osd ceph rtd unknown /proc/59097/task/59441/root (readlink: Permission denied) 2024-09-21T01:16:05.863 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59441 ceph-osd ceph txt unknown /proc/59097/task/59441/exe (readlink: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59441 ceph-osd ceph NOFD /proc/59097/task/59441/fd (opendir: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59512 ceph-osd ceph cwd unknown /proc/59097/task/59512/cwd (readlink: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59512 ceph-osd ceph rtd unknown /proc/59097/task/59512/root (readlink: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59512 ceph-osd ceph txt unknown /proc/59097/task/59512/exe (readlink: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59512 ceph-osd ceph NOFD /proc/59097/task/59512/fd (opendir: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59528 ceph-osd ceph cwd unknown /proc/59097/task/59528/cwd (readlink: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59528 ceph-osd ceph rtd unknown /proc/59097/task/59528/root (readlink: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59528 ceph-osd ceph txt unknown /proc/59097/task/59528/exe (readlink: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59528 ceph-osd ceph NOFD /proc/59097/task/59528/fd (opendir: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59545 ceph-osd ceph cwd unknown /proc/59097/task/59545/cwd (readlink: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59545 ceph-osd ceph rtd unknown /proc/59097/task/59545/root (readlink: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59545 ceph-osd ceph txt unknown /proc/59097/task/59545/exe (readlink: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59545 ceph-osd ceph NOFD /proc/59097/task/59545/fd (opendir: Permission denied) 2024-09-21T01:16:05.864 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59548 ceph-osd ceph cwd unknown /proc/59097/task/59548/cwd (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59548 ceph-osd ceph rtd unknown /proc/59097/task/59548/root (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59548 ceph-osd ceph txt unknown /proc/59097/task/59548/exe (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59548 ceph-osd ceph NOFD /proc/59097/task/59548/fd (opendir: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59600 ceph-osd ceph cwd unknown /proc/59097/task/59600/cwd (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59600 ceph-osd ceph rtd unknown /proc/59097/task/59600/root (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59600 ceph-osd ceph txt unknown /proc/59097/task/59600/exe (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59600 ceph-osd ceph NOFD /proc/59097/task/59600/fd (opendir: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59627 ceph-osd ceph cwd unknown /proc/59097/task/59627/cwd (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59627 ceph-osd ceph rtd unknown /proc/59097/task/59627/root (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59627 ceph-osd ceph txt unknown /proc/59097/task/59627/exe (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59627 ceph-osd ceph NOFD /proc/59097/task/59627/fd (opendir: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59628 ceph-osd ceph cwd unknown /proc/59097/task/59628/cwd (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59628 ceph-osd ceph rtd unknown /proc/59097/task/59628/root (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59628 ceph-osd ceph txt unknown /proc/59097/task/59628/exe (readlink: Permission denied) 2024-09-21T01:16:05.865 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59628 ceph-osd ceph NOFD /proc/59097/task/59628/fd (opendir: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59629 safe_time ceph cwd unknown /proc/59097/task/59629/cwd (readlink: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59629 safe_time ceph rtd unknown /proc/59097/task/59629/root (readlink: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59629 safe_time ceph txt unknown /proc/59097/task/59629/exe (readlink: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59629 safe_time ceph NOFD /proc/59097/task/59629/fd (opendir: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59630 safe_time ceph cwd unknown /proc/59097/task/59630/cwd (readlink: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59630 safe_time ceph rtd unknown /proc/59097/task/59630/root (readlink: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59630 safe_time ceph txt unknown /proc/59097/task/59630/exe (readlink: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59630 safe_time ceph NOFD /proc/59097/task/59630/fd (opendir: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59631 safe_time ceph cwd unknown /proc/59097/task/59631/cwd (readlink: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59631 safe_time ceph rtd unknown /proc/59097/task/59631/root (readlink: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59631 safe_time ceph txt unknown /proc/59097/task/59631/exe (readlink: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59631 safe_time ceph NOFD /proc/59097/task/59631/fd (opendir: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59632 safe_time ceph cwd unknown /proc/59097/task/59632/cwd (readlink: Permission denied) 2024-09-21T01:16:05.866 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59632 safe_time ceph rtd unknown /proc/59097/task/59632/root (readlink: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59632 safe_time ceph txt unknown /proc/59097/task/59632/exe (readlink: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59632 safe_time ceph NOFD /proc/59097/task/59632/fd (opendir: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59633 fn_anonym ceph cwd unknown /proc/59097/task/59633/cwd (readlink: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59633 fn_anonym ceph rtd unknown /proc/59097/task/59633/root (readlink: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59633 fn_anonym ceph txt unknown /proc/59097/task/59633/exe (readlink: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59633 fn_anonym ceph NOFD /proc/59097/task/59633/fd (opendir: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59712 rocksdb:l ceph cwd unknown /proc/59097/task/59712/cwd (readlink: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59712 rocksdb:l ceph rtd unknown /proc/59097/task/59712/root (readlink: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59712 rocksdb:l ceph txt unknown /proc/59097/task/59712/exe (readlink: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59712 rocksdb:l ceph NOFD /proc/59097/task/59712/fd (opendir: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59713 rocksdb:l ceph cwd unknown /proc/59097/task/59713/cwd (readlink: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59713 rocksdb:l ceph rtd unknown /proc/59097/task/59713/root (readlink: Permission denied) 2024-09-21T01:16:05.867 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59713 rocksdb:l ceph txt unknown /proc/59097/task/59713/exe (readlink: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59713 rocksdb:l ceph NOFD /proc/59097/task/59713/fd (opendir: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59714 rocksdb:l ceph cwd unknown /proc/59097/task/59714/cwd (readlink: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59714 rocksdb:l ceph rtd unknown /proc/59097/task/59714/root (readlink: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59714 rocksdb:l ceph txt unknown /proc/59097/task/59714/exe (readlink: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59714 rocksdb:l ceph NOFD /proc/59097/task/59714/fd (opendir: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59715 rocksdb:h ceph cwd unknown /proc/59097/task/59715/cwd (readlink: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59715 rocksdb:h ceph rtd unknown /proc/59097/task/59715/root (readlink: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59715 rocksdb:h ceph txt unknown /proc/59097/task/59715/exe (readlink: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 59715 rocksdb:h ceph NOFD /proc/59097/task/59715/fd (opendir: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60115 bstore_ai ceph cwd unknown /proc/59097/task/60115/cwd (readlink: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60115 bstore_ai ceph rtd unknown /proc/59097/task/60115/root (readlink: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60115 bstore_ai ceph txt unknown /proc/59097/task/60115/exe (readlink: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60115 bstore_ai ceph NOFD /proc/59097/task/60115/fd (opendir: Permission denied) 2024-09-21T01:16:05.868 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60320 bstore_ai ceph cwd unknown /proc/59097/task/60320/cwd (readlink: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60320 bstore_ai ceph rtd unknown /proc/59097/task/60320/root (readlink: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60320 bstore_ai ceph txt unknown /proc/59097/task/60320/exe (readlink: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60320 bstore_ai ceph NOFD /proc/59097/task/60320/fd (opendir: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60505 ceph-osd ceph cwd unknown /proc/59097/task/60505/cwd (readlink: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60505 ceph-osd ceph rtd unknown /proc/59097/task/60505/root (readlink: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60505 ceph-osd ceph txt unknown /proc/59097/task/60505/exe (readlink: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60505 ceph-osd ceph NOFD /proc/59097/task/60505/fd (opendir: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60506 cfin ceph cwd unknown /proc/59097/task/60506/cwd (readlink: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60506 cfin ceph rtd unknown /proc/59097/task/60506/root (readlink: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60506 cfin ceph txt unknown /proc/59097/task/60506/exe (readlink: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60506 cfin ceph NOFD /proc/59097/task/60506/fd (opendir: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60507 bstore_kv ceph cwd unknown /proc/59097/task/60507/cwd (readlink: Permission denied) 2024-09-21T01:16:05.869 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60507 bstore_kv ceph rtd unknown /proc/59097/task/60507/root (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60507 bstore_kv ceph txt unknown /proc/59097/task/60507/exe (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60507 bstore_kv ceph NOFD /proc/59097/task/60507/fd (opendir: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60508 bstore_kv ceph cwd unknown /proc/59097/task/60508/cwd (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60508 bstore_kv ceph rtd unknown /proc/59097/task/60508/root (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60508 bstore_kv ceph txt unknown /proc/59097/task/60508/exe (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60508 bstore_kv ceph NOFD /proc/59097/task/60508/fd (opendir: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60509 bstore_me ceph cwd unknown /proc/59097/task/60509/cwd (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60509 bstore_me ceph rtd unknown /proc/59097/task/60509/root (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60509 bstore_me ceph txt unknown /proc/59097/task/60509/exe (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60509 bstore_me ceph NOFD /proc/59097/task/60509/fd (opendir: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60510 ms_dispat ceph cwd unknown /proc/59097/task/60510/cwd (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60510 ms_dispat ceph rtd unknown /proc/59097/task/60510/root (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60510 ms_dispat ceph txt unknown /proc/59097/task/60510/exe (readlink: Permission denied) 2024-09-21T01:16:05.870 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60510 ms_dispat ceph NOFD /proc/59097/task/60510/fd (opendir: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60511 ms_local ceph cwd unknown /proc/59097/task/60511/cwd (readlink: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60511 ms_local ceph rtd unknown /proc/59097/task/60511/root (readlink: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60511 ms_local ceph txt unknown /proc/59097/task/60511/exe (readlink: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60511 ms_local ceph NOFD /proc/59097/task/60511/fd (opendir: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60512 safe_time ceph cwd unknown /proc/59097/task/60512/cwd (readlink: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60512 safe_time ceph rtd unknown /proc/59097/task/60512/root (readlink: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60512 safe_time ceph txt unknown /proc/59097/task/60512/exe (readlink: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60512 safe_time ceph NOFD /proc/59097/task/60512/fd (opendir: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60513 safe_time ceph cwd unknown /proc/59097/task/60513/cwd (readlink: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60513 safe_time ceph rtd unknown /proc/59097/task/60513/root (readlink: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60513 safe_time ceph txt unknown /proc/59097/task/60513/exe (readlink: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60513 safe_time ceph NOFD /proc/59097/task/60513/fd (opendir: Permission denied) 2024-09-21T01:16:05.871 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60514 ms_dispat ceph cwd unknown /proc/59097/task/60514/cwd (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60514 ms_dispat ceph rtd unknown /proc/59097/task/60514/root (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60514 ms_dispat ceph txt unknown /proc/59097/task/60514/exe (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60514 ms_dispat ceph NOFD /proc/59097/task/60514/fd (opendir: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60515 ms_local ceph cwd unknown /proc/59097/task/60515/cwd (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60515 ms_local ceph rtd unknown /proc/59097/task/60515/root (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60515 ms_local ceph txt unknown /proc/59097/task/60515/exe (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60515 ms_local ceph NOFD /proc/59097/task/60515/fd (opendir: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60516 ms_dispat ceph cwd unknown /proc/59097/task/60516/cwd (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60516 ms_dispat ceph rtd unknown /proc/59097/task/60516/root (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60516 ms_dispat ceph txt unknown /proc/59097/task/60516/exe (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60516 ms_dispat ceph NOFD /proc/59097/task/60516/fd (opendir: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60517 ms_local ceph cwd unknown /proc/59097/task/60517/cwd (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60517 ms_local ceph rtd unknown /proc/59097/task/60517/root (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60517 ms_local ceph txt unknown /proc/59097/task/60517/exe (readlink: Permission denied) 2024-09-21T01:16:05.872 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60517 ms_local ceph NOFD /proc/59097/task/60517/fd (opendir: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60518 ms_dispat ceph cwd unknown /proc/59097/task/60518/cwd (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60518 ms_dispat ceph rtd unknown /proc/59097/task/60518/root (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60518 ms_dispat ceph txt unknown /proc/59097/task/60518/exe (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60518 ms_dispat ceph NOFD /proc/59097/task/60518/fd (opendir: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60519 ms_local ceph cwd unknown /proc/59097/task/60519/cwd (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60519 ms_local ceph rtd unknown /proc/59097/task/60519/root (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60519 ms_local ceph txt unknown /proc/59097/task/60519/exe (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60519 ms_local ceph NOFD /proc/59097/task/60519/fd (opendir: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60520 ms_dispat ceph cwd unknown /proc/59097/task/60520/cwd (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60520 ms_dispat ceph rtd unknown /proc/59097/task/60520/root (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60520 ms_dispat ceph txt unknown /proc/59097/task/60520/exe (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60520 ms_dispat ceph NOFD /proc/59097/task/60520/fd (opendir: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60521 ms_local ceph cwd unknown /proc/59097/task/60521/cwd (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60521 ms_local ceph rtd unknown /proc/59097/task/60521/root (readlink: Permission denied) 2024-09-21T01:16:05.873 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60521 ms_local ceph txt unknown /proc/59097/task/60521/exe (readlink: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60521 ms_local ceph NOFD /proc/59097/task/60521/fd (opendir: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60522 ms_dispat ceph cwd unknown /proc/59097/task/60522/cwd (readlink: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60522 ms_dispat ceph rtd unknown /proc/59097/task/60522/root (readlink: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60522 ms_dispat ceph txt unknown /proc/59097/task/60522/exe (readlink: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60522 ms_dispat ceph NOFD /proc/59097/task/60522/fd (opendir: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60523 ms_local ceph cwd unknown /proc/59097/task/60523/cwd (readlink: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60523 ms_local ceph rtd unknown /proc/59097/task/60523/root (readlink: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60523 ms_local ceph txt unknown /proc/59097/task/60523/exe (readlink: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60523 ms_local ceph NOFD /proc/59097/task/60523/fd (opendir: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60524 ms_dispat ceph cwd unknown /proc/59097/task/60524/cwd (readlink: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60524 ms_dispat ceph rtd unknown /proc/59097/task/60524/root (readlink: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60524 ms_dispat ceph txt unknown /proc/59097/task/60524/exe (readlink: Permission denied) 2024-09-21T01:16:05.874 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60524 ms_dispat ceph NOFD /proc/59097/task/60524/fd (opendir: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60525 ms_local ceph cwd unknown /proc/59097/task/60525/cwd (readlink: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60525 ms_local ceph rtd unknown /proc/59097/task/60525/root (readlink: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60525 ms_local ceph txt unknown /proc/59097/task/60525/exe (readlink: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60525 ms_local ceph NOFD /proc/59097/task/60525/fd (opendir: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60526 fn_anonym ceph cwd unknown /proc/59097/task/60526/cwd (readlink: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60526 fn_anonym ceph rtd unknown /proc/59097/task/60526/root (readlink: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60526 fn_anonym ceph txt unknown /proc/59097/task/60526/exe (readlink: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60526 fn_anonym ceph NOFD /proc/59097/task/60526/fd (opendir: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60527 finisher ceph cwd unknown /proc/59097/task/60527/cwd (readlink: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60527 finisher ceph rtd unknown /proc/59097/task/60527/root (readlink: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60527 finisher ceph txt unknown /proc/59097/task/60527/exe (readlink: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60527 finisher ceph NOFD /proc/59097/task/60527/fd (opendir: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60528 safe_time ceph cwd unknown /proc/59097/task/60528/cwd (readlink: Permission denied) 2024-09-21T01:16:05.875 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60528 safe_time ceph rtd unknown /proc/59097/task/60528/root (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60528 safe_time ceph txt unknown /proc/59097/task/60528/exe (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60528 safe_time ceph NOFD /proc/59097/task/60528/fd (opendir: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60529 safe_time ceph cwd unknown /proc/59097/task/60529/cwd (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60529 safe_time ceph rtd unknown /proc/59097/task/60529/root (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60529 safe_time ceph txt unknown /proc/59097/task/60529/exe (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60529 safe_time ceph NOFD /proc/59097/task/60529/fd (opendir: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60530 ceph-osd ceph cwd unknown /proc/59097/task/60530/cwd (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60530 ceph-osd ceph rtd unknown /proc/59097/task/60530/root (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60530 ceph-osd ceph txt unknown /proc/59097/task/60530/exe (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60530 ceph-osd ceph NOFD /proc/59097/task/60530/fd (opendir: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60531 osd_srv_a ceph cwd unknown /proc/59097/task/60531/cwd (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60531 osd_srv_a ceph rtd unknown /proc/59097/task/60531/root (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60531 osd_srv_a ceph txt unknown /proc/59097/task/60531/exe (readlink: Permission denied) 2024-09-21T01:16:05.876 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60531 osd_srv_a ceph NOFD /proc/59097/task/60531/fd (opendir: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60532 tp_osd_tp ceph cwd unknown /proc/59097/task/60532/cwd (readlink: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60532 tp_osd_tp ceph rtd unknown /proc/59097/task/60532/root (readlink: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60532 tp_osd_tp ceph txt unknown /proc/59097/task/60532/exe (readlink: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60532 tp_osd_tp ceph NOFD /proc/59097/task/60532/fd (opendir: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60533 tp_osd_tp ceph cwd unknown /proc/59097/task/60533/cwd (readlink: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60533 tp_osd_tp ceph rtd unknown /proc/59097/task/60533/root (readlink: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60533 tp_osd_tp ceph txt unknown /proc/59097/task/60533/exe (readlink: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60533 tp_osd_tp ceph NOFD /proc/59097/task/60533/fd (opendir: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60534 tp_osd_tp ceph cwd unknown /proc/59097/task/60534/cwd (readlink: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60534 tp_osd_tp ceph rtd unknown /proc/59097/task/60534/root (readlink: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60534 tp_osd_tp ceph txt unknown /proc/59097/task/60534/exe (readlink: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60534 tp_osd_tp ceph NOFD /proc/59097/task/60534/fd (opendir: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60535 tp_osd_tp ceph cwd unknown /proc/59097/task/60535/cwd (readlink: Permission denied) 2024-09-21T01:16:05.877 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60535 tp_osd_tp ceph rtd unknown /proc/59097/task/60535/root (readlink: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60535 tp_osd_tp ceph txt unknown /proc/59097/task/60535/exe (readlink: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60535 tp_osd_tp ceph NOFD /proc/59097/task/60535/fd (opendir: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60536 tp_osd_tp ceph cwd unknown /proc/59097/task/60536/cwd (readlink: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60536 tp_osd_tp ceph rtd unknown /proc/59097/task/60536/root (readlink: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60536 tp_osd_tp ceph txt unknown /proc/59097/task/60536/exe (readlink: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60536 tp_osd_tp ceph NOFD /proc/59097/task/60536/fd (opendir: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60537 tp_osd_tp ceph cwd unknown /proc/59097/task/60537/cwd (readlink: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60537 tp_osd_tp ceph rtd unknown /proc/59097/task/60537/root (readlink: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60537 tp_osd_tp ceph txt unknown /proc/59097/task/60537/exe (readlink: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60537 tp_osd_tp ceph NOFD /proc/59097/task/60537/fd (opendir: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60538 tp_osd_tp ceph cwd unknown /proc/59097/task/60538/cwd (readlink: Permission denied) 2024-09-21T01:16:05.878 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60538 tp_osd_tp ceph rtd unknown /proc/59097/task/60538/root (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60538 tp_osd_tp ceph txt unknown /proc/59097/task/60538/exe (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60538 tp_osd_tp ceph NOFD /proc/59097/task/60538/fd (opendir: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60539 tp_osd_tp ceph cwd unknown /proc/59097/task/60539/cwd (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60539 tp_osd_tp ceph rtd unknown /proc/59097/task/60539/root (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60539 tp_osd_tp ceph txt unknown /proc/59097/task/60539/exe (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60539 tp_osd_tp ceph NOFD /proc/59097/task/60539/fd (opendir: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60540 tp_osd_tp ceph cwd unknown /proc/59097/task/60540/cwd (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60540 tp_osd_tp ceph rtd unknown /proc/59097/task/60540/root (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60540 tp_osd_tp ceph txt unknown /proc/59097/task/60540/exe (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60540 tp_osd_tp ceph NOFD /proc/59097/task/60540/fd (opendir: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60541 tp_osd_tp ceph cwd unknown /proc/59097/task/60541/cwd (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60541 tp_osd_tp ceph rtd unknown /proc/59097/task/60541/root (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60541 tp_osd_tp ceph txt unknown /proc/59097/task/60541/exe (readlink: Permission denied) 2024-09-21T01:16:05.879 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60541 tp_osd_tp ceph NOFD /proc/59097/task/60541/fd (opendir: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60542 tp_osd_tp ceph cwd unknown /proc/59097/task/60542/cwd (readlink: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60542 tp_osd_tp ceph rtd unknown /proc/59097/task/60542/root (readlink: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60542 tp_osd_tp ceph txt unknown /proc/59097/task/60542/exe (readlink: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60542 tp_osd_tp ceph NOFD /proc/59097/task/60542/fd (opendir: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60543 tp_osd_tp ceph cwd unknown /proc/59097/task/60543/cwd (readlink: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60543 tp_osd_tp ceph rtd unknown /proc/59097/task/60543/root (readlink: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60543 tp_osd_tp ceph txt unknown /proc/59097/task/60543/exe (readlink: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60543 tp_osd_tp ceph NOFD /proc/59097/task/60543/fd (opendir: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60544 tp_osd_tp ceph cwd unknown /proc/59097/task/60544/cwd (readlink: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60544 tp_osd_tp ceph rtd unknown /proc/59097/task/60544/root (readlink: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60544 tp_osd_tp ceph txt unknown /proc/59097/task/60544/exe (readlink: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60544 tp_osd_tp ceph NOFD /proc/59097/task/60544/fd (opendir: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60545 tp_osd_tp ceph cwd unknown /proc/59097/task/60545/cwd (readlink: Permission denied) 2024-09-21T01:16:05.880 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60545 tp_osd_tp ceph rtd unknown /proc/59097/task/60545/root (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60545 tp_osd_tp ceph txt unknown /proc/59097/task/60545/exe (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60545 tp_osd_tp ceph NOFD /proc/59097/task/60545/fd (opendir: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60546 tp_osd_tp ceph cwd unknown /proc/59097/task/60546/cwd (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60546 tp_osd_tp ceph rtd unknown /proc/59097/task/60546/root (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60546 tp_osd_tp ceph txt unknown /proc/59097/task/60546/exe (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60546 tp_osd_tp ceph NOFD /proc/59097/task/60546/fd (opendir: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60547 tp_osd_tp ceph cwd unknown /proc/59097/task/60547/cwd (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60547 tp_osd_tp ceph rtd unknown /proc/59097/task/60547/root (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60547 tp_osd_tp ceph txt unknown /proc/59097/task/60547/exe (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60547 tp_osd_tp ceph NOFD /proc/59097/task/60547/fd (opendir: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60548 osd_srv_h ceph cwd unknown /proc/59097/task/60548/cwd (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60548 osd_srv_h ceph rtd unknown /proc/59097/task/60548/root (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60548 osd_srv_h ceph txt unknown /proc/59097/task/60548/exe (readlink: Permission denied) 2024-09-21T01:16:05.881 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 59097 60548 osd_srv_h ceph NOFD /proc/59097/task/60548/fd (opendir: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 59639 root cwd unknown /proc/59639/cwd (readlink: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 59639 root rtd unknown /proc/59639/root (readlink: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 59639 root txt unknown /proc/59639/exe (readlink: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 59639 root NOFD /proc/59639/fd (opendir: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 59656 root cwd unknown /proc/59656/cwd (readlink: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 59656 root rtd unknown /proc/59656/root (readlink: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 59656 root txt unknown /proc/59656/exe (readlink: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 59656 root NOFD /proc/59656/fd (opendir: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 63141 root cwd unknown /proc/63141/cwd (readlink: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 63141 root rtd unknown /proc/63141/root (readlink: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 63141 root txt unknown /proc/63141/exe (readlink: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 63141 root NOFD /proc/63141/fd (opendir: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 63142 root cwd unknown /proc/63142/cwd (readlink: Permission denied) 2024-09-21T01:16:05.882 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 63142 root rtd unknown /proc/63142/root (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 63142 root txt unknown /proc/63142/exe (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/2 63142 root NOFD /proc/63142/fd (opendir: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 65708 root cwd unknown /proc/65708/cwd (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 65708 root rtd unknown /proc/65708/root (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 65708 root txt unknown /proc/65708/exe (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 65708 root NOFD /proc/65708/fd (opendir: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 65710 root cwd unknown /proc/65710/cwd (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 65710 root rtd unknown /proc/65710/root (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 65710 root txt unknown /proc/65710/exe (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 65710 root NOFD /proc/65710/fd (opendir: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 ceph cwd unknown /proc/65712/cwd (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 ceph rtd unknown /proc/65712/root (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 ceph txt unknown /proc/65712/exe (readlink: Permission denied) 2024-09-21T01:16:05.883 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 ceph NOFD /proc/65712/fd (opendir: Permission denied) 2024-09-21T01:16:05.885 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65713 log ceph cwd unknown /proc/65712/task/65713/cwd (readlink: Permission denied) 2024-09-21T01:16:05.885 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65713 log ceph rtd unknown /proc/65712/task/65713/root (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65713 log ceph txt unknown /proc/65712/task/65713/exe (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65713 log ceph NOFD /proc/65712/task/65713/fd (opendir: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65715 msgr-work ceph cwd unknown /proc/65712/task/65715/cwd (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65715 msgr-work ceph rtd unknown /proc/65712/task/65715/root (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65715 msgr-work ceph txt unknown /proc/65712/task/65715/exe (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65715 msgr-work ceph NOFD /proc/65712/task/65715/fd (opendir: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65716 msgr-work ceph cwd unknown /proc/65712/task/65716/cwd (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65716 msgr-work ceph rtd unknown /proc/65712/task/65716/root (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65716 msgr-work ceph txt unknown /proc/65712/task/65716/exe (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65716 msgr-work ceph NOFD /proc/65712/task/65716/fd (opendir: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65717 msgr-work ceph cwd unknown /proc/65712/task/65717/cwd (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65717 msgr-work ceph rtd unknown /proc/65712/task/65717/root (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65717 msgr-work ceph txt unknown /proc/65712/task/65717/exe (readlink: Permission denied) 2024-09-21T01:16:05.886 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65717 msgr-work ceph NOFD /proc/65712/task/65717/fd (opendir: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65721 service ceph cwd unknown /proc/65712/task/65721/cwd (readlink: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65721 service ceph rtd unknown /proc/65712/task/65721/root (readlink: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65721 service ceph txt unknown /proc/65712/task/65721/exe (readlink: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65721 service ceph NOFD /proc/65712/task/65721/fd (opendir: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65722 admin_soc ceph cwd unknown /proc/65712/task/65722/cwd (readlink: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65722 admin_soc ceph rtd unknown /proc/65712/task/65722/root (readlink: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65722 admin_soc ceph txt unknown /proc/65712/task/65722/exe (readlink: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 65722 admin_soc ceph NOFD /proc/65712/task/65722/fd (opendir: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66012 signal_ha ceph cwd unknown /proc/65712/task/66012/cwd (readlink: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66012 signal_ha ceph rtd unknown /proc/65712/task/66012/root (readlink: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66012 signal_ha ceph txt unknown /proc/65712/task/66012/exe (readlink: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66012 signal_ha ceph NOFD /proc/65712/task/66012/fd (opendir: Permission denied) 2024-09-21T01:16:05.887 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66013 io_contex ceph cwd unknown /proc/65712/task/66013/cwd (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66013 io_contex ceph rtd unknown /proc/65712/task/66013/root (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66013 io_contex ceph txt unknown /proc/65712/task/66013/exe (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66013 io_contex ceph NOFD /proc/65712/task/66013/fd (opendir: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66014 io_contex ceph cwd unknown /proc/65712/task/66014/cwd (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66014 io_contex ceph rtd unknown /proc/65712/task/66014/root (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66014 io_contex ceph txt unknown /proc/65712/task/66014/exe (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66014 io_contex ceph NOFD /proc/65712/task/66014/fd (opendir: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66028 OpHistory ceph cwd unknown /proc/65712/task/66028/cwd (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66028 OpHistory ceph rtd unknown /proc/65712/task/66028/root (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66028 OpHistory ceph txt unknown /proc/65712/task/66028/exe (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66028 OpHistory ceph NOFD /proc/65712/task/66028/fd (opendir: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66029 ceph_time ceph cwd unknown /proc/65712/task/66029/cwd (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66029 ceph_time ceph rtd unknown /proc/65712/task/66029/root (readlink: Permission denied) 2024-09-21T01:16:05.888 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66029 ceph_time ceph txt unknown /proc/65712/task/66029/exe (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66029 ceph_time ceph NOFD /proc/65712/task/66029/fd (opendir: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66083 ceph-osd ceph cwd unknown /proc/65712/task/66083/cwd (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66083 ceph-osd ceph rtd unknown /proc/65712/task/66083/root (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66083 ceph-osd ceph txt unknown /proc/65712/task/66083/exe (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66083 ceph-osd ceph NOFD /proc/65712/task/66083/fd (opendir: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66115 ceph-osd ceph cwd unknown /proc/65712/task/66115/cwd (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66115 ceph-osd ceph rtd unknown /proc/65712/task/66115/root (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66115 ceph-osd ceph txt unknown /proc/65712/task/66115/exe (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66115 ceph-osd ceph NOFD /proc/65712/task/66115/fd (opendir: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66176 ceph-osd ceph cwd unknown /proc/65712/task/66176/cwd (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66176 ceph-osd ceph rtd unknown /proc/65712/task/66176/root (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66176 ceph-osd ceph txt unknown /proc/65712/task/66176/exe (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66176 ceph-osd ceph NOFD /proc/65712/task/66176/fd (opendir: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66185 ceph-osd ceph cwd unknown /proc/65712/task/66185/cwd (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66185 ceph-osd ceph rtd unknown /proc/65712/task/66185/root (readlink: Permission denied) 2024-09-21T01:16:05.889 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66185 ceph-osd ceph txt unknown /proc/65712/task/66185/exe (readlink: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66185 ceph-osd ceph NOFD /proc/65712/task/66185/fd (opendir: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66191 ceph-osd ceph cwd unknown /proc/65712/task/66191/cwd (readlink: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66191 ceph-osd ceph rtd unknown /proc/65712/task/66191/root (readlink: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66191 ceph-osd ceph txt unknown /proc/65712/task/66191/exe (readlink: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66191 ceph-osd ceph NOFD /proc/65712/task/66191/fd (opendir: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66240 ceph-osd ceph cwd unknown /proc/65712/task/66240/cwd (readlink: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66240 ceph-osd ceph rtd unknown /proc/65712/task/66240/root (readlink: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66240 ceph-osd ceph txt unknown /proc/65712/task/66240/exe (readlink: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66240 ceph-osd ceph NOFD /proc/65712/task/66240/fd (opendir: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66283 ceph-osd ceph cwd unknown /proc/65712/task/66283/cwd (readlink: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66283 ceph-osd ceph rtd unknown /proc/65712/task/66283/root (readlink: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66283 ceph-osd ceph txt unknown /proc/65712/task/66283/exe (readlink: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66283 ceph-osd ceph NOFD /proc/65712/task/66283/fd (opendir: Permission denied) 2024-09-21T01:16:05.890 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66295 ceph-osd ceph cwd unknown /proc/65712/task/66295/cwd (readlink: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66295 ceph-osd ceph rtd unknown /proc/65712/task/66295/root (readlink: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66295 ceph-osd ceph txt unknown /proc/65712/task/66295/exe (readlink: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66295 ceph-osd ceph NOFD /proc/65712/task/66295/fd (opendir: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66297 ceph-osd ceph cwd unknown /proc/65712/task/66297/cwd (readlink: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66297 ceph-osd ceph rtd unknown /proc/65712/task/66297/root (readlink: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66297 ceph-osd ceph txt unknown /proc/65712/task/66297/exe (readlink: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66297 ceph-osd ceph NOFD /proc/65712/task/66297/fd (opendir: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66298 safe_time ceph cwd unknown /proc/65712/task/66298/cwd (readlink: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66298 safe_time ceph rtd unknown /proc/65712/task/66298/root (readlink: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66298 safe_time ceph txt unknown /proc/65712/task/66298/exe (readlink: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66298 safe_time ceph NOFD /proc/65712/task/66298/fd (opendir: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66299 safe_time ceph cwd unknown /proc/65712/task/66299/cwd (readlink: Permission denied) 2024-09-21T01:16:05.891 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66299 safe_time ceph rtd unknown /proc/65712/task/66299/root (readlink: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66299 safe_time ceph txt unknown /proc/65712/task/66299/exe (readlink: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66299 safe_time ceph NOFD /proc/65712/task/66299/fd (opendir: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66301 safe_time ceph cwd unknown /proc/65712/task/66301/cwd (readlink: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66301 safe_time ceph rtd unknown /proc/65712/task/66301/root (readlink: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66301 safe_time ceph txt unknown /proc/65712/task/66301/exe (readlink: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66301 safe_time ceph NOFD /proc/65712/task/66301/fd (opendir: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66302 safe_time ceph cwd unknown /proc/65712/task/66302/cwd (readlink: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66302 safe_time ceph rtd unknown /proc/65712/task/66302/root (readlink: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66302 safe_time ceph txt unknown /proc/65712/task/66302/exe (readlink: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66302 safe_time ceph NOFD /proc/65712/task/66302/fd (opendir: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66303 fn_anonym ceph cwd unknown /proc/65712/task/66303/cwd (readlink: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66303 fn_anonym ceph rtd unknown /proc/65712/task/66303/root (readlink: Permission denied) 2024-09-21T01:16:05.892 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66303 fn_anonym ceph txt unknown /proc/65712/task/66303/exe (readlink: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66303 fn_anonym ceph NOFD /proc/65712/task/66303/fd (opendir: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66357 rocksdb:l ceph cwd unknown /proc/65712/task/66357/cwd (readlink: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66357 rocksdb:l ceph rtd unknown /proc/65712/task/66357/root (readlink: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66357 rocksdb:l ceph txt unknown /proc/65712/task/66357/exe (readlink: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66357 rocksdb:l ceph NOFD /proc/65712/task/66357/fd (opendir: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66358 rocksdb:l ceph cwd unknown /proc/65712/task/66358/cwd (readlink: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66358 rocksdb:l ceph rtd unknown /proc/65712/task/66358/root (readlink: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66358 rocksdb:l ceph txt unknown /proc/65712/task/66358/exe (readlink: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66358 rocksdb:l ceph NOFD /proc/65712/task/66358/fd (opendir: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66359 rocksdb:l ceph cwd unknown /proc/65712/task/66359/cwd (readlink: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66359 rocksdb:l ceph rtd unknown /proc/65712/task/66359/root (readlink: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66359 rocksdb:l ceph txt unknown /proc/65712/task/66359/exe (readlink: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66359 rocksdb:l ceph NOFD /proc/65712/task/66359/fd (opendir: Permission denied) 2024-09-21T01:16:05.893 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66360 rocksdb:h ceph cwd unknown /proc/65712/task/66360/cwd (readlink: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66360 rocksdb:h ceph rtd unknown /proc/65712/task/66360/root (readlink: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66360 rocksdb:h ceph txt unknown /proc/65712/task/66360/exe (readlink: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66360 rocksdb:h ceph NOFD /proc/65712/task/66360/fd (opendir: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66759 bstore_ai ceph cwd unknown /proc/65712/task/66759/cwd (readlink: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66759 bstore_ai ceph rtd unknown /proc/65712/task/66759/root (readlink: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66759 bstore_ai ceph txt unknown /proc/65712/task/66759/exe (readlink: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 66759 bstore_ai ceph NOFD /proc/65712/task/66759/fd (opendir: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 67759 bstore_ai ceph cwd unknown /proc/65712/task/67759/cwd (readlink: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 67759 bstore_ai ceph rtd unknown /proc/65712/task/67759/root (readlink: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 67759 bstore_ai ceph txt unknown /proc/65712/task/67759/exe (readlink: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 67759 bstore_ai ceph NOFD /proc/65712/task/67759/fd (opendir: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68098 ceph-osd ceph cwd unknown /proc/65712/task/68098/cwd (readlink: Permission denied) 2024-09-21T01:16:05.894 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68098 ceph-osd ceph rtd unknown /proc/65712/task/68098/root (readlink: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68098 ceph-osd ceph txt unknown /proc/65712/task/68098/exe (readlink: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68098 ceph-osd ceph NOFD /proc/65712/task/68098/fd (opendir: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68104 cfin ceph cwd unknown /proc/65712/task/68104/cwd (readlink: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68104 cfin ceph rtd unknown /proc/65712/task/68104/root (readlink: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68104 cfin ceph txt unknown /proc/65712/task/68104/exe (readlink: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68104 cfin ceph NOFD /proc/65712/task/68104/fd (opendir: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68105 bstore_kv ceph cwd unknown /proc/65712/task/68105/cwd (readlink: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68105 bstore_kv ceph rtd unknown /proc/65712/task/68105/root (readlink: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68105 bstore_kv ceph txt unknown /proc/65712/task/68105/exe (readlink: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68105 bstore_kv ceph NOFD /proc/65712/task/68105/fd (opendir: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68106 bstore_kv ceph cwd unknown /proc/65712/task/68106/cwd (readlink: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68106 bstore_kv ceph rtd unknown /proc/65712/task/68106/root (readlink: Permission denied) 2024-09-21T01:16:05.895 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68106 bstore_kv ceph txt unknown /proc/65712/task/68106/exe (readlink: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68106 bstore_kv ceph NOFD /proc/65712/task/68106/fd (opendir: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68108 bstore_me ceph cwd unknown /proc/65712/task/68108/cwd (readlink: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68108 bstore_me ceph rtd unknown /proc/65712/task/68108/root (readlink: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68108 bstore_me ceph txt unknown /proc/65712/task/68108/exe (readlink: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68108 bstore_me ceph NOFD /proc/65712/task/68108/fd (opendir: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68213 ms_dispat ceph cwd unknown /proc/65712/task/68213/cwd (readlink: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68213 ms_dispat ceph rtd unknown /proc/65712/task/68213/root (readlink: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68213 ms_dispat ceph txt unknown /proc/65712/task/68213/exe (readlink: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68213 ms_dispat ceph NOFD /proc/65712/task/68213/fd (opendir: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68215 ms_local ceph cwd unknown /proc/65712/task/68215/cwd (readlink: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68215 ms_local ceph rtd unknown /proc/65712/task/68215/root (readlink: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68215 ms_local ceph txt unknown /proc/65712/task/68215/exe (readlink: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68215 ms_local ceph NOFD /proc/65712/task/68215/fd (opendir: Permission denied) 2024-09-21T01:16:05.896 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68216 safe_time ceph cwd unknown /proc/65712/task/68216/cwd (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68216 safe_time ceph rtd unknown /proc/65712/task/68216/root (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68216 safe_time ceph txt unknown /proc/65712/task/68216/exe (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68216 safe_time ceph NOFD /proc/65712/task/68216/fd (opendir: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68217 safe_time ceph cwd unknown /proc/65712/task/68217/cwd (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68217 safe_time ceph rtd unknown /proc/65712/task/68217/root (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68217 safe_time ceph txt unknown /proc/65712/task/68217/exe (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68217 safe_time ceph NOFD /proc/65712/task/68217/fd (opendir: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68219 ms_dispat ceph cwd unknown /proc/65712/task/68219/cwd (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68219 ms_dispat ceph rtd unknown /proc/65712/task/68219/root (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68219 ms_dispat ceph txt unknown /proc/65712/task/68219/exe (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68219 ms_dispat ceph NOFD /proc/65712/task/68219/fd (opendir: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68220 ms_local ceph cwd unknown /proc/65712/task/68220/cwd (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68220 ms_local ceph rtd unknown /proc/65712/task/68220/root (readlink: Permission denied) 2024-09-21T01:16:05.897 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68220 ms_local ceph txt unknown /proc/65712/task/68220/exe (readlink: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68220 ms_local ceph NOFD /proc/65712/task/68220/fd (opendir: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68221 ms_dispat ceph cwd unknown /proc/65712/task/68221/cwd (readlink: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68221 ms_dispat ceph rtd unknown /proc/65712/task/68221/root (readlink: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68221 ms_dispat ceph txt unknown /proc/65712/task/68221/exe (readlink: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68221 ms_dispat ceph NOFD /proc/65712/task/68221/fd (opendir: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68223 ms_local ceph cwd unknown /proc/65712/task/68223/cwd (readlink: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68223 ms_local ceph rtd unknown /proc/65712/task/68223/root (readlink: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68223 ms_local ceph txt unknown /proc/65712/task/68223/exe (readlink: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68223 ms_local ceph NOFD /proc/65712/task/68223/fd (opendir: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68224 ms_dispat ceph cwd unknown /proc/65712/task/68224/cwd (readlink: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68224 ms_dispat ceph rtd unknown /proc/65712/task/68224/root (readlink: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68224 ms_dispat ceph txt unknown /proc/65712/task/68224/exe (readlink: Permission denied) 2024-09-21T01:16:05.898 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68224 ms_dispat ceph NOFD /proc/65712/task/68224/fd (opendir: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68225 ms_local ceph cwd unknown /proc/65712/task/68225/cwd (readlink: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68225 ms_local ceph rtd unknown /proc/65712/task/68225/root (readlink: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68225 ms_local ceph txt unknown /proc/65712/task/68225/exe (readlink: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68225 ms_local ceph NOFD /proc/65712/task/68225/fd (opendir: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68227 ms_dispat ceph cwd unknown /proc/65712/task/68227/cwd (readlink: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68227 ms_dispat ceph rtd unknown /proc/65712/task/68227/root (readlink: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68227 ms_dispat ceph txt unknown /proc/65712/task/68227/exe (readlink: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68227 ms_dispat ceph NOFD /proc/65712/task/68227/fd (opendir: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68228 ms_local ceph cwd unknown /proc/65712/task/68228/cwd (readlink: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68228 ms_local ceph rtd unknown /proc/65712/task/68228/root (readlink: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68228 ms_local ceph txt unknown /proc/65712/task/68228/exe (readlink: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68228 ms_local ceph NOFD /proc/65712/task/68228/fd (opendir: Permission denied) 2024-09-21T01:16:05.899 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68229 ms_dispat ceph cwd unknown /proc/65712/task/68229/cwd (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68229 ms_dispat ceph rtd unknown /proc/65712/task/68229/root (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68229 ms_dispat ceph txt unknown /proc/65712/task/68229/exe (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68229 ms_dispat ceph NOFD /proc/65712/task/68229/fd (opendir: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68231 ms_local ceph cwd unknown /proc/65712/task/68231/cwd (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68231 ms_local ceph rtd unknown /proc/65712/task/68231/root (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68231 ms_local ceph txt unknown /proc/65712/task/68231/exe (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68231 ms_local ceph NOFD /proc/65712/task/68231/fd (opendir: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68232 ms_dispat ceph cwd unknown /proc/65712/task/68232/cwd (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68232 ms_dispat ceph rtd unknown /proc/65712/task/68232/root (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68232 ms_dispat ceph txt unknown /proc/65712/task/68232/exe (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68232 ms_dispat ceph NOFD /proc/65712/task/68232/fd (opendir: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68233 ms_local ceph cwd unknown /proc/65712/task/68233/cwd (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68233 ms_local ceph rtd unknown /proc/65712/task/68233/root (readlink: Permission denied) 2024-09-21T01:16:05.900 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68233 ms_local ceph txt unknown /proc/65712/task/68233/exe (readlink: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68233 ms_local ceph NOFD /proc/65712/task/68233/fd (opendir: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68234 fn_anonym ceph cwd unknown /proc/65712/task/68234/cwd (readlink: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68234 fn_anonym ceph rtd unknown /proc/65712/task/68234/root (readlink: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68234 fn_anonym ceph txt unknown /proc/65712/task/68234/exe (readlink: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68234 fn_anonym ceph NOFD /proc/65712/task/68234/fd (opendir: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68235 finisher ceph cwd unknown /proc/65712/task/68235/cwd (readlink: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68235 finisher ceph rtd unknown /proc/65712/task/68235/root (readlink: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68235 finisher ceph txt unknown /proc/65712/task/68235/exe (readlink: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68235 finisher ceph NOFD /proc/65712/task/68235/fd (opendir: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68237 safe_time ceph cwd unknown /proc/65712/task/68237/cwd (readlink: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68237 safe_time ceph rtd unknown /proc/65712/task/68237/root (readlink: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68237 safe_time ceph txt unknown /proc/65712/task/68237/exe (readlink: Permission denied) 2024-09-21T01:16:05.901 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68237 safe_time ceph NOFD /proc/65712/task/68237/fd (opendir: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68238 safe_time ceph cwd unknown /proc/65712/task/68238/cwd (readlink: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68238 safe_time ceph rtd unknown /proc/65712/task/68238/root (readlink: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68238 safe_time ceph txt unknown /proc/65712/task/68238/exe (readlink: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68238 safe_time ceph NOFD /proc/65712/task/68238/fd (opendir: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68239 ceph-osd ceph cwd unknown /proc/65712/task/68239/cwd (readlink: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68239 ceph-osd ceph rtd unknown /proc/65712/task/68239/root (readlink: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68239 ceph-osd ceph txt unknown /proc/65712/task/68239/exe (readlink: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68239 ceph-osd ceph NOFD /proc/65712/task/68239/fd (opendir: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68240 osd_srv_a ceph cwd unknown /proc/65712/task/68240/cwd (readlink: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68240 osd_srv_a ceph rtd unknown /proc/65712/task/68240/root (readlink: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68240 osd_srv_a ceph txt unknown /proc/65712/task/68240/exe (readlink: Permission denied) 2024-09-21T01:16:05.902 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68240 osd_srv_a ceph NOFD /proc/65712/task/68240/fd (opendir: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68242 tp_osd_tp ceph cwd unknown /proc/65712/task/68242/cwd (readlink: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68242 tp_osd_tp ceph rtd unknown /proc/65712/task/68242/root (readlink: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68242 tp_osd_tp ceph txt unknown /proc/65712/task/68242/exe (readlink: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68242 tp_osd_tp ceph NOFD /proc/65712/task/68242/fd (opendir: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68243 tp_osd_tp ceph cwd unknown /proc/65712/task/68243/cwd (readlink: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68243 tp_osd_tp ceph rtd unknown /proc/65712/task/68243/root (readlink: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68243 tp_osd_tp ceph txt unknown /proc/65712/task/68243/exe (readlink: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68243 tp_osd_tp ceph NOFD /proc/65712/task/68243/fd (opendir: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68245 tp_osd_tp ceph cwd unknown /proc/65712/task/68245/cwd (readlink: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68245 tp_osd_tp ceph rtd unknown /proc/65712/task/68245/root (readlink: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68245 tp_osd_tp ceph txt unknown /proc/65712/task/68245/exe (readlink: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68245 tp_osd_tp ceph NOFD /proc/65712/task/68245/fd (opendir: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68246 tp_osd_tp ceph cwd unknown /proc/65712/task/68246/cwd (readlink: Permission denied) 2024-09-21T01:16:05.903 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68246 tp_osd_tp ceph rtd unknown /proc/65712/task/68246/root (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68246 tp_osd_tp ceph txt unknown /proc/65712/task/68246/exe (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68246 tp_osd_tp ceph NOFD /proc/65712/task/68246/fd (opendir: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68247 tp_osd_tp ceph cwd unknown /proc/65712/task/68247/cwd (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68247 tp_osd_tp ceph rtd unknown /proc/65712/task/68247/root (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68247 tp_osd_tp ceph txt unknown /proc/65712/task/68247/exe (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68247 tp_osd_tp ceph NOFD /proc/65712/task/68247/fd (opendir: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68248 tp_osd_tp ceph cwd unknown /proc/65712/task/68248/cwd (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68248 tp_osd_tp ceph rtd unknown /proc/65712/task/68248/root (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68248 tp_osd_tp ceph txt unknown /proc/65712/task/68248/exe (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68248 tp_osd_tp ceph NOFD /proc/65712/task/68248/fd (opendir: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68250 tp_osd_tp ceph cwd unknown /proc/65712/task/68250/cwd (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68250 tp_osd_tp ceph rtd unknown /proc/65712/task/68250/root (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68250 tp_osd_tp ceph txt unknown /proc/65712/task/68250/exe (readlink: Permission denied) 2024-09-21T01:16:05.904 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68250 tp_osd_tp ceph NOFD /proc/65712/task/68250/fd (opendir: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68251 tp_osd_tp ceph cwd unknown /proc/65712/task/68251/cwd (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68251 tp_osd_tp ceph rtd unknown /proc/65712/task/68251/root (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68251 tp_osd_tp ceph txt unknown /proc/65712/task/68251/exe (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68251 tp_osd_tp ceph NOFD /proc/65712/task/68251/fd (opendir: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68252 tp_osd_tp ceph cwd unknown /proc/65712/task/68252/cwd (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68252 tp_osd_tp ceph rtd unknown /proc/65712/task/68252/root (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68252 tp_osd_tp ceph txt unknown /proc/65712/task/68252/exe (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68252 tp_osd_tp ceph NOFD /proc/65712/task/68252/fd (opendir: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68254 tp_osd_tp ceph cwd unknown /proc/65712/task/68254/cwd (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68254 tp_osd_tp ceph rtd unknown /proc/65712/task/68254/root (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68254 tp_osd_tp ceph txt unknown /proc/65712/task/68254/exe (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68254 tp_osd_tp ceph NOFD /proc/65712/task/68254/fd (opendir: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68255 tp_osd_tp ceph cwd unknown /proc/65712/task/68255/cwd (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68255 tp_osd_tp ceph rtd unknown /proc/65712/task/68255/root (readlink: Permission denied) 2024-09-21T01:16:05.905 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68255 tp_osd_tp ceph txt unknown /proc/65712/task/68255/exe (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68255 tp_osd_tp ceph NOFD /proc/65712/task/68255/fd (opendir: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68256 tp_osd_tp ceph cwd unknown /proc/65712/task/68256/cwd (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68256 tp_osd_tp ceph rtd unknown /proc/65712/task/68256/root (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68256 tp_osd_tp ceph txt unknown /proc/65712/task/68256/exe (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68256 tp_osd_tp ceph NOFD /proc/65712/task/68256/fd (opendir: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68257 tp_osd_tp ceph cwd unknown /proc/65712/task/68257/cwd (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68257 tp_osd_tp ceph rtd unknown /proc/65712/task/68257/root (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68257 tp_osd_tp ceph txt unknown /proc/65712/task/68257/exe (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68257 tp_osd_tp ceph NOFD /proc/65712/task/68257/fd (opendir: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68259 tp_osd_tp ceph cwd unknown /proc/65712/task/68259/cwd (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68259 tp_osd_tp ceph rtd unknown /proc/65712/task/68259/root (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68259 tp_osd_tp ceph txt unknown /proc/65712/task/68259/exe (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68259 tp_osd_tp ceph NOFD /proc/65712/task/68259/fd (opendir: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68260 tp_osd_tp ceph cwd unknown /proc/65712/task/68260/cwd (readlink: Permission denied) 2024-09-21T01:16:05.906 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68260 tp_osd_tp ceph rtd unknown /proc/65712/task/68260/root (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68260 tp_osd_tp ceph txt unknown /proc/65712/task/68260/exe (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68260 tp_osd_tp ceph NOFD /proc/65712/task/68260/fd (opendir: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68261 tp_osd_tp ceph cwd unknown /proc/65712/task/68261/cwd (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68261 tp_osd_tp ceph rtd unknown /proc/65712/task/68261/root (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68261 tp_osd_tp ceph txt unknown /proc/65712/task/68261/exe (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68261 tp_osd_tp ceph NOFD /proc/65712/task/68261/fd (opendir: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68262 osd_srv_h ceph cwd unknown /proc/65712/task/68262/cwd (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68262 osd_srv_h ceph rtd unknown /proc/65712/task/68262/root (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68262 osd_srv_h ceph txt unknown /proc/65712/task/68262/exe (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-osd 65712 68262 osd_srv_h ceph NOFD /proc/65712/task/68262/fd (opendir: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 66286 root cwd unknown /proc/66286/cwd (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 66286 root rtd unknown /proc/66286/root (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 66286 root txt unknown /proc/66286/exe (readlink: Permission denied) 2024-09-21T01:16:05.907 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 66286 root NOFD /proc/66286/fd (opendir: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 66326 root cwd unknown /proc/66326/cwd (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 66326 root rtd unknown /proc/66326/root (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 66326 root txt unknown /proc/66326/exe (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 66326 root NOFD /proc/66326/fd (opendir: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 66353 root cwd unknown /proc/66353/cwd (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 66353 root rtd unknown /proc/66353/root (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 66353 root txt unknown /proc/66353/exe (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 66353 root NOFD /proc/66353/fd (opendir: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 69761 root cwd unknown /proc/69761/cwd (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 69761 root rtd unknown /proc/69761/root (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 69761 root txt unknown /proc/69761/exe (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/4 69761 root NOFD /proc/69761/fd (opendir: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70488 root cwd unknown /proc/70488/cwd (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70488 root rtd unknown /proc/70488/root (readlink: Permission denied) 2024-09-21T01:16:05.908 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70488 root txt unknown /proc/70488/exe (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70488 root NOFD /proc/70488/fd (opendir: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70505 root cwd unknown /proc/70505/cwd (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70505 root rtd unknown /proc/70505/root (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70505 root txt unknown /proc/70505/exe (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70505 root NOFD /proc/70505/fd (opendir: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70506 root cwd unknown /proc/70506/cwd (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70506 root rtd unknown /proc/70506/root (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70506 root txt unknown /proc/70506/exe (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70506 root NOFD /proc/70506/fd (opendir: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70523 root cwd unknown /proc/70523/cwd (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70523 root rtd unknown /proc/70523/root (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70523 root txt unknown /proc/70523/exe (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70523 root NOFD /proc/70523/fd (opendir: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70524 root cwd unknown /proc/70524/cwd (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70524 root rtd unknown /proc/70524/root (readlink: Permission denied) 2024-09-21T01:16:05.909 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70524 root txt unknown /proc/70524/exe (readlink: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70524 root NOFD /proc/70524/fd (opendir: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70541 root cwd unknown /proc/70541/cwd (readlink: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70541 root rtd unknown /proc/70541/root (readlink: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70541 root txt unknown /proc/70541/exe (readlink: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70541 root NOFD /proc/70541/fd (opendir: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70542 root cwd unknown /proc/70542/cwd (readlink: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70542 root rtd unknown /proc/70542/root (readlink: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70542 root txt unknown /proc/70542/exe (readlink: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 70542 root NOFD /proc/70542/fd (opendir: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70559 root cwd unknown /proc/70559/cwd (readlink: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70559 root rtd unknown /proc/70559/root (readlink: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70559 root txt unknown /proc/70559/exe (readlink: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:journalct 70559 root NOFD /proc/70559/fd (opendir: Permission denied) 2024-09-21T01:16:05.910 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 70670 root cwd unknown /proc/70670/cwd (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 70670 root rtd unknown /proc/70670/root (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 70670 root txt unknown /proc/70670/exe (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/5 70670 root NOFD /proc/70670/fd (opendir: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 71026 root cwd unknown /proc/71026/cwd (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 71026 root rtd unknown /proc/71026/root (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 71026 root txt unknown /proc/71026/exe (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 71026 root NOFD /proc/71026/fd (opendir: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 71028 root cwd unknown /proc/71028/cwd (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 71028 root rtd unknown /proc/71028/root (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 71028 root txt unknown /proc/71028/exe (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 71028 root NOFD /proc/71028/fd (opendir: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 ceph cwd unknown /proc/71030/cwd (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 ceph rtd unknown /proc/71030/root (readlink: Permission denied) 2024-09-21T01:16:05.911 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 ceph txt unknown /proc/71030/exe (readlink: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 ceph NOFD /proc/71030/fd (opendir: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71031 log ceph cwd unknown /proc/71030/task/71031/cwd (readlink: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71031 log ceph rtd unknown /proc/71030/task/71031/root (readlink: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71031 log ceph txt unknown /proc/71030/task/71031/exe (readlink: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71031 log ceph NOFD /proc/71030/task/71031/fd (opendir: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71033 msgr-work ceph cwd unknown /proc/71030/task/71033/cwd (readlink: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71033 msgr-work ceph rtd unknown /proc/71030/task/71033/root (readlink: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71033 msgr-work ceph txt unknown /proc/71030/task/71033/exe (readlink: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71033 msgr-work ceph NOFD /proc/71030/task/71033/fd (opendir: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71034 msgr-work ceph cwd unknown /proc/71030/task/71034/cwd (readlink: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71034 msgr-work ceph rtd unknown /proc/71030/task/71034/root (readlink: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71034 msgr-work ceph txt unknown /proc/71030/task/71034/exe (readlink: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71034 msgr-work ceph NOFD /proc/71030/task/71034/fd (opendir: Permission denied) 2024-09-21T01:16:05.912 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71035 msgr-work ceph cwd unknown /proc/71030/task/71035/cwd (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71035 msgr-work ceph rtd unknown /proc/71030/task/71035/root (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71035 msgr-work ceph txt unknown /proc/71030/task/71035/exe (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71035 msgr-work ceph NOFD /proc/71030/task/71035/fd (opendir: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71039 service ceph cwd unknown /proc/71030/task/71039/cwd (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71039 service ceph rtd unknown /proc/71030/task/71039/root (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71039 service ceph txt unknown /proc/71030/task/71039/exe (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71039 service ceph NOFD /proc/71030/task/71039/fd (opendir: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71040 admin_soc ceph cwd unknown /proc/71030/task/71040/cwd (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71040 admin_soc ceph rtd unknown /proc/71030/task/71040/root (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71040 admin_soc ceph txt unknown /proc/71030/task/71040/exe (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71040 admin_soc ceph NOFD /proc/71030/task/71040/fd (opendir: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71041 signal_ha ceph cwd unknown /proc/71030/task/71041/cwd (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71041 signal_ha ceph rtd unknown /proc/71030/task/71041/root (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71041 signal_ha ceph txt unknown /proc/71030/task/71041/exe (readlink: Permission denied) 2024-09-21T01:16:05.913 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71041 signal_ha ceph NOFD /proc/71030/task/71041/fd (opendir: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71042 io_contex ceph cwd unknown /proc/71030/task/71042/cwd (readlink: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71042 io_contex ceph rtd unknown /proc/71030/task/71042/root (readlink: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71042 io_contex ceph txt unknown /proc/71030/task/71042/exe (readlink: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71042 io_contex ceph NOFD /proc/71030/task/71042/fd (opendir: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71043 io_contex ceph cwd unknown /proc/71030/task/71043/cwd (readlink: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71043 io_contex ceph rtd unknown /proc/71030/task/71043/root (readlink: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71043 io_contex ceph txt unknown /proc/71030/task/71043/exe (readlink: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71043 io_contex ceph NOFD /proc/71030/task/71043/fd (opendir: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71044 ms_dispat ceph cwd unknown /proc/71030/task/71044/cwd (readlink: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71044 ms_dispat ceph rtd unknown /proc/71030/task/71044/root (readlink: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71044 ms_dispat ceph txt unknown /proc/71030/task/71044/exe (readlink: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71044 ms_dispat ceph NOFD /proc/71030/task/71044/fd (opendir: Permission denied) 2024-09-21T01:16:05.914 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71045 ms_local ceph cwd unknown /proc/71030/task/71045/cwd (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71045 ms_local ceph rtd unknown /proc/71030/task/71045/root (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71045 ms_local ceph txt unknown /proc/71030/task/71045/exe (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71045 ms_local ceph NOFD /proc/71030/task/71045/fd (opendir: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71046 safe_time ceph cwd unknown /proc/71030/task/71046/cwd (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71046 safe_time ceph rtd unknown /proc/71030/task/71046/root (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71046 safe_time ceph txt unknown /proc/71030/task/71046/exe (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71046 safe_time ceph NOFD /proc/71030/task/71046/fd (opendir: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71047 safe_time ceph cwd unknown /proc/71030/task/71047/cwd (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71047 safe_time ceph rtd unknown /proc/71030/task/71047/root (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71047 safe_time ceph txt unknown /proc/71030/task/71047/exe (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71047 safe_time ceph NOFD /proc/71030/task/71047/fd (opendir: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71048 ceph-mds ceph cwd unknown /proc/71030/task/71048/cwd (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71048 ceph-mds ceph rtd unknown /proc/71030/task/71048/root (readlink: Permission denied) 2024-09-21T01:16:05.915 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71048 ceph-mds ceph txt unknown /proc/71030/task/71048/exe (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71048 ceph-mds ceph NOFD /proc/71030/task/71048/fd (opendir: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71232 safe_time ceph cwd unknown /proc/71030/task/71232/cwd (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71232 safe_time ceph rtd unknown /proc/71030/task/71232/root (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71232 safe_time ceph txt unknown /proc/71030/task/71232/exe (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71030 71232 safe_time ceph NOFD /proc/71030/task/71232/fd (opendir: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 71405 root cwd unknown /proc/71405/cwd (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 71405 root rtd unknown /proc/71405/root (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 71405 root txt unknown /proc/71405/exe (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 71405 root NOFD /proc/71405/fd (opendir: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 71407 root cwd unknown /proc/71407/cwd (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 71407 root rtd unknown /proc/71407/root (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 71407 root txt unknown /proc/71407/exe (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 71407 root NOFD /proc/71407/fd (opendir: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 ceph cwd unknown /proc/71410/cwd (readlink: Permission denied) 2024-09-21T01:16:05.916 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 ceph rtd unknown /proc/71410/root (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 ceph txt unknown /proc/71410/exe (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 ceph NOFD /proc/71410/fd (opendir: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71411 log ceph cwd unknown /proc/71410/task/71411/cwd (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71411 log ceph rtd unknown /proc/71410/task/71411/root (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71411 log ceph txt unknown /proc/71410/task/71411/exe (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71411 log ceph NOFD /proc/71410/task/71411/fd (opendir: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71413 msgr-work ceph cwd unknown /proc/71410/task/71413/cwd (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71413 msgr-work ceph rtd unknown /proc/71410/task/71413/root (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71413 msgr-work ceph txt unknown /proc/71410/task/71413/exe (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71413 msgr-work ceph NOFD /proc/71410/task/71413/fd (opendir: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71414 msgr-work ceph cwd unknown /proc/71410/task/71414/cwd (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71414 msgr-work ceph rtd unknown /proc/71410/task/71414/root (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71414 msgr-work ceph txt unknown /proc/71410/task/71414/exe (readlink: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71414 msgr-work ceph NOFD /proc/71410/task/71414/fd (opendir: Permission denied) 2024-09-21T01:16:05.917 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71415 msgr-work ceph cwd unknown /proc/71410/task/71415/cwd (readlink: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71415 msgr-work ceph rtd unknown /proc/71410/task/71415/root (readlink: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71415 msgr-work ceph txt unknown /proc/71410/task/71415/exe (readlink: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71415 msgr-work ceph NOFD /proc/71410/task/71415/fd (opendir: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71419 service ceph cwd unknown /proc/71410/task/71419/cwd (readlink: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71419 service ceph rtd unknown /proc/71410/task/71419/root (readlink: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71419 service ceph txt unknown /proc/71410/task/71419/exe (readlink: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71419 service ceph NOFD /proc/71410/task/71419/fd (opendir: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71420 admin_soc ceph cwd unknown /proc/71410/task/71420/cwd (readlink: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71420 admin_soc ceph rtd unknown /proc/71410/task/71420/root (readlink: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71420 admin_soc ceph txt unknown /proc/71410/task/71420/exe (readlink: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71420 admin_soc ceph NOFD /proc/71410/task/71420/fd (opendir: Permission denied) 2024-09-21T01:16:05.918 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71421 signal_ha ceph cwd unknown /proc/71410/task/71421/cwd (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71421 signal_ha ceph rtd unknown /proc/71410/task/71421/root (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71421 signal_ha ceph txt unknown /proc/71410/task/71421/exe (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71421 signal_ha ceph NOFD /proc/71410/task/71421/fd (opendir: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71422 io_contex ceph cwd unknown /proc/71410/task/71422/cwd (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71422 io_contex ceph rtd unknown /proc/71410/task/71422/root (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71422 io_contex ceph txt unknown /proc/71410/task/71422/exe (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71422 io_contex ceph NOFD /proc/71410/task/71422/fd (opendir: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71423 io_contex ceph cwd unknown /proc/71410/task/71423/cwd (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71423 io_contex ceph rtd unknown /proc/71410/task/71423/root (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71423 io_contex ceph txt unknown /proc/71410/task/71423/exe (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71423 io_contex ceph NOFD /proc/71410/task/71423/fd (opendir: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71424 ms_dispat ceph cwd unknown /proc/71410/task/71424/cwd (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71424 ms_dispat ceph rtd unknown /proc/71410/task/71424/root (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71424 ms_dispat ceph txt unknown /proc/71410/task/71424/exe (readlink: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71424 ms_dispat ceph NOFD /proc/71410/task/71424/fd (opendir: Permission denied) 2024-09-21T01:16:05.919 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71425 ms_local ceph cwd unknown /proc/71410/task/71425/cwd (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71425 ms_local ceph rtd unknown /proc/71410/task/71425/root (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71425 ms_local ceph txt unknown /proc/71410/task/71425/exe (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71425 ms_local ceph NOFD /proc/71410/task/71425/fd (opendir: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71426 safe_time ceph cwd unknown /proc/71410/task/71426/cwd (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71426 safe_time ceph rtd unknown /proc/71410/task/71426/root (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71426 safe_time ceph txt unknown /proc/71410/task/71426/exe (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71426 safe_time ceph NOFD /proc/71410/task/71426/fd (opendir: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71427 safe_time ceph cwd unknown /proc/71410/task/71427/cwd (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71427 safe_time ceph rtd unknown /proc/71410/task/71427/root (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71427 safe_time ceph txt unknown /proc/71410/task/71427/exe (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71427 safe_time ceph NOFD /proc/71410/task/71427/fd (opendir: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71428 ceph-mds ceph cwd unknown /proc/71410/task/71428/cwd (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71428 ceph-mds ceph rtd unknown /proc/71410/task/71428/root (readlink: Permission denied) 2024-09-21T01:16:05.920 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71428 ceph-mds ceph txt unknown /proc/71410/task/71428/exe (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71428 ceph-mds ceph NOFD /proc/71410/task/71428/fd (opendir: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71433 safe_time ceph cwd unknown /proc/71410/task/71433/cwd (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71433 safe_time ceph rtd unknown /proc/71410/task/71433/root (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71433 safe_time ceph txt unknown /proc/71410/task/71433/exe (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 71410 71433 safe_time ceph NOFD /proc/71410/task/71433/fd (opendir: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 72149 root cwd unknown /proc/72149/cwd (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 72149 root rtd unknown /proc/72149/root (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 72149 root txt unknown /proc/72149/exe (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 72149 root NOFD /proc/72149/fd (opendir: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 72151 root cwd unknown /proc/72151/cwd (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 72151 root rtd unknown /proc/72151/root (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 72151 root txt unknown /proc/72151/exe (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 72151 root NOFD /proc/72151/fd (opendir: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 ceph cwd unknown /proc/72153/cwd (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 ceph rtd unknown /proc/72153/root (readlink: Permission denied) 2024-09-21T01:16:05.921 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 ceph txt unknown /proc/72153/exe (readlink: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 ceph NOFD /proc/72153/fd (opendir: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72154 log ceph cwd unknown /proc/72153/task/72154/cwd (readlink: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72154 log ceph rtd unknown /proc/72153/task/72154/root (readlink: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72154 log ceph txt unknown /proc/72153/task/72154/exe (readlink: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72154 log ceph NOFD /proc/72153/task/72154/fd (opendir: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72156 msgr-work ceph cwd unknown /proc/72153/task/72156/cwd (readlink: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72156 msgr-work ceph rtd unknown /proc/72153/task/72156/root (readlink: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72156 msgr-work ceph txt unknown /proc/72153/task/72156/exe (readlink: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72156 msgr-work ceph NOFD /proc/72153/task/72156/fd (opendir: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72157 msgr-work ceph cwd unknown /proc/72153/task/72157/cwd (readlink: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72157 msgr-work ceph rtd unknown /proc/72153/task/72157/root (readlink: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72157 msgr-work ceph txt unknown /proc/72153/task/72157/exe (readlink: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72157 msgr-work ceph NOFD /proc/72153/task/72157/fd (opendir: Permission denied) 2024-09-21T01:16:05.922 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72158 msgr-work ceph cwd unknown /proc/72153/task/72158/cwd (readlink: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72158 msgr-work ceph rtd unknown /proc/72153/task/72158/root (readlink: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72158 msgr-work ceph txt unknown /proc/72153/task/72158/exe (readlink: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72158 msgr-work ceph NOFD /proc/72153/task/72158/fd (opendir: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72162 service ceph cwd unknown /proc/72153/task/72162/cwd (readlink: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72162 service ceph rtd unknown /proc/72153/task/72162/root (readlink: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72162 service ceph txt unknown /proc/72153/task/72162/exe (readlink: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72162 service ceph NOFD /proc/72153/task/72162/fd (opendir: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72163 admin_soc ceph cwd unknown /proc/72153/task/72163/cwd (readlink: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72163 admin_soc ceph rtd unknown /proc/72153/task/72163/root (readlink: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72163 admin_soc ceph txt unknown /proc/72153/task/72163/exe (readlink: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72163 admin_soc ceph NOFD /proc/72153/task/72163/fd (opendir: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72164 signal_ha ceph cwd unknown /proc/72153/task/72164/cwd (readlink: Permission denied) 2024-09-21T01:16:05.923 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72164 signal_ha ceph rtd unknown /proc/72153/task/72164/root (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72164 signal_ha ceph txt unknown /proc/72153/task/72164/exe (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72164 signal_ha ceph NOFD /proc/72153/task/72164/fd (opendir: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72165 io_contex ceph cwd unknown /proc/72153/task/72165/cwd (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72165 io_contex ceph rtd unknown /proc/72153/task/72165/root (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72165 io_contex ceph txt unknown /proc/72153/task/72165/exe (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72165 io_contex ceph NOFD /proc/72153/task/72165/fd (opendir: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72166 io_contex ceph cwd unknown /proc/72153/task/72166/cwd (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72166 io_contex ceph rtd unknown /proc/72153/task/72166/root (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72166 io_contex ceph txt unknown /proc/72153/task/72166/exe (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72166 io_contex ceph NOFD /proc/72153/task/72166/fd (opendir: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72167 ms_dispat ceph cwd unknown /proc/72153/task/72167/cwd (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72167 ms_dispat ceph rtd unknown /proc/72153/task/72167/root (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72167 ms_dispat ceph txt unknown /proc/72153/task/72167/exe (readlink: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72167 ms_dispat ceph NOFD /proc/72153/task/72167/fd (opendir: Permission denied) 2024-09-21T01:16:05.924 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72168 ms_local ceph cwd unknown /proc/72153/task/72168/cwd (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72168 ms_local ceph rtd unknown /proc/72153/task/72168/root (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72168 ms_local ceph txt unknown /proc/72153/task/72168/exe (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72168 ms_local ceph NOFD /proc/72153/task/72168/fd (opendir: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72169 safe_time ceph cwd unknown /proc/72153/task/72169/cwd (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72169 safe_time ceph rtd unknown /proc/72153/task/72169/root (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72169 safe_time ceph txt unknown /proc/72153/task/72169/exe (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72169 safe_time ceph NOFD /proc/72153/task/72169/fd (opendir: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72170 safe_time ceph cwd unknown /proc/72153/task/72170/cwd (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72170 safe_time ceph rtd unknown /proc/72153/task/72170/root (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72170 safe_time ceph txt unknown /proc/72153/task/72170/exe (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72170 safe_time ceph NOFD /proc/72153/task/72170/fd (opendir: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72171 ceph-mds ceph cwd unknown /proc/72153/task/72171/cwd (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72171 ceph-mds ceph rtd unknown /proc/72153/task/72171/root (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72171 ceph-mds ceph txt unknown /proc/72153/task/72171/exe (readlink: Permission denied) 2024-09-21T01:16:05.925 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72171 ceph-mds ceph NOFD /proc/72153/task/72171/fd (opendir: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72271 safe_time ceph cwd unknown /proc/72153/task/72271/cwd (readlink: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72271 safe_time ceph rtd unknown /proc/72153/task/72271/root (readlink: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72271 safe_time ceph txt unknown /proc/72153/task/72271/exe (readlink: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72153 72271 safe_time ceph NOFD /proc/72153/task/72271/fd (opendir: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 72428 root cwd unknown /proc/72428/cwd (readlink: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 72428 root rtd unknown /proc/72428/root (readlink: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 72428 root txt unknown /proc/72428/exe (readlink: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 72428 root NOFD /proc/72428/fd (opendir: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 72430 root cwd unknown /proc/72430/cwd (readlink: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 72430 root rtd unknown /proc/72430/root (readlink: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 72430 root txt unknown /proc/72430/exe (readlink: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:podman-in 72430 root NOFD /proc/72430/fd (opendir: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 ceph cwd unknown /proc/72450/cwd (readlink: Permission denied) 2024-09-21T01:16:05.926 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 ceph rtd unknown /proc/72450/root (readlink: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 ceph txt unknown /proc/72450/exe (readlink: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 ceph NOFD /proc/72450/fd (opendir: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72451 log ceph cwd unknown /proc/72450/task/72451/cwd (readlink: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72451 log ceph rtd unknown /proc/72450/task/72451/root (readlink: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72451 log ceph txt unknown /proc/72450/task/72451/exe (readlink: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72451 log ceph NOFD /proc/72450/task/72451/fd (opendir: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72453 msgr-work ceph cwd unknown /proc/72450/task/72453/cwd (readlink: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72453 msgr-work ceph rtd unknown /proc/72450/task/72453/root (readlink: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72453 msgr-work ceph txt unknown /proc/72450/task/72453/exe (readlink: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72453 msgr-work ceph NOFD /proc/72450/task/72453/fd (opendir: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72454 msgr-work ceph cwd unknown /proc/72450/task/72454/cwd (readlink: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72454 msgr-work ceph rtd unknown /proc/72450/task/72454/root (readlink: Permission denied) 2024-09-21T01:16:05.927 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72454 msgr-work ceph txt unknown /proc/72450/task/72454/exe (readlink: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72454 msgr-work ceph NOFD /proc/72450/task/72454/fd (opendir: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72455 msgr-work ceph cwd unknown /proc/72450/task/72455/cwd (readlink: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72455 msgr-work ceph rtd unknown /proc/72450/task/72455/root (readlink: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72455 msgr-work ceph txt unknown /proc/72450/task/72455/exe (readlink: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72455 msgr-work ceph NOFD /proc/72450/task/72455/fd (opendir: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72459 service ceph cwd unknown /proc/72450/task/72459/cwd (readlink: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72459 service ceph rtd unknown /proc/72450/task/72459/root (readlink: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72459 service ceph txt unknown /proc/72450/task/72459/exe (readlink: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72459 service ceph NOFD /proc/72450/task/72459/fd (opendir: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72460 admin_soc ceph cwd unknown /proc/72450/task/72460/cwd (readlink: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72460 admin_soc ceph rtd unknown /proc/72450/task/72460/root (readlink: Permission denied) 2024-09-21T01:16:05.928 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72460 admin_soc ceph txt unknown /proc/72450/task/72460/exe (readlink: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72460 admin_soc ceph NOFD /proc/72450/task/72460/fd (opendir: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72461 signal_ha ceph cwd unknown /proc/72450/task/72461/cwd (readlink: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72461 signal_ha ceph rtd unknown /proc/72450/task/72461/root (readlink: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72461 signal_ha ceph txt unknown /proc/72450/task/72461/exe (readlink: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72461 signal_ha ceph NOFD /proc/72450/task/72461/fd (opendir: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72462 io_contex ceph cwd unknown /proc/72450/task/72462/cwd (readlink: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72462 io_contex ceph rtd unknown /proc/72450/task/72462/root (readlink: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72462 io_contex ceph txt unknown /proc/72450/task/72462/exe (readlink: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72462 io_contex ceph NOFD /proc/72450/task/72462/fd (opendir: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72463 io_contex ceph cwd unknown /proc/72450/task/72463/cwd (readlink: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72463 io_contex ceph rtd unknown /proc/72450/task/72463/root (readlink: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72463 io_contex ceph txt unknown /proc/72450/task/72463/exe (readlink: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72463 io_contex ceph NOFD /proc/72450/task/72463/fd (opendir: Permission denied) 2024-09-21T01:16:05.929 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72464 ms_dispat ceph cwd unknown /proc/72450/task/72464/cwd (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72464 ms_dispat ceph rtd unknown /proc/72450/task/72464/root (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72464 ms_dispat ceph txt unknown /proc/72450/task/72464/exe (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72464 ms_dispat ceph NOFD /proc/72450/task/72464/fd (opendir: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72465 ms_local ceph cwd unknown /proc/72450/task/72465/cwd (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72465 ms_local ceph rtd unknown /proc/72450/task/72465/root (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72465 ms_local ceph txt unknown /proc/72450/task/72465/exe (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72465 ms_local ceph NOFD /proc/72450/task/72465/fd (opendir: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72466 safe_time ceph cwd unknown /proc/72450/task/72466/cwd (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72466 safe_time ceph rtd unknown /proc/72450/task/72466/root (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72466 safe_time ceph txt unknown /proc/72450/task/72466/exe (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72466 safe_time ceph NOFD /proc/72450/task/72466/fd (opendir: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72467 safe_time ceph cwd unknown /proc/72450/task/72467/cwd (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72467 safe_time ceph rtd unknown /proc/72450/task/72467/root (readlink: Permission denied) 2024-09-21T01:16:05.930 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72467 safe_time ceph txt unknown /proc/72450/task/72467/exe (readlink: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72467 safe_time ceph NOFD /proc/72450/task/72467/fd (opendir: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72468 ceph-mds ceph cwd unknown /proc/72450/task/72468/cwd (readlink: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72468 ceph-mds ceph rtd unknown /proc/72450/task/72468/root (readlink: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72468 ceph-mds ceph txt unknown /proc/72450/task/72468/exe (readlink: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72468 ceph-mds ceph NOFD /proc/72450/task/72468/fd (opendir: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72469 safe_time ceph cwd unknown /proc/72450/task/72469/cwd (readlink: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72469 safe_time ceph rtd unknown /proc/72450/task/72469/root (readlink: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72469 safe_time ceph txt unknown /proc/72450/task/72469/exe (readlink: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:ceph-mds 72450 72469 safe_time ceph NOFD /proc/72450/task/72469/fd (opendir: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 73595 root cwd unknown /proc/73595/cwd (readlink: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 73595 root rtd unknown /proc/73595/root (readlink: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 73595 root txt unknown /proc/73595/exe (readlink: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/1 73595 root NOFD /proc/73595/fd (opendir: Permission denied) 2024-09-21T01:16:05.931 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 75673 root cwd unknown /proc/75673/cwd (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 75673 root rtd unknown /proc/75673/root (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 75673 root txt unknown /proc/75673/exe (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/u 75673 root NOFD /proc/75673/fd (opendir: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 78524 root cwd unknown /proc/78524/cwd (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 78524 root rtd unknown /proc/78524/root (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 78524 root txt unknown /proc/78524/exe (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/3 78524 root NOFD /proc/78524/fd (opendir: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 80436 root cwd unknown /proc/80436/cwd (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 80436 root rtd unknown /proc/80436/root (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 80436 root txt unknown /proc/80436/exe (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 80436 root NOFD /proc/80436/fd (opendir: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 80914 root cwd unknown /proc/80914/cwd (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 80914 root rtd unknown /proc/80914/root (readlink: Permission denied) 2024-09-21T01:16:05.932 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 80914 root txt unknown /proc/80914/exe (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/0 80914 root NOFD /proc/80914/fd (opendir: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 81436 root cwd unknown /proc/81436/cwd (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 81436 root rtd unknown /proc/81436/root (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 81436 root txt unknown /proc/81436/exe (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/6 81436 root NOFD /proc/81436/fd (opendir: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82470 root cwd unknown /proc/82470/cwd (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82470 root rtd unknown /proc/82470/root (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82470 root txt unknown /proc/82470/exe (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82470 root NOFD /proc/82470/fd (opendir: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82471 root cwd unknown /proc/82471/cwd (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82471 root rtd unknown /proc/82471/root (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82471 root txt unknown /proc/82471/exe (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82471 root NOFD /proc/82471/fd (opendir: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82472 root cwd unknown /proc/82472/cwd (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82472 root rtd unknown /proc/82472/root (readlink: Permission denied) 2024-09-21T01:16:05.933 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82472 root txt unknown /proc/82472/exe (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/R 82472 root NOFD /proc/82472/fd (opendir: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 83319 root cwd unknown /proc/83319/cwd (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 83319 root rtd unknown /proc/83319/root (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 83319 root txt unknown /proc/83319/exe (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 83319 root NOFD /proc/83319/fd (opendir: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:daemon-he 83364 root cwd unknown /proc/83364/cwd (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:daemon-he 83364 root rtd unknown /proc/83364/root (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:daemon-he 83364 root txt unknown /proc/83364/exe (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:daemon-he 83364 root NOFD /proc/83364/fd (opendir: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:bash 83371 root cwd unknown /proc/83371/cwd (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:bash 83371 root rtd unknown /proc/83371/root (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:bash 83371 root txt unknown /proc/83371/exe (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:bash 83371 root NOFD /proc/83371/fd (opendir: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 84987 root cwd unknown /proc/84987/cwd (readlink: Permission denied) 2024-09-21T01:16:05.934 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 84987 root rtd unknown /proc/84987/root (readlink: Permission denied) 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 84987 root txt unknown /proc/84987/exe (readlink: Permission denied) 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 84987 root NOFD /proc/84987/fd (opendir: Permission denied) 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-21T01:16:05.935 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu 0r FIFO 0,13 0t0 229271 pipe 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu 1w FIFO 0,13 0t0 229272 pipe 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:timeout 85261 ubuntu 2w FIFO 0,13 0t0 229273 pipe 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-21T01:16:05.936 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu 0r FIFO 0,13 0t0 229271 pipe 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu 1w FIFO 0,13 0t0 229272 pipe 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu 2w FIFO 0,13 0t0 229273 pipe 2024-09-21T01:16:05.937 INFO:tasks.workunit.client.0.smithi148.stdout:fsync-tes 85279 ubuntu 255r REG 8,1 207 547345 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 85335 root cwd unknown /proc/85335/cwd (readlink: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 85335 root rtd unknown /proc/85335/root (readlink: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 85335 root txt unknown /proc/85335/exe (readlink: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:kworker/7 85335 root NOFD /proc/85335/fd (opendir: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 setroubleshoot cwd unknown /proc/86560/cwd (readlink: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 setroubleshoot rtd unknown /proc/86560/root (readlink: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 setroubleshoot txt unknown /proc/86560/exe (readlink: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 setroubleshoot NOFD /proc/86560/fd (opendir: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86561 setrouble setroubleshoot cwd unknown /proc/86560/task/86561/cwd (readlink: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86561 setrouble setroubleshoot rtd unknown /proc/86560/task/86561/root (readlink: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86561 setrouble setroubleshoot txt unknown /proc/86560/task/86561/exe (readlink: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86561 setrouble setroubleshoot NOFD /proc/86560/task/86561/fd (opendir: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86566 gmain setroubleshoot cwd unknown /proc/86560/task/86566/cwd (readlink: Permission denied) 2024-09-21T01:16:05.938 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86566 gmain setroubleshoot rtd unknown /proc/86560/task/86566/root (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86566 gmain setroubleshoot txt unknown /proc/86560/task/86566/exe (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86566 gmain setroubleshoot NOFD /proc/86560/task/86566/fd (opendir: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86567 gdbus setroubleshoot cwd unknown /proc/86560/task/86567/cwd (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86567 gdbus setroubleshoot rtd unknown /proc/86560/task/86567/root (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86567 gdbus setroubleshoot txt unknown /proc/86560/task/86567/exe (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:setrouble 86560 86567 gdbus setroubleshoot NOFD /proc/86560/task/86567/fd (opendir: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 root cwd unknown /proc/86568/cwd (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 root rtd unknown /proc/86568/root (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 root txt unknown /proc/86568/exe (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 root NOFD /proc/86568/fd (opendir: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 86569 gmain root cwd unknown /proc/86568/task/86569/cwd (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 86569 gmain root rtd unknown /proc/86568/task/86569/root (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 86569 gmain root txt unknown /proc/86568/task/86569/exe (readlink: Permission denied) 2024-09-21T01:16:05.939 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 86569 gmain root NOFD /proc/86568/task/86569/fd (opendir: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 86570 gdbus root cwd unknown /proc/86568/task/86570/cwd (readlink: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 86570 gdbus root rtd unknown /proc/86568/task/86570/root (readlink: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 86570 gdbus root txt unknown /proc/86568/task/86570/exe (readlink: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:Setrouble 86568 86570 gdbus root NOFD /proc/86568/task/86570/fd (opendir: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:sleep 86636 root cwd unknown /proc/86636/cwd (readlink: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:sleep 86636 root rtd unknown /proc/86636/root (readlink: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:sleep 86636 root txt unknown /proc/86636/exe (readlink: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:sleep 86636 root NOFD /proc/86636/fd (opendir: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 87008 root cwd unknown /proc/87008/cwd (readlink: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 87008 root rtd unknown /proc/87008/root (readlink: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 87008 root txt unknown /proc/87008/exe (readlink: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:sudo 87008 root NOFD /proc/87008/fd (opendir: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:cephadm 87025 root cwd unknown /proc/87025/cwd (readlink: Permission denied) 2024-09-21T01:16:05.940 INFO:tasks.workunit.client.0.smithi148.stdout:cephadm 87025 root rtd unknown /proc/87025/root (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:cephadm 87025 root txt unknown /proc/87025/exe (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:cephadm 87025 root NOFD /proc/87025/fd (opendir: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 root cwd unknown /proc/87067/cwd (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 root rtd unknown /proc/87067/root (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 root txt unknown /proc/87067/exe (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 root NOFD /proc/87067/fd (opendir: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87068 podman root cwd unknown /proc/87067/task/87068/cwd (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87068 podman root rtd unknown /proc/87067/task/87068/root (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87068 podman root txt unknown /proc/87067/task/87068/exe (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87068 podman root NOFD /proc/87067/task/87068/fd (opendir: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87069 podman root cwd unknown /proc/87067/task/87069/cwd (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87069 podman root rtd unknown /proc/87067/task/87069/root (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87069 podman root txt unknown /proc/87067/task/87069/exe (readlink: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87069 podman root NOFD /proc/87067/task/87069/fd (opendir: Permission denied) 2024-09-21T01:16:05.941 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87070 podman root cwd unknown /proc/87067/task/87070/cwd (readlink: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87070 podman root rtd unknown /proc/87067/task/87070/root (readlink: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87070 podman root txt unknown /proc/87067/task/87070/exe (readlink: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87070 podman root NOFD /proc/87067/task/87070/fd (opendir: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87071 podman root cwd unknown /proc/87067/task/87071/cwd (readlink: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87071 podman root rtd unknown /proc/87067/task/87071/root (readlink: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87071 podman root txt unknown /proc/87067/task/87071/exe (readlink: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87071 podman root NOFD /proc/87067/task/87071/fd (opendir: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87072 podman root cwd unknown /proc/87067/task/87072/cwd (readlink: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87072 podman root rtd unknown /proc/87067/task/87072/root (readlink: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87072 podman root txt unknown /proc/87067/task/87072/exe (readlink: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87072 podman root NOFD /proc/87067/task/87072/fd (opendir: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87073 podman root cwd unknown /proc/87067/task/87073/cwd (readlink: Permission denied) 2024-09-21T01:16:05.942 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87073 podman root rtd unknown /proc/87067/task/87073/root (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87073 podman root txt unknown /proc/87067/task/87073/exe (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87073 podman root NOFD /proc/87067/task/87073/fd (opendir: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87074 podman root cwd unknown /proc/87067/task/87074/cwd (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87074 podman root rtd unknown /proc/87067/task/87074/root (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87074 podman root txt unknown /proc/87067/task/87074/exe (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87074 podman root NOFD /proc/87067/task/87074/fd (opendir: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87075 podman root cwd unknown /proc/87067/task/87075/cwd (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87075 podman root rtd unknown /proc/87067/task/87075/root (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87075 podman root txt unknown /proc/87067/task/87075/exe (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87075 podman root NOFD /proc/87067/task/87075/fd (opendir: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87076 podman root cwd unknown /proc/87067/task/87076/cwd (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87076 podman root rtd unknown /proc/87067/task/87076/root (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87076 podman root txt unknown /proc/87067/task/87076/exe (readlink: Permission denied) 2024-09-21T01:16:05.943 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87076 podman root NOFD /proc/87067/task/87076/fd (opendir: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87077 podman root cwd unknown /proc/87067/task/87077/cwd (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87077 podman root rtd unknown /proc/87067/task/87077/root (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87077 podman root txt unknown /proc/87067/task/87077/exe (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87077 podman root NOFD /proc/87067/task/87077/fd (opendir: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87078 podman root cwd unknown /proc/87067/task/87078/cwd (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87078 podman root rtd unknown /proc/87067/task/87078/root (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87078 podman root txt unknown /proc/87067/task/87078/exe (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87078 podman root NOFD /proc/87067/task/87078/fd (opendir: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87079 podman root cwd unknown /proc/87067/task/87079/cwd (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87079 podman root rtd unknown /proc/87067/task/87079/root (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87079 podman root txt unknown /proc/87067/task/87079/exe (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87079 podman root NOFD /proc/87067/task/87079/fd (opendir: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87081 podman root cwd unknown /proc/87067/task/87081/cwd (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87081 podman root rtd unknown /proc/87067/task/87081/root (readlink: Permission denied) 2024-09-21T01:16:05.944 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87081 podman root txt unknown /proc/87067/task/87081/exe (readlink: Permission denied) 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:podman 87067 87081 podman root NOFD /proc/87067/task/87081/fd (opendir: Permission denied) 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 87083 root cwd unknown /proc/87083/cwd (readlink: Permission denied) 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 87083 root rtd unknown /proc/87083/root (readlink: Permission denied) 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 87083 root txt unknown /proc/87083/exe (readlink: Permission denied) 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:conmon 87083 root NOFD /proc/87083/fd (opendir: Permission denied) 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:3 87085 root cwd unknown /proc/87085/cwd (readlink: Permission denied) 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:3 87085 root rtd unknown /proc/87085/root (readlink: Permission denied) 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:3 87085 root txt unknown /proc/87085/exe (readlink: Permission denied) 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:3 87085 root NOFD /proc/87085/fd (opendir: Permission denied) 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-21T01:16:05.945 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu 0r FIFO 0,13 0t0 229271 pipe 2024-09-21T01:16:05.946 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu 1w FIFO 0,13 0t0 229272 pipe 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu 2w FIFO 0,13 0t0 229273 pipe 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu 3r DIR 0,20 0 1 /proc 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu 4r DIR 0,20 0 239626 /proc/87086/fd 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu 5w FIFO 0,13 0t0 239631 pipe 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87086 ubuntu 6r FIFO 0,13 0t0 239632 pipe 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu rtd DIR 8,1 4096 2 / 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-21T01:16:05.947 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu 4r FIFO 0,13 0t0 239631 pipe 2024-09-21T01:16:05.948 INFO:tasks.workunit.client.0.smithi148.stdout:lsof 87087 ubuntu 7w FIFO 0,13 0t0 239632 pipe 2024-09-21T01:16:05.949 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T01:16:05.949 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:16:05.949 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:05 smithi148 ceph-mon[31000]: pgmap v401: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-21T01:16:05.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.780+0000 7fc7ded6f640 1 -- 172.21.15.148:0/2012543357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d8102a90 msgr2=0x7fc7d8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:05.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.780+0000 7fc7ded6f640 1 --2- 172.21.15.148:0/2012543357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d8102a90 0x7fc7d8102ea0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009900 tx=0x7fc7c802a410 comp rx=0 tx=0).stop 2024-09-21T01:16:05.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.780+0000 7fc7ded6f640 1 -- 172.21.15.148:0/2012543357 shutdown_connections 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.780+0000 7fc7ded6f640 1 --2- 172.21.15.148:0/2012543357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7d8108d20 0x7fc7d810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.780+0000 7fc7ded6f640 1 --2- 172.21.15.148:0/2012543357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d81083d0 0x7fc7d81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.780+0000 7fc7ded6f640 1 --2- 172.21.15.148:0/2012543357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d8102a90 0x7fc7d8102ea0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.780+0000 7fc7ded6f640 1 -- 172.21.15.148:0/2012543357 >> 172.21.15.148:0/2012543357 conn(0x7fc7d8079750 msgr2=0x7fc7d8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.780+0000 7fc7ded6f640 1 -- 172.21.15.148:0/2012543357 shutdown_connections 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.780+0000 7fc7ded6f640 1 -- 172.21.15.148:0/2012543357 wait complete. 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.780+0000 7fc7ded6f640 1 Processor -- start 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7ded6f640 1 -- start start 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7ded6f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d8102a90 0x7fc7d819b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7ded6f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7d81083d0 0x7fc7d819b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7ded6f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d8108d20 0x7fc7d819bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7ded6f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d8112990 con 0x7fc7d8102a90 2024-09-21T01:16:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7ded6f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d8112810 con 0x7fc7d81083d0 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7ded6f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d8112b10 con 0x7fc7d8108d20 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7dcb0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d8102a90 0x7fc7d819b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7dcb0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d8102a90 0x7fc7d819b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36344/0 (socket says 172.21.15.148:36344) 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/924798406 learned_addr learned my addr 172.21.15.148:0/924798406 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7dd30c640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d8108d20 0x7fc7d819bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7d7fff640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7d81083d0 0x7fc7d819b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/924798406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d8108d20 msgr2=0x7fc7d819bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d8108d20 0x7fc7d819bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/924798406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7d81083d0 msgr2=0x7fc7d819b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7d81083d0 0x7fc7d819b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.781+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/924798406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d81a6530 con 0x7fc7d8102a90 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.782+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d8102a90 0x7fc7d819b220 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8005940 tx=0x7fc7c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.782+0000 7fc7d5ffb640 1 -- 172.21.15.148:0/924798406 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c803f030 con 0x7fc7d8102a90 2024-09-21T01:16:05.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.782+0000 7fc7ded6f640 1 -- 172.21.15.148:0/924798406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d81a67c0 con 0x7fc7d8102a90 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.782+0000 7fc7d5ffb640 1 -- 172.21.15.148:0/924798406 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7c8003cb0 con 0x7fc7d8102a90 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.782+0000 7fc7d5ffb640 1 -- 172.21.15.148:0/924798406 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8035070 con 0x7fc7d8102a90 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.782+0000 7fc7ded6f640 1 -- 172.21.15.148:0/924798406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d81a6ca0 con 0x7fc7d8102a90 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7e52e3740 1 Processor -- start 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7e52e3740 1 -- start start 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7d5ffb640 1 -- 172.21.15.148:0/924798406 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7fc7c8042030 con 0x7fc7d8102a90 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0463a0070 0x55d0467476a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d046747be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d04637f390 0x55d046748120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d0466bdea0 con 0x55d0463771b0 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55d0466ad2d0 con 0x55d04637f390 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d0466b10e0 con 0x55d0463a0070 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7dcb0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d046747be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7dcb0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d046747be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36358/0 (socket says 172.21.15.148:36358) 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/2385934382 learned_addr learned my addr 172.21.15.148:0/2385934382 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7dd30c640 1 --2- 172.21.15.148:0/2385934382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0463a0070 0x55d0467476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7d7fff640 1 --2- 172.21.15.148:0/2385934382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d04637f390 0x55d046748120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/2385934382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0463a0070 msgr2=0x55d0467476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/2385934382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0463a0070 0x55d0467476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/2385934382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d04637f390 msgr2=0x55d046748120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.785+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/2385934382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d04637f390 0x55d046748120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.786+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/2385934382 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d04640b650 con 0x55d0463771b0 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.786+0000 7fc7d7fff640 1 --2- 172.21.15.148:0/2385934382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d04637f390 0x55d046748120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.786+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/2385934382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d046747be0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc7c810bd50 tx=0x7fc7c810be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67b8e23d9767c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.786+0000 7fc7d5ffb640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7c00b6510 0x7fc7c00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.786+0000 7fc7dd30c640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7c00b6510 0x7fc7c00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.786+0000 7fc7beffd640 1 -- 172.21.15.148:0/2385934382 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8117070 con 0x55d0463771b0 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.786+0000 7fc7beffd640 1 -- 172.21.15.148:0/2385934382 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7c80cd860 con 0x55d0463771b0 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.786+0000 7fc7beffd640 1 -- 172.21.15.148:0/2385934382 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c80cdb20 con 0x55d0463771b0 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.786+0000 7fc7d5ffb640 1 -- 172.21.15.148:0/924798406 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fc7c8107bb0 con 0x7fc7d8102a90 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 -- 172.21.15.148:0/2385934382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 msgr2=0x55d046747be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/2385934382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d046747be0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc7c810bd50 tx=0x7fc7c810be40 comp rx=0 tx=0).stop 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7dd30c640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7c00b6510 0x7fc7c00b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc7d806cc00 tx=0x7fc7d0009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 -- 172.21.15.148:0/2385934382 shutdown_connections 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/2385934382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d046747be0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/2385934382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d04637f390 0x55d046748120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/2385934382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0463a0070 0x55d0467476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 -- 172.21.15.148:0/2385934382 >> 172.21.15.148:0/2385934382 conn(0x55d046394460 msgr2=0x55d046745590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 -- 172.21.15.148:0/2385934382 shutdown_connections 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 -- 172.21.15.148:0/2385934382 wait complete. 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 -- start start 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.787+0000 7fc7e52e3740 1 Processor -- start 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463771b0 0x55d046752d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d04637f390 0x55d046753240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463a0070 0x55d04675eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d04650e700 con 0x55d0463a0070 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55d046648160 con 0x55d0463771b0 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d046755c40 con 0x55d04637f390 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7e52e3740 10 client.0 _ll_register_callbacks cb 0x55d0466619e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7dd30c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463a0070 0x55d04675eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7dd30c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463a0070 0x55d04675eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36360/0 (socket says 172.21.15.148:36360) 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7dd30c640 1 -- 172.21.15.148:0/339474712 learned_addr learned my addr 172.21.15.148:0/339474712 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7d7fff640 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d04637f390 0x55d046753240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463771b0 0x55d046752d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7dd30c640 1 -- 172.21.15.148:0/339474712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d04637f390 msgr2=0x55d046753240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7dd30c640 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d04637f390 0x55d046753240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7dd30c640 1 -- 172.21.15.148:0/339474712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463771b0 msgr2=0x55d046752d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7dd30c640 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463771b0 0x55d046752d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.788+0000 7fc7dd30c640 1 -- 172.21.15.148:0/339474712 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d046675c90 con 0x55d0463a0070 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7dd30c640 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463a0070 0x55d04675eea0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009b00 tx=0x7fc7d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75416349dab751e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7b7fff640 1 -- 172.21.15.148:0/339474712 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0003b70 con 0x55d0463a0070 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7b7fff640 1 -- 172.21.15.148:0/339474712 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fc7d0003d10 con 0x55d0463a0070 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7e52e3740 1 -- 172.21.15.148:0/339474712 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c80cd860 con 0x55d0463a0070 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7b7fff640 1 -- 172.21.15.148:0/339474712 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc7d0004020 con 0x55d0463a0070 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7e52e3740 10 client.15864 fetch_fsmap learned FSMap version 25 2024-09-21T01:16:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7e52e3740 1 -- 172.21.15.148:0/339474712 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d0467618c0 con 0x55d0463a0070 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7b7fff640 1 -- 172.21.15.148:0/339474712 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7c80cd860 con 0x55d0463a0070 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7b7fff640 1 -- 172.21.15.148:0/339474712 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7fc7d000f040 con 0x55d0463a0070 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7e52e3740 10 client.15864 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7e52e3740 10 client.15864 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7e52e3740 20 client.15864 populate_metadata read hostname 'smithi148' 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55d04635e9f0 0x55d046764d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7e52e3740 4 client.15864 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.789+0000 7fc7e52e3740 1 -- 172.21.15.148:0/339474712 --> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0466bfdf0 con 0x55d04635e9f0 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.790+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55d04635e9f0 0x55d046764d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.790+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55d04635e9f0 0x55d046764d70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aefdc65e71e345b server_cookie=b26e5109075dcbd1 in_seq=0 out_seq=0 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.790+0000 7fc7b7fff640 10 client.15864 ms_handle_connect on v2:172.21.15.181:6838/2036386246 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7b7fff640 1 -- 172.21.15.148:0/339474712 <== mds.1 v2:172.21.15.181:6838/2036386246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0466bfdf0 con 0x55d04635e9f0 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7b7fff640 10 client.15864 handle_command_reply: tid=0 2024-09-21T01:16:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 client.15864 shutdown 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 -- 172.21.15.148:0/339474712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463a0070 msgr2=0x55d04675eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463a0070 0x55d04675eea0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009b00 tx=0x7fc7d0004a40 comp rx=0 tx=0).stop 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 -- 172.21.15.148:0/339474712 shutdown_connections 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55d04635e9f0 0x55d046764d70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463a0070 0x55d04675eea0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d04637f390 0x55d046753240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/339474712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463771b0 0x55d046752d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 -- 172.21.15.148:0/339474712 >> 172.21.15.148:0/339474712 conn(0x55d046394460 msgr2=0x55d04674a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7b7fff640 0 client.15864 ms_handle_reset on v2:172.21.15.181:6838/2036386246 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 -- 172.21.15.148:0/339474712 shutdown_connections 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 1 -- 172.21.15.148:0/339474712 wait complete. 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.791+0000 7fc7e52e3740 20 client.15864 trim_cache size 0 max 16384 2024-09-21T01:16:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7e52e3740 1 Processor -- start 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7e52e3740 1 -- start start 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0463771b0 0x55d046749090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d04637f390 0x55d046754930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463a0070 0x55d046744bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d81b1c50 con 0x55d04637f390 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d81af520 con 0x55d0463a0070 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d81ad370 con 0x55d0463771b0 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d04637f390 0x55d046754930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d04637f390 0x55d046754930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36362/0 (socket says 172.21.15.148:36362) 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7d7fff640 1 -- 172.21.15.148:0/2968296560 learned_addr learned my addr 172.21.15.148:0/2968296560 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7dd30c640 1 --2- 172.21.15.148:0/2968296560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463a0070 0x55d046744bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.805+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/2968296560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0463771b0 0x55d046749090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.806+0000 7fc7d7fff640 1 -- 172.21.15.148:0/2968296560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0463771b0 msgr2=0x55d046749090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.806+0000 7fc7d7fff640 1 --2- 172.21.15.148:0/2968296560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0463771b0 0x55d046749090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.806+0000 7fc7d7fff640 1 -- 172.21.15.148:0/2968296560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463a0070 msgr2=0x55d046744bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.806+0000 7fc7d7fff640 1 --2- 172.21.15.148:0/2968296560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463a0070 0x55d046744bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.806+0000 7fc7d7fff640 1 -- 172.21.15.148:0/2968296560 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d04674a500 con 0x55d04637f390 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.806+0000 7fc7dd30c640 1 --2- 172.21.15.148:0/2968296560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463a0070 0x55d046744bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.806+0000 7fc7d7fff640 1 --2- 172.21.15.148:0/2968296560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d04637f390 0x55d046754930 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00fab0 tx=0x7fc7cc00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a00aa09bb4f3c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.806+0000 7fc7be7fc640 1 -- 172.21.15.148:0/2968296560 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc005220 con 0x55d04637f390 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.806+0000 7fc7be7fc640 1 -- 172.21.15.148:0/2968296560 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7cc004c50 con 0x55d04637f390 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.806+0000 7fc7be7fc640 1 -- 172.21.15.148:0/2968296560 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00bb60 con 0x55d04637f390 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.807+0000 7fc7e52e3740 1 -- 172.21.15.148:0/2968296560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d04637f390 msgr2=0x55d046754930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.807+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/2968296560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d04637f390 0x55d046754930 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00fab0 tx=0x7fc7cc00ff70 comp rx=0 tx=0).stop 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.807+0000 7fc7e52e3740 1 -- 172.21.15.148:0/2968296560 shutdown_connections 2024-09-21T01:16:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.807+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/2968296560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d04637f390 0x55d046754930 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.807+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/2968296560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463a0070 0x55d046744bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.807+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/2968296560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0463771b0 0x55d046749090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.807+0000 7fc7e52e3740 1 -- 172.21.15.148:0/2968296560 >> 172.21.15.148:0/2968296560 conn(0x55d046394460 msgr2=0x55d046754220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.807+0000 7fc7e52e3740 1 -- 172.21.15.148:0/2968296560 shutdown_connections 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.807+0000 7fc7e52e3740 1 -- 172.21.15.148:0/2968296560 wait complete. 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.807+0000 7fc7e52e3740 1 -- start start 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7e52e3740 1 Processor -- start 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d04675b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d04637f390 0x55d046756cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7e52e3740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463a0070 0x55d0467573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d81ad9e0 con 0x55d0463771b0 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d81aee50 con 0x55d0463a0070 2024-09-21T01:16:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7e52e3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d81ae0b0 con 0x55d04637f390 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7e52e3740 10 client.0 _ll_register_callbacks cb 0x7fc7d0009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7dcb0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d04675b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7dcb0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d04675b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36370/0 (socket says 172.21.15.148:36370) 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/3220202472 learned_addr learned my addr 172.21.15.148:0/3220202472 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7d7fff640 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d04637f390 0x55d046756cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/3220202472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d04637f390 msgr2=0x55d046756cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.808+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d04637f390 0x55d046756cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/3220202472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463a0070 msgr2=0x55d0467573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463a0070 0x55d0467573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7dcb0b640 1 -- 172.21.15.148:0/3220202472 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0467ce730 con 0x55d0463771b0 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7dcb0b640 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d04675b7e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8003fd0 tx=0x7fc7c802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af9e7694da95553 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7b7fff640 1 -- 172.21.15.148:0/3220202472 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8076cb0 con 0x55d0463771b0 2024-09-21T01:16:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7b7fff640 1 -- 172.21.15.148:0/3220202472 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fc7c810b8d0 con 0x55d0463771b0 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7e52e3740 1 -- 172.21.15.148:0/3220202472 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7cc004c50 con 0x55d0463771b0 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7b7fff640 1 -- 172.21.15.148:0/3220202472 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc7c8049030 con 0x55d0463771b0 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7e52e3740 10 client.15870 fetch_fsmap learned FSMap version 25 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7e52e3740 1 -- 172.21.15.148:0/3220202472 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d0467d3c90 con 0x55d0463771b0 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7b7fff640 1 -- 172.21.15.148:0/3220202472 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7cc004c50 con 0x55d0463771b0 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7b7fff640 1 -- 172.21.15.148:0/3220202472 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7fc7c80c9fc0 con 0x55d0463771b0 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7e52e3740 10 client.15870 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7e52e3740 10 client.15870 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7e52e3740 20 client.15870 populate_metadata read hostname 'smithi148' 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55d046333da0 0x55d0467d6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7e52e3740 4 client.15870 mds_command: new command op to 24646 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.809+0000 7fc7e52e3740 1 -- 172.21.15.148:0/3220202472 --> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0466bb8a0 con 0x55d046333da0 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.810+0000 7fc7d7fff640 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55d046333da0 0x55d0467d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.810+0000 7fc7b7fff640 10 client.15870 ms_handle_connect on v2:172.21.15.181:6838/2036386246 2024-09-21T01:16:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.810+0000 7fc7d7fff640 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55d046333da0 0x55d0467d6050 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56bbf9e14335ff40 server_cookie=b5153774b385adc2 in_seq=0 out_seq=0 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7b7fff640 1 -- 172.21.15.148:0/3220202472 <== mds.1 v2:172.21.15.181:6838/2036386246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0466bb8a0 con 0x55d046333da0 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7b7fff640 10 client.15870 handle_command_reply: tid=0 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 client.15870 shutdown 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 -- 172.21.15.148:0/3220202472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 msgr2=0x55d04675b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d04675b7e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8003fd0 tx=0x7fc7c802a410 comp rx=0 tx=0).stop 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 -- 172.21.15.148:0/3220202472 shutdown_connections 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.181:6838/2036386246,v1:172.21.15.181:6839/2036386246] conn(0x55d046333da0 0x55d0467d6050 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d0463a0070 0x55d0467573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d04637f390 0x55d046756cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7b7fff640 0 client.15870 ms_handle_reset on v2:172.21.15.181:6838/2036386246 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 --2- 172.21.15.148:0/3220202472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0463771b0 0x55d04675b7e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 -- 172.21.15.148:0/3220202472 >> 172.21.15.148:0/3220202472 conn(0x55d046394460 msgr2=0x55d046754b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 -- 172.21.15.148:0/3220202472 shutdown_connections 2024-09-21T01:16:05.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 1 -- 172.21.15.148:0/3220202472 wait complete. 2024-09-21T01:16:05.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.811+0000 7fc7e52e3740 20 client.15870 trim_cache size 0 max 16384 2024-09-21T01:16:05.970 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 -- 172.21.15.148:0/924798406 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7c00b6510 msgr2=0x7fc7c00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7c00b6510 0x7fc7c00b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc7d806cc00 tx=0x7fc7d0009600 comp rx=0 tx=0).stop 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 -- 172.21.15.148:0/924798406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d8102a90 msgr2=0x7fc7d819b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d8102a90 0x7fc7d819b220 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8005940 tx=0x7fc7c80042f0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 -- 172.21.15.148:0/924798406 shutdown_connections 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fc7c00b6510 0x7fc7c00b8a20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7d8108d20 0x7fc7d819bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7d81083d0 0x7fc7d819b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 --2- 172.21.15.148:0/924798406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d8102a90 0x7fc7d819b220 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 -- 172.21.15.148:0/924798406 >> 172.21.15.148:0/924798406 conn(0x7fc7d8079750 msgr2=0x7fc7d8101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 -- 172.21.15.148:0/924798406 shutdown_connections 2024-09-21T01:16:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:05.812+0000 7fc7ded6f640 1 -- 172.21.15.148:0/924798406 wait complete. 2024-09-21T01:16:05.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:05 smithi181 ceph-mon[34811]: pgmap v401: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-21T01:16:05.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:05 smithi157 ceph-mon[34140]: pgmap v401: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2024-09-21T01:16:06.013 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-21T01:16:06.013 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T01:16:06.361 DEBUG:teuthology.parallel:result is None 2024-09-21T01:16:06.362 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T01:16:06.404 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T01:16:06.404 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T01:16:06.414 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T01:16:06.454 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T01:16:06.464 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T01:16:06.489 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:16:06.779 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 -- 172.21.15.148:0/599926852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16fc109e40 msgr2=0x7f16fc110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 --2- 172.21.15.148:0/599926852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16fc109e40 0x7f16fc110670 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009ca0 tx=0x7f16f402a8e0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 -- 172.21.15.148:0/599926852 shutdown_connections 2024-09-21T01:16:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 --2- 172.21.15.148:0/599926852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16fc109e40 0x7f16fc110670 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 --2- 172.21.15.148:0/599926852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16fc1094f0 0x7f16fc109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 --2- 172.21.15.148:0/599926852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc103bb0 0x7f16fc103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 -- 172.21.15.148:0/599926852 >> 172.21.15.148:0/599926852 conn(0x7f16fc0ff600 msgr2=0x7f16fc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 -- 172.21.15.148:0/599926852 shutdown_connections 2024-09-21T01:16:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 -- 172.21.15.148:0/599926852 wait complete. 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 Processor -- start 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.274+0000 7f1703b73640 1 -- start start 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f1703b73640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc103bb0 0x7f16fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f1703b73640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16fc1094f0 0x7f16fc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f1703b73640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16fc109e40 0x7f16fc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f1703b73640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc113bc0 con 0x7f16fc1094f0 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f1703b73640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc113a40 con 0x7f16fc103bb0 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f1703b73640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc113d40 con 0x7f16fc109e40 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f170110e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16fc1094f0 0x7f16fc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f170110e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16fc1094f0 0x7f16fc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54908/0 (socket says 172.21.15.148:54908) 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f170110e640 1 -- 172.21.15.148:0/2991049334 learned_addr learned my addr 172.21.15.148:0/2991049334 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f1702110640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16fc109e40 0x7f16fc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f170190f640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc103bb0 0x7f16fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f170110e640 1 -- 172.21.15.148:0/2991049334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16fc109e40 msgr2=0x7f16fc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:07.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f170110e640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16fc109e40 0x7f16fc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f170110e640 1 -- 172.21.15.148:0/2991049334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc103bb0 msgr2=0x7f16fc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:07.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f170110e640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc103bb0 0x7f16fc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f170110e640 1 -- 172.21.15.148:0/2991049334 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16fc1a88f0 con 0x7f16fc1094f0 2024-09-21T01:16:07.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.275+0000 7f170110e640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16fc1094f0 0x7f16fc075c50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f16ec006fd0 tx=0x7f16ec00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.276+0000 7f16f2ffd640 1 -- 172.21.15.148:0/2991049334 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec015020 con 0x7f16fc1094f0 2024-09-21T01:16:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.276+0000 7f16f2ffd640 1 -- 172.21.15.148:0/2991049334 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16ec011ce0 con 0x7f16fc1094f0 2024-09-21T01:16:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.276+0000 7f1703b73640 1 -- 172.21.15.148:0/2991049334 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16fc1a8be0 con 0x7f16fc1094f0 2024-09-21T01:16:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.276+0000 7f16f2ffd640 1 -- 172.21.15.148:0/2991049334 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec010d90 con 0x7f16fc1094f0 2024-09-21T01:16:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.276+0000 7f1703b73640 1 -- 172.21.15.148:0/2991049334 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16fc1a9120 con 0x7f16fc1094f0 2024-09-21T01:16:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.278+0000 7f170a0e7740 1 Processor -- start 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170a0e7740 1 -- start start 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f16f2ffd640 1 -- 172.21.15.148:0/2991049334 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f16ec018020 con 0x7f16fc1094f0 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf47516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 0x55dbf4751be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4752120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170a0e7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dbf46c7ea0 con 0x55dbf4389390 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170a0e7740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55dbf46b72d0 con 0x55dbf43811b0 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170a0e7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55dbf46bb0e0 con 0x55dbf43aa070 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170110e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4752120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170110e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4752120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54918/0 (socket says 172.21.15.148:54918) 2024-09-21T01:16:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170110e640 1 -- 172.21.15.148:0/1412420896 learned_addr learned my addr 172.21.15.148:0/1412420896 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f1702110640 1 --2- 172.21.15.148:0/1412420896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf47516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170190f640 1 --2- 172.21.15.148:0/1412420896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 0x55dbf4751be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170110e640 1 -- 172.21.15.148:0/1412420896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 msgr2=0x55dbf47516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170110e640 1 --2- 172.21.15.148:0/1412420896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf47516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170110e640 1 -- 172.21.15.148:0/1412420896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 msgr2=0x55dbf4751be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170110e640 1 --2- 172.21.15.148:0/1412420896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 0x55dbf4751be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.279+0000 7f170110e640 1 -- 172.21.15.148:0/1412420896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf4415650 con 0x55dbf4389390 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.280+0000 7f170110e640 1 --2- 172.21.15.148:0/1412420896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4752120 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0ecbf0 tx=0x7f16ec0ee670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e087180b085e4ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.280+0000 7f16f2ffd640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16e80b6510 0x7f16e80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.280+0000 7f1702110640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16e80b6510 0x7f16e80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.280+0000 7f16e7fff640 1 -- 172.21.15.148:0/1412420896 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0f5070 con 0x55dbf4389390 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.280+0000 7f16f2ffd640 1 -- 172.21.15.148:0/2991049334 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f16ec0e69f0 con 0x7f16fc1094f0 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.280+0000 7f16e7fff640 1 -- 172.21.15.148:0/1412420896 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16ec0ac6a0 con 0x55dbf4389390 2024-09-21T01:16:07.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.280+0000 7f16e7fff640 1 -- 172.21.15.148:0/1412420896 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0a91e0 con 0x55dbf4389390 2024-09-21T01:16:07.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.281+0000 7f170a0e7740 1 -- 172.21.15.148:0/1412420896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 msgr2=0x55dbf4752120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:07.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.281+0000 7f1702110640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16e80b6510 0x7f16e80b8a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f16f40098d0 tx=0x7f16f4009a00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:07.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.281+0000 7f170a0e7740 1 --2- 172.21.15.148:0/1412420896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4752120 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0ecbf0 tx=0x7f16ec0ee670 comp rx=0 tx=0).stop 2024-09-21T01:16:07.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.281+0000 7f170a0e7740 1 -- 172.21.15.148:0/1412420896 shutdown_connections 2024-09-21T01:16:07.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.281+0000 7f170a0e7740 1 --2- 172.21.15.148:0/1412420896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4752120 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.281+0000 7f170a0e7740 1 --2- 172.21.15.148:0/1412420896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 0x55dbf4751be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.281+0000 7f170a0e7740 1 --2- 172.21.15.148:0/1412420896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf47516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.281+0000 7f170a0e7740 1 -- 172.21.15.148:0/1412420896 >> 172.21.15.148:0/1412420896 conn(0x55dbf439e460 msgr2=0x55dbf474f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.281+0000 7f170a0e7740 1 -- 172.21.15.148:0/1412420896 shutdown_connections 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.281+0000 7f170a0e7740 1 -- 172.21.15.148:0/1412420896 wait complete. 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.282+0000 7f170a0e7740 1 -- start start 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.282+0000 7f170a0e7740 1 Processor -- start 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.282+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf43811b0 0x55dbf475cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.282+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf4389390 0x55dbf475d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.282+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf47691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.282+0000 7f170a0e7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dbf4518700 con 0x55dbf43811b0 2024-09-21T01:16:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.282+0000 7f170a0e7740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55dbf4652160 con 0x55dbf4389390 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.282+0000 7f170a0e7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55dbf475fe80 con 0x55dbf43aa070 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.282+0000 7f170a0e7740 10 client.0 _ll_register_callbacks cb 0x55dbf466b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.282+0000 7f170190f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf43811b0 0x55dbf475cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170190f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf43811b0 0x55dbf475cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54932/0 (socket says 172.21.15.148:54932) 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170190f640 1 -- 172.21.15.148:0/1424738549 learned_addr learned my addr 172.21.15.148:0/1424738549 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f1702110640 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf47691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170110e640 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf4389390 0x55dbf475d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170190f640 1 -- 172.21.15.148:0/1424738549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 msgr2=0x55dbf47691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170190f640 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf47691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170190f640 1 -- 172.21.15.148:0/1424738549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf4389390 msgr2=0x55dbf475d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170190f640 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf4389390 0x55dbf475d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170190f640 1 -- 172.21.15.148:0/1424738549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf467fc90 con 0x55dbf43811b0 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f1702110640 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf47691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170110e640 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf4389390 0x55dbf475d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170190f640 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf43811b0 0x55dbf475cd40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f16f8011570 tx=0x7f16f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6f0a97f688487c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f16e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f16e57fa640 1 -- 172.21.15.148:0/1424738549 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8013670 con 0x55dbf43811b0 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f16e57fa640 1 -- 172.21.15.148:0/1424738549 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f16f8013810 con 0x55dbf43811b0 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f170a0e7740 1 -- 172.21.15.148:0/1424738549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16ec0ac6a0 con 0x55dbf43811b0 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.283+0000 7f16e57fa640 1 -- 172.21.15.148:0/1424738549 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16f8013a10 con 0x55dbf43811b0 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f170a0e7740 10 client.15882 fetch_fsmap learned FSMap version 25 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f170a0e7740 1 -- 172.21.15.148:0/1424738549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dbf476bc00 con 0x55dbf43811b0 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f16e57fa640 1 -- 172.21.15.148:0/1424738549 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16ec0ac6a0 con 0x55dbf43811b0 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f16e57fa640 1 -- 172.21.15.148:0/1424738549 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f16f8014440 con 0x55dbf43811b0 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f170a0e7740 10 client.15882 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f170a0e7740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f170a0e7740 20 client.15882 populate_metadata read hostname 'smithi148' 2024-09-21T01:16:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f170a0e7740 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dbf43689f0 0x55dbf476f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f170a0e7740 4 client.15882 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:07.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f170a0e7740 1 -- 172.21.15.148:0/1424738549 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbf46c9df0 con 0x55dbf43689f0 2024-09-21T01:16:07.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.284+0000 7f170110e640 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dbf43689f0 0x55dbf476f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.285+0000 7f16e57fa640 10 client.15882 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:07.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.285+0000 7f170110e640 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dbf43689f0 0x55dbf476f180 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b957e4458d4e16e server_cookie=56d577aed5f48541 in_seq=0 out_seq=0 2024-09-21T01:16:07.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.285+0000 7f16e57fa640 1 -- 172.21.15.148:0/1424738549 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dbf46c9df0 con 0x55dbf43689f0 2024-09-21T01:16:07.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.285+0000 7f16e57fa640 10 client.15882 handle_command_reply: tid=0 2024-09-21T01:16:07.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 client.15882 shutdown 2024-09-21T01:16:07.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 -- 172.21.15.148:0/1424738549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf43811b0 msgr2=0x55dbf475cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:07.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf43811b0 0x55dbf475cd40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f16f8011570 tx=0x7f16f8009f90 comp rx=0 tx=0).stop 2024-09-21T01:16:07.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 -- 172.21.15.148:0/1424738549 shutdown_connections 2024-09-21T01:16:07.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dbf43689f0 0x55dbf476f180 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf47691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf4389390 0x55dbf475d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f16e57fa640 0 client.15882 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:07.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 --2- 172.21.15.148:0/1424738549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf43811b0 0x55dbf475cd40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 -- 172.21.15.148:0/1424738549 >> 172.21.15.148:0/1424738549 conn(0x55dbf439e460 msgr2=0x55dbf4754830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:07.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 -- 172.21.15.148:0/1424738549 shutdown_connections 2024-09-21T01:16:07.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 1 -- 172.21.15.148:0/1424738549 wait complete. 2024-09-21T01:16:07.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.286+0000 7f170a0e7740 20 client.15882 trim_cache size 0 max 16384 2024-09-21T01:16:07.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170a0e7740 1 Processor -- start 2024-09-21T01:16:07.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170a0e7740 1 -- start start 2024-09-21T01:16:07.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 0x55dbf475bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf475e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf474ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170a0e7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc1b3eb0 con 0x55dbf4389390 2024-09-21T01:16:07.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170a0e7740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc1b1780 con 0x55dbf43811b0 2024-09-21T01:16:07.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170a0e7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc1af5f0 con 0x55dbf43aa070 2024-09-21T01:16:07.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170110e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf475e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170110e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf475e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54944/0 (socket says 172.21.15.148:54944) 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170110e640 1 -- 172.21.15.148:0/3923876117 learned_addr learned my addr 172.21.15.148:0/3923876117 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.299+0000 7f170190f640 1 --2- 172.21.15.148:0/3923876117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 0x55dbf475bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f1702110640 1 --2- 172.21.15.148:0/3923876117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf474ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f170110e640 1 -- 172.21.15.148:0/3923876117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 msgr2=0x55dbf474ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f170110e640 1 --2- 172.21.15.148:0/3923876117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf474ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f170110e640 1 -- 172.21.15.148:0/3923876117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 msgr2=0x55dbf475bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f170110e640 1 --2- 172.21.15.148:0/3923876117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 0x55dbf475bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f170110e640 1 -- 172.21.15.148:0/3923876117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf475b240 con 0x55dbf4389390 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f170190f640 1 --2- 172.21.15.148:0/3923876117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 0x55dbf475bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f170110e640 1 --2- 172.21.15.148:0/3923876117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf475e970 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0e4550 tx=0x7f16ec0ee670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56866fe34e1f219d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:07.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f16e77fe640 1 -- 172.21.15.148:0/3923876117 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0f5070 con 0x55dbf4389390 2024-09-21T01:16:07.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f16e77fe640 1 -- 172.21.15.148:0/3923876117 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16ec0ec300 con 0x55dbf4389390 2024-09-21T01:16:07.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.300+0000 7f16e77fe640 1 -- 172.21.15.148:0/3923876117 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0ac300 con 0x55dbf4389390 2024-09-21T01:16:07.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 -- 172.21.15.148:0/3923876117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 msgr2=0x55dbf475e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:07.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 --2- 172.21.15.148:0/3923876117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf475e970 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0e4550 tx=0x7f16ec0ee670 comp rx=0 tx=0).stop 2024-09-21T01:16:07.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 -- 172.21.15.148:0/3923876117 shutdown_connections 2024-09-21T01:16:07.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 --2- 172.21.15.148:0/3923876117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf475e970 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 --2- 172.21.15.148:0/3923876117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43aa070 0x55dbf474ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 --2- 172.21.15.148:0/3923876117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43811b0 0x55dbf475bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 -- 172.21.15.148:0/3923876117 >> 172.21.15.148:0/3923876117 conn(0x55dbf439e460 msgr2=0x55dbf475e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 -- 172.21.15.148:0/3923876117 shutdown_connections 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 -- 172.21.15.148:0/3923876117 wait complete. 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 -- start start 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.301+0000 7f170a0e7740 1 Processor -- start 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43811b0 0x55dbf47659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4760e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170a0e7740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43aa070 0x55dbf47614c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170a0e7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc1afc40 con 0x55dbf4389390 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170a0e7740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc1b10b0 con 0x55dbf43aa070 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170a0e7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc1b0310 con 0x55dbf43811b0 2024-09-21T01:16:07.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170a0e7740 10 client.0 _ll_register_callbacks cb 0x7f16f8009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170110e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4760e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170110e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4760e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54948/0 (socket says 172.21.15.148:54948) 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170110e640 1 -- 172.21.15.148:0/226664686 learned_addr learned my addr 172.21.15.148:0/226664686 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f1702110640 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43aa070 0x55dbf47614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170190f640 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43811b0 0x55dbf47659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170110e640 1 -- 172.21.15.148:0/226664686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43811b0 msgr2=0x55dbf47659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170110e640 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43811b0 0x55dbf47659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170110e640 1 -- 172.21.15.148:0/226664686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43aa070 msgr2=0x55dbf47614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170110e640 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43aa070 0x55dbf47614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170110e640 1 -- 172.21.15.148:0/226664686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf4761c50 con 0x55dbf4389390 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.302+0000 7f170190f640 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43811b0 0x55dbf47659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f170110e640 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4760e90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0acb20 tx=0x7f16ec0ecef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a3e4f4cd8af78c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f16e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T01:16:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f16e57fa640 1 -- 172.21.15.148:0/226664686 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0f5070 con 0x55dbf4389390 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f16e57fa640 1 -- 172.21.15.148:0/226664686 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f16ec0d00e0 con 0x55dbf4389390 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f170a0e7740 1 -- 172.21.15.148:0/226664686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16ec0ec300 con 0x55dbf4389390 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f16e57fa640 1 -- 172.21.15.148:0/226664686 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16ec0ac4e0 con 0x55dbf4389390 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f170a0e7740 10 client.15888 fetch_fsmap learned FSMap version 25 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f170a0e7740 1 -- 172.21.15.148:0/226664686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dbf47d9b80 con 0x55dbf4389390 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f16e57fa640 1 -- 172.21.15.148:0/226664686 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16ec0ec300 con 0x55dbf4389390 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f16e57fa640 1 -- 172.21.15.148:0/226664686 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f16ec0a8e00 con 0x55dbf4389390 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f170a0e7740 10 client.15888 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f170a0e7740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f170a0e7740 20 client.15888 populate_metadata read hostname 'smithi148' 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f170a0e7740 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dbf433dda0 0x55dbf47dbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f170a0e7740 4 client.15888 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.303+0000 7f170a0e7740 1 -- 172.21.15.148:0/226664686 --> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dbf46c58a0 con 0x55dbf433dda0 2024-09-21T01:16:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.304+0000 7f170190f640 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dbf433dda0 0x55dbf47dbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.304+0000 7f170190f640 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dbf433dda0 0x55dbf47dbe00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e8934c189a9eda6 server_cookie=3881153fe330a1c2 in_seq=0 out_seq=0 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.304+0000 7f16e57fa640 10 client.15888 ms_handle_connect on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.304+0000 7f16e57fa640 1 -- 172.21.15.148:0/226664686 <== mds.0 v2:172.21.15.157:6838/762884269 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dbf46c58a0 con 0x55dbf433dda0 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.304+0000 7f16e57fa640 10 client.15888 handle_command_reply: tid=0 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.304+0000 7f170a0e7740 1 client.15888 shutdown 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 1 -- 172.21.15.148:0/226664686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 msgr2=0x55dbf4760e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4760e90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0acb20 tx=0x7f16ec0ecef0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 1 -- 172.21.15.148:0/226664686 shutdown_connections 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.157:6838/762884269,v1:172.21.15.157:6839/762884269] conn(0x55dbf433dda0 0x55dbf47dbe00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf4389390 0x55dbf4760e90 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55dbf43aa070 0x55dbf47614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 1 --2- 172.21.15.148:0/226664686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dbf43811b0 0x55dbf47659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f16e57fa640 0 client.15888 ms_handle_reset on v2:172.21.15.157:6838/762884269 2024-09-21T01:16:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 1 -- 172.21.15.148:0/226664686 >> 172.21.15.148:0/226664686 conn(0x55dbf439e460 msgr2=0x55dbf475e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 1 -- 172.21.15.148:0/226664686 shutdown_connections 2024-09-21T01:16:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 1 -- 172.21.15.148:0/226664686 wait complete. 2024-09-21T01:16:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f170a0e7740 20 client.15888 trim_cache size 0 max 16384 2024-09-21T01:16:07.311 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-21T01:16:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f1703b73640 1 -- 172.21.15.148:0/2991049334 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16e80b6510 msgr2=0x7f16e80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f1703b73640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16e80b6510 0x7f16e80b8a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f16f40098d0 tx=0x7f16f4009a00 comp rx=0 tx=0).stop 2024-09-21T01:16:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f1703b73640 1 -- 172.21.15.148:0/2991049334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16fc1094f0 msgr2=0x7f16fc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f1703b73640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16fc1094f0 0x7f16fc075c50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f16ec006fd0 tx=0x7f16ec00b820 comp rx=0 tx=0).stop 2024-09-21T01:16:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f1703b73640 1 -- 172.21.15.148:0/2991049334 shutdown_connections 2024-09-21T01:16:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.305+0000 7f1703b73640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f16e80b6510 0x7f16e80b8a20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.306+0000 7f1703b73640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16fc1094f0 0x7f16fc075c50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.306+0000 7f1703b73640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16fc109e40 0x7f16fc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.306+0000 7f1703b73640 1 --2- 172.21.15.148:0/2991049334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc103bb0 0x7f16fc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.306+0000 7f1703b73640 1 -- 172.21.15.148:0/2991049334 >> 172.21.15.148:0/2991049334 conn(0x7f16fc0ff600 msgr2=0x7f16fc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.306+0000 7f1703b73640 1 -- 172.21.15.148:0/2991049334 shutdown_connections 2024-09-21T01:16:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:07.306+0000 7f1703b73640 1 -- 172.21.15.148:0/2991049334 wait complete. 2024-09-21T01:16:08.017 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T01:16:08.017 INFO:tasks.fwd_scrub:done joining 2024-09-21T01:16:08.017 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T01:16:08.027 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:16:08.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.139+0000 7fb438f8a640 1 -- 172.21.15.148:0/3167705092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb434102570 msgr2=0x7fb4341029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.139+0000 7fb438f8a640 1 --2- 172.21.15.148:0/3167705092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb434102570 0x7fb4341029e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb424009900 tx=0x7fb42402a410 comp rx=0 tx=0).stop 2024-09-21T01:16:08.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.139+0000 7fb438f8a640 1 -- 172.21.15.148:0/3167705092 shutdown_connections 2024-09-21T01:16:08.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.139+0000 7fb438f8a640 1 --2- 172.21.15.148:0/3167705092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb434103f90 0x7fb43410a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.139+0000 7fb438f8a640 1 --2- 172.21.15.148:0/3167705092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4341035f0 0x7fb434103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.139+0000 7fb438f8a640 1 --2- 172.21.15.148:0/3167705092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb434102570 0x7fb4341029e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.139+0000 7fb438f8a640 1 -- 172.21.15.148:0/3167705092 >> 172.21.15.148:0/3167705092 conn(0x7fb4340fdeb0 msgr2=0x7fb434100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:08.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.139+0000 7fb438f8a640 1 -- 172.21.15.148:0/3167705092 shutdown_connections 2024-09-21T01:16:08.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.139+0000 7fb438f8a640 1 -- 172.21.15.148:0/3167705092 wait complete. 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb438f8a640 1 Processor -- start 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb438f8a640 1 -- start start 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb438f8a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb434102570 0x7fb434198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb438f8a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4341035f0 0x7fb434199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb438f8a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb434103f90 0x7fb43419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb438f8a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb43410e1c0 con 0x7fb4341035f0 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb438f8a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb43410e040 con 0x7fb434102570 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb438f8a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb43410e340 con 0x7fb434103f90 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb429d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4341035f0 0x7fb434199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb429d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4341035f0 0x7fb434199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54972/0 (socket says 172.21.15.148:54972) 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.140+0000 7fb429d9b640 1 -- 172.21.15.148:0/110693703 learned_addr learned my addr 172.21.15.148:0/110693703 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:08.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb43259c640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb434102570 0x7fb434198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb432d9d640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb434103f90 0x7fb43419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb429d9b640 1 -- 172.21.15.148:0/110693703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb434103f90 msgr2=0x7fb43419a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb429d9b640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb434103f90 0x7fb43419a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb429d9b640 1 -- 172.21.15.148:0/110693703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb434102570 msgr2=0x7fb434198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb429d9b640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb434102570 0x7fb434198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb429d9b640 1 -- 172.21.15.148:0/110693703 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43419a850 con 0x7fb4341035f0 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb43259c640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb434102570 0x7fb434198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb429d9b640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4341035f0 0x7fb434199480 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c890 tx=0x7fb41c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb42bfff640 1 -- 172.21.15.148:0/110693703 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c004220 con 0x7fb4341035f0 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb438f8a640 1 -- 172.21.15.148:0/110693703 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43419ab40 con 0x7fb4341035f0 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb42bfff640 1 -- 172.21.15.148:0/110693703 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41c0043c0 con 0x7fb4341035f0 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb42bfff640 1 -- 172.21.15.148:0/110693703 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c004a00 con 0x7fb4341035f0 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.141+0000 7fb438f8a640 1 -- 172.21.15.148:0/110693703 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4341a1230 con 0x7fb4341035f0 2024-09-21T01:16:08.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.142+0000 7fb438f8a640 1 -- 172.21.15.148:0/110693703 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb434109740 con 0x7fb4341035f0 2024-09-21T01:16:08.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.144+0000 7fb42bfff640 1 -- 172.21.15.148:0/110693703 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7fb41c0079b0 con 0x7fb4341035f0 2024-09-21T01:16:08.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.145+0000 7fb42bfff640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4200b6510 0x7fb4200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.145+0000 7fb43259c640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4200b6510 0x7fb4200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.145+0000 7fb42bfff640 1 -- 172.21.15.148:0/110693703 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fb41c0e7530 con 0x7fb4341035f0 2024-09-21T01:16:08.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.145+0000 7fb43259c640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4200b6510 0x7fb4200b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb424031440 tx=0x7fb424005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:08.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.148+0000 7fb42bfff640 1 -- 172.21.15.148:0/110693703 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb41c014030 con 0x7fb4341035f0 2024-09-21T01:16:08.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.326+0000 7fb438f8a640 1 -- 172.21.15.148:0/110693703 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb434063fc0 con 0x7fb4341035f0 2024-09-21T01:16:08.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.327+0000 7fb42bfff640 1 -- 172.21.15.148:0/110693703 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22837 (secure 0 0 0) 0x7fb41c0addd0 con 0x7fb4341035f0 2024-09-21T01:16:08.328 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:16:08.329 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":76,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:55.664651+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:16:08.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 -- 172.21.15.148:0/110693703 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4200b6510 msgr2=0x7fb4200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4200b6510 0x7fb4200b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb424031440 tx=0x7fb424005d50 comp rx=0 tx=0).stop 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 -- 172.21.15.148:0/110693703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4341035f0 msgr2=0x7fb434199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4341035f0 0x7fb434199480 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c890 tx=0x7fb41c00cd50 comp rx=0 tx=0).stop 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 -- 172.21.15.148:0/110693703 shutdown_connections 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb4200b6510 0x7fb4200b8a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb4341035f0 0x7fb434199480 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb434103f90 0x7fb43419a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 --2- 172.21.15.148:0/110693703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb434102570 0x7fb434198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 -- 172.21.15.148:0/110693703 >> 172.21.15.148:0/110693703 conn(0x7fb4340fdeb0 msgr2=0x7fb434106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 -- 172.21.15.148:0/110693703 shutdown_connections 2024-09-21T01:16:08.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.330+0000 7fb438f8a640 1 -- 172.21.15.148:0/110693703 wait complete. 2024-09-21T01:16:08.343 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T01:07:42.541158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T01:12:07.562738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T01:12:09.877690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T01:16:08.343 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T01:16:08.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.460+0000 7f3c79070640 1 -- 172.21.15.148:0/2234675049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c74103640 msgr2=0x7f3c74103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.460+0000 7f3c79070640 1 --2- 172.21.15.148:0/2234675049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c74103640 0x7f3c74103a50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009900 tx=0x7f3c5c02a410 comp rx=0 tx=0).stop 2024-09-21T01:16:08.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.460+0000 7f3c79070640 1 -- 172.21.15.148:0/2234675049 shutdown_connections 2024-09-21T01:16:08.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.460+0000 7f3c79070640 1 --2- 172.21.15.148:0/2234675049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c74103640 0x7f3c74103a50 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.460+0000 7f3c79070640 1 --2- 172.21.15.148:0/2234675049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c74103fe0 0x7f3c7410a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.460+0000 7f3c79070640 1 --2- 172.21.15.148:0/2234675049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c741025c0 0x7f3c74102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.460+0000 7f3c79070640 1 -- 172.21.15.148:0/2234675049 >> 172.21.15.148:0/2234675049 conn(0x7f3c740fdf00 msgr2=0x7f3c741003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:08.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.460+0000 7f3c79070640 1 -- 172.21.15.148:0/2234675049 shutdown_connections 2024-09-21T01:16:08.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.460+0000 7f3c79070640 1 -- 172.21.15.148:0/2234675049 wait complete. 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c79070640 1 Processor -- start 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c79070640 1 -- start start 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c79070640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c741025c0 0x7f3c7406bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c79070640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c74103640 0x7f3c741a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c79070640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c74103fe0 0x7f3c741a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c79070640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7410e240 con 0x7f3c74103fe0 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c79070640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7410e0c0 con 0x7f3c741025c0 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c79070640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7410e3c0 con 0x7f3c74103640 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c7359e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c74103fe0 0x7f3c741a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c7359e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c74103fe0 0x7f3c741a35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54988/0 (socket says 172.21.15.148:54988) 2024-09-21T01:16:08.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c7359e640 1 -- 172.21.15.148:0/1910478807 learned_addr learned my addr 172.21.15.148:0/1910478807 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.461+0000 7f3c72d9d640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c741025c0 0x7f3c7406bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c7259c640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c74103640 0x7f3c741a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c7359e640 1 -- 172.21.15.148:0/1910478807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c74103640 msgr2=0x7f3c741a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c7359e640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c74103640 0x7f3c741a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c7359e640 1 -- 172.21.15.148:0/1910478807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c741025c0 msgr2=0x7f3c7406bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c7359e640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c741025c0 0x7f3c7406bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c7359e640 1 -- 172.21.15.148:0/1910478807 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c741a3c00 con 0x7f3c74103fe0 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c7359e640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c74103fe0 0x7f3c741a35f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00eaa0 tx=0x7f3c6c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c6bfff640 1 -- 172.21.15.148:0/1910478807 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00cdb0 con 0x7f3c74103fe0 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c6bfff640 1 -- 172.21.15.148:0/1910478807 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c6c005020 con 0x7f3c74103fe0 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c79070640 1 -- 172.21.15.148:0/1910478807 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c741a3ef0 con 0x7f3c74103fe0 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c6bfff640 1 -- 172.21.15.148:0/1910478807 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0116d0 con 0x7f3c74103fe0 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.462+0000 7f3c79070640 1 -- 172.21.15.148:0/1910478807 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c741a4350 con 0x7f3c74103fe0 2024-09-21T01:16:08.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.463+0000 7f3c79070640 1 -- 172.21.15.148:0/1910478807 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c74109770 con 0x7f3c74103fe0 2024-09-21T01:16:08.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.465+0000 7f3c6bfff640 1 -- 172.21.15.148:0/1910478807 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f3c6c0051d0 con 0x7f3c74103fe0 2024-09-21T01:16:08.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.465+0000 7f3c6bfff640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3c600b6510 0x7f3c600b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.466+0000 7f3c6bfff640 1 -- 172.21.15.148:0/1910478807 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f3c6c0e79c0 con 0x7f3c74103fe0 2024-09-21T01:16:08.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.466+0000 7f3c72d9d640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3c600b6510 0x7f3c600b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.466+0000 7f3c72d9d640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3c600b6510 0x7f3c600b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3c64005fd0 tx=0x7f3c64005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:08.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.469+0000 7f3c6bfff640 1 -- 172.21.15.148:0/1910478807 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c6c016030 con 0x7f3c74103fe0 2024-09-21T01:16:08.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:08 smithi148 ceph-mon[31000]: pgmap v402: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 859 KiB/s wr, 12 op/s 2024-09-21T01:16:08.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:08 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/110693703' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:16:08.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.647+0000 7f3c79070640 1 -- 172.21.15.148:0/1910478807 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3c7402e7d0 con 0x7f3c74103fe0 2024-09-21T01:16:08.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.648+0000 7f3c6bfff640 1 -- 172.21.15.148:0/1910478807 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f3c6c0ae260 con 0x7f3c74103fe0 2024-09-21T01:16:08.649 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-09-21T01:16:08.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 -- 172.21.15.148:0/1910478807 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3c600b6510 msgr2=0x7f3c600b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3c600b6510 0x7f3c600b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3c64005fd0 tx=0x7f3c64005850 comp rx=0 tx=0).stop 2024-09-21T01:16:08.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 -- 172.21.15.148:0/1910478807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c74103fe0 msgr2=0x7f3c741a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c74103fe0 0x7f3c741a35f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00eaa0 tx=0x7f3c6c00ef60 comp rx=0 tx=0).stop 2024-09-21T01:16:08.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 -- 172.21.15.148:0/1910478807 shutdown_connections 2024-09-21T01:16:08.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f3c600b6510 0x7f3c600b8a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c74103fe0 0x7f3c741a35f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c74103640 0x7f3c741a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 --2- 172.21.15.148:0/1910478807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c741025c0 0x7f3c7406bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 -- 172.21.15.148:0/1910478807 >> 172.21.15.148:0/1910478807 conn(0x7f3c740fdf00 msgr2=0x7f3c74106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:08.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 -- 172.21.15.148:0/1910478807 shutdown_connections 2024-09-21T01:16:08.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.650+0000 7f3c79070640 1 -- 172.21.15.148:0/1910478807 wait complete. 2024-09-21T01:16:08.663 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T01:16:08.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:08 smithi181 ceph-mon[34811]: pgmap v402: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 859 KiB/s wr, 12 op/s 2024-09-21T01:16:08.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:08 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/110693703' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:16:08.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:08 smithi157 ceph-mon[34140]: pgmap v402: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 859 KiB/s wr, 12 op/s 2024-09-21T01:16:08.742 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:08 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/110693703' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:16:08.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 -- 172.21.15.148:0/3249143445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed801056c0 msgr2=0x7fed80107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 --2- 172.21.15.148:0/3249143445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed801056c0 0x7fed80107ba0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fed70009900 tx=0x7fed7002a410 comp rx=0 tx=0).stop 2024-09-21T01:16:08.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 -- 172.21.15.148:0/3249143445 shutdown_connections 2024-09-21T01:16:08.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 --2- 172.21.15.148:0/3249143445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed801056c0 0x7fed80107ba0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 --2- 172.21.15.148:0/3249143445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed801082e0 0x7fed8010a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 --2- 172.21.15.148:0/3249143445 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed80102c40 0x7fed80105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 -- 172.21.15.148:0/3249143445 >> 172.21.15.148:0/3249143445 conn(0x7fed800fd690 msgr2=0x7fed800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:08.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 -- 172.21.15.148:0/3249143445 shutdown_connections 2024-09-21T01:16:08.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 -- 172.21.15.148:0/3249143445 wait complete. 2024-09-21T01:16:08.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 Processor -- start 2024-09-21T01:16:08.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.777+0000 7fed884a9640 1 -- start start 2024-09-21T01:16:08.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed884a9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed80102c40 0x7fed80102100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed884a9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed801056c0 0x7fed8019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed884a9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed801082e0 0x7fed801a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed884a9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fed8010e1f0 con 0x7fed801056c0 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed884a9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fed8010e070 con 0x7fed80102c40 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed884a9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fed8010e370 con 0x7fed801082e0 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed85a44640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed801056c0 0x7fed8019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed85a44640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed801056c0 0x7fed8019ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55020/0 (socket says 172.21.15.148:55020) 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed85a44640 1 -- 172.21.15.148:0/2278591821 learned_addr learned my addr 172.21.15.148:0/2278591821 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed86a46640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed801082e0 0x7fed801a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed86245640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed80102c40 0x7fed80102100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed85a44640 1 -- 172.21.15.148:0/2278591821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed801082e0 msgr2=0x7fed801a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed85a44640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed801082e0 0x7fed801a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed85a44640 1 -- 172.21.15.148:0/2278591821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed80102c40 msgr2=0x7fed80102100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed85a44640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed80102c40 0x7fed80102100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed85a44640 1 -- 172.21.15.148:0/2278591821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed801a1970 con 0x7fed801056c0 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed86245640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed80102c40 0x7fed80102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed85a44640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed801056c0 0x7fed8019ec90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fed70006010 tx=0x7fed70004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.778+0000 7fed777fe640 1 -- 172.21.15.148:0/2278591821 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7003f030 con 0x7fed801056c0 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.779+0000 7fed777fe640 1 -- 172.21.15.148:0/2278591821 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed70003cb0 con 0x7fed801056c0 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.779+0000 7fed884a9640 1 -- 172.21.15.148:0/2278591821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed801a1c00 con 0x7fed801056c0 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.779+0000 7fed777fe640 1 -- 172.21.15.148:0/2278591821 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70035070 con 0x7fed801056c0 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.779+0000 7fed884a9640 1 -- 172.21.15.148:0/2278591821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed801a20f0 con 0x7fed801056c0 2024-09-21T01:16:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.780+0000 7fed884a9640 1 -- 172.21.15.148:0/2278591821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed800ff1b0 con 0x7fed801056c0 2024-09-21T01:16:08.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.781+0000 7fed777fe640 1 -- 172.21.15.148:0/2278591821 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7fed70042030 con 0x7fed801056c0 2024-09-21T01:16:08.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.782+0000 7fed777fe640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed6c0b6510 0x7fed6c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:08.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.782+0000 7fed86245640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed6c0b6510 0x7fed6c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:08.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.782+0000 7fed777fe640 1 -- 172.21.15.148:0/2278591821 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fed701079e0 con 0x7fed801056c0 2024-09-21T01:16:08.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.783+0000 7fed86245640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed6c0b6510 0x7fed6c0b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0058c0 tx=0x7fed7c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:08.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.786+0000 7fed777fe640 1 -- 172.21.15.148:0/2278591821 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed70003e60 con 0x7fed801056c0 2024-09-21T01:16:08.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.965+0000 7fed884a9640 1 -- 172.21.15.148:0/2278591821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fed8002e860 con 0x7fed801056c0 2024-09-21T01:16:08.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.965+0000 7fed777fe640 1 -- 172.21.15.148:0/2278591821 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) ==== 104+0+11 (secure 0 0 0) 0x7fed700ce280 con 0x7fed801056c0 2024-09-21T01:16:08.966 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-09-21T01:16:08.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 -- 172.21.15.148:0/2278591821 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed6c0b6510 msgr2=0x7fed6c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed6c0b6510 0x7fed6c0b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0058c0 tx=0x7fed7c005850 comp rx=0 tx=0).stop 2024-09-21T01:16:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 -- 172.21.15.148:0/2278591821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed801056c0 msgr2=0x7fed8019ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed801056c0 0x7fed8019ec90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fed70006010 tx=0x7fed70004340 comp rx=0 tx=0).stop 2024-09-21T01:16:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 -- 172.21.15.148:0/2278591821 shutdown_connections 2024-09-21T01:16:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fed6c0b6510 0x7fed6c0b8a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed801056c0 0x7fed8019ec90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fed801082e0 0x7fed801a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 --2- 172.21.15.148:0/2278591821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed80102c40 0x7fed80102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 -- 172.21.15.148:0/2278591821 >> 172.21.15.148:0/2278591821 conn(0x7fed800fd690 msgr2=0x7fed80103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.967+0000 7fed884a9640 1 -- 172.21.15.148:0/2278591821 shutdown_connections 2024-09-21T01:16:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:08.968+0000 7fed884a9640 1 -- 172.21.15.148:0/2278591821 wait complete. 2024-09-21T01:16:08.980 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T01:16:09.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.096+0000 7f8a32de6640 1 -- 172.21.15.148:0/1897322559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103fa0 msgr2=0x7f8a2c10a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:09.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.096+0000 7f8a32de6640 1 --2- 172.21.15.148:0/1897322559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103fa0 0x7f8a2c10a940 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009900 tx=0x7f8a1402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.096+0000 7f8a32de6640 1 -- 172.21.15.148:0/1897322559 shutdown_connections 2024-09-21T01:16:09.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.096+0000 7f8a32de6640 1 --2- 172.21.15.148:0/1897322559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103fa0 0x7f8a2c10a940 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.096+0000 7f8a32de6640 1 --2- 172.21.15.148:0/1897322559 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c103600 0x7f8a2c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.096+0000 7f8a32de6640 1 --2- 172.21.15.148:0/1897322559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c102580 0x7f8a2c1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.096+0000 7f8a32de6640 1 -- 172.21.15.148:0/1897322559 >> 172.21.15.148:0/1897322559 conn(0x7f8a2c0fdee0 msgr2=0x7f8a2c100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:09.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.096+0000 7f8a32de6640 1 -- 172.21.15.148:0/1897322559 shutdown_connections 2024-09-21T01:16:09.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.096+0000 7f8a32de6640 1 -- 172.21.15.148:0/1897322559 wait complete. 2024-09-21T01:16:09.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a32de6640 1 Processor -- start 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a32de6640 1 -- start start 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a32de6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c102580 0x7f8a2c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a32de6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103600 0x7f8a2c199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a32de6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c103fa0 0x7f8a2c199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a32de6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c10e1e0 con 0x7f8a2c103600 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a32de6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c10e060 con 0x7f8a2c102580 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a32de6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c10e360 con 0x7f8a2c103fa0 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103600 0x7f8a2c199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a2bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103600 0x7f8a2c199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55040/0 (socket says 172.21.15.148:55040) 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a2bfff640 1 -- 172.21.15.148:0/2602455299 learned_addr learned my addr 172.21.15.148:0/2602455299 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a31383640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c103fa0 0x7f8a2c199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a30b82640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c102580 0x7f8a2c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:09.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a2bfff640 1 -- 172.21.15.148:0/2602455299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c103fa0 msgr2=0x7f8a2c199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a2bfff640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c103fa0 0x7f8a2c199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a2bfff640 1 -- 172.21.15.148:0/2602455299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c102580 msgr2=0x7f8a2c198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a2bfff640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c102580 0x7f8a2c198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.097+0000 7f8a2bfff640 1 -- 172.21.15.148:0/2602455299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c19a750 con 0x7f8a2c103600 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.098+0000 7f8a2bfff640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103600 0x7f8a2c199410 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00cce0 tx=0x7f8a1c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.098+0000 7f8a29ffb640 1 -- 172.21.15.148:0/2602455299 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00f650 con 0x7f8a2c103600 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.098+0000 7f8a29ffb640 1 -- 172.21.15.148:0/2602455299 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a1c00fca0 con 0x7f8a2c103600 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.098+0000 7f8a32de6640 1 -- 172.21.15.148:0/2602455299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2c19aa40 con 0x7f8a2c103600 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.098+0000 7f8a29ffb640 1 -- 172.21.15.148:0/2602455299 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c018b40 con 0x7f8a2c103600 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.098+0000 7f8a32de6640 1 -- 172.21.15.148:0/2602455299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2c1a11c0 con 0x7f8a2c103600 2024-09-21T01:16:09.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.099+0000 7f8a32de6640 1 -- 172.21.15.148:0/2602455299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2c1029f0 con 0x7f8a2c103600 2024-09-21T01:16:09.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.101+0000 7f8a29ffb640 1 -- 172.21.15.148:0/2602455299 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f8a1c018d00 con 0x7f8a2c103600 2024-09-21T01:16:09.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.101+0000 7f8a29ffb640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b6510 0x7f8a180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:09.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.101+0000 7f8a30b82640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b6510 0x7f8a180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:09.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.101+0000 7f8a29ffb640 1 -- 172.21.15.148:0/2602455299 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f8a1c0e79d0 con 0x7f8a2c103600 2024-09-21T01:16:09.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.102+0000 7f8a30b82640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b6510 0x7f8a180b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8a24005fd0 tx=0x7f8a2400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:09.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.104+0000 7f8a29ffb640 1 -- 172.21.15.148:0/2602455299 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a1c014030 con 0x7f8a2c103600 2024-09-21T01:16:09.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.282+0000 7f8a32de6640 1 -- 172.21.15.148:0/2602455299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8a2c02e640 con 0x7f8a2c103600 2024-09-21T01:16:09.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.282+0000 7f8a29ffb640 1 -- 172.21.15.148:0/2602455299 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) ==== 100+0+11 (secure 0 0 0) 0x7f8a1c0ae300 con 0x7f8a2c103600 2024-09-21T01:16:09.283 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-09-21T01:16:09.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.284+0000 7f8a32de6640 1 -- 172.21.15.148:0/2602455299 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b6510 msgr2=0x7f8a180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:09.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.284+0000 7f8a32de6640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b6510 0x7f8a180b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8a24005fd0 tx=0x7f8a2400b390 comp rx=0 tx=0).stop 2024-09-21T01:16:09.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.284+0000 7f8a32de6640 1 -- 172.21.15.148:0/2602455299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103600 msgr2=0x7f8a2c199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.284+0000 7f8a32de6640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103600 0x7f8a2c199410 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00cce0 tx=0x7f8a1c00a620 comp rx=0 tx=0).stop 2024-09-21T01:16:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.284+0000 7f8a32de6640 1 -- 172.21.15.148:0/2602455299 shutdown_connections 2024-09-21T01:16:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.284+0000 7f8a32de6640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f8a180b6510 0x7f8a180b8a20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.284+0000 7f8a32de6640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2c103600 0x7f8a2c199410 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.284+0000 7f8a32de6640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a2c103fa0 0x7f8a2c199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.284+0000 7f8a32de6640 1 --2- 172.21.15.148:0/2602455299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a2c102580 0x7f8a2c198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.285+0000 7f8a32de6640 1 -- 172.21.15.148:0/2602455299 >> 172.21.15.148:0/2602455299 conn(0x7f8a2c0fdee0 msgr2=0x7f8a2c106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.285+0000 7f8a32de6640 1 -- 172.21.15.148:0/2602455299 shutdown_connections 2024-09-21T01:16:09.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.285+0000 7f8a32de6640 1 -- 172.21.15.148:0/2602455299 wait complete. 2024-09-21T01:16:09.297 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T01:16:09.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.413+0000 7f740164d640 1 -- 172.21.15.148:0/2581334165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73fc108ca0 msgr2=0x7f73fc10b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:09.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.413+0000 7f740164d640 1 --2- 172.21.15.148:0/2581334165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73fc108ca0 0x7f73fc10b0c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009900 tx=0x7f73e402a410 comp rx=0 tx=0).stop 2024-09-21T01:16:09.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.413+0000 7f740164d640 1 -- 172.21.15.148:0/2581334165 shutdown_connections 2024-09-21T01:16:09.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.413+0000 7f740164d640 1 --2- 172.21.15.148:0/2581334165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73fc108ca0 0x7f73fc10b0c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.413+0000 7f740164d640 1 --2- 172.21.15.148:0/2581334165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73fc10b600 0x7f73fc10db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.413+0000 7f740164d640 1 --2- 172.21.15.148:0/2581334165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73fc06c230 0x7f73fc108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.413+0000 7f740164d640 1 -- 172.21.15.148:0/2581334165 >> 172.21.15.148:0/2581334165 conn(0x7f73fc0fdf00 msgr2=0x7f73fc1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:09.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.413+0000 7f740164d640 1 -- 172.21.15.148:0/2581334165 shutdown_connections 2024-09-21T01:16:09.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.413+0000 7f740164d640 1 -- 172.21.15.148:0/2581334165 wait complete. 2024-09-21T01:16:09.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.413+0000 7f740164d640 1 Processor -- start 2024-09-21T01:16:09.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f740164d640 1 -- start start 2024-09-21T01:16:09.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f740164d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73fc06c230 0x7f73fc19c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:09.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f740164d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73fc108ca0 0x7f73fc19c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:09.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f740164d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73fc10b600 0x7f73fc19d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:09.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f740164d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1114f0 con 0x7f73fc06c230 2024-09-21T01:16:09.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f740164d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc111370 con 0x7f73fc108ca0 2024-09-21T01:16:09.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f740164d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc111670 con 0x7f73fc10b600 2024-09-21T01:16:09.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73faffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73fc06c230 0x7f73fc19c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:09.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73faffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73fc06c230 0x7f73fc19c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55050/0 (socket says 172.21.15.148:55050) 2024-09-21T01:16:09.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73faffd640 1 -- 172.21.15.148:0/4089324545 learned_addr learned my addr 172.21.15.148:0/4089324545 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73fa7fc640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73fc108ca0 0x7f73fc19c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73faffd640 1 -- 172.21.15.148:0/4089324545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73fc10b600 msgr2=0x7f73fc19d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73fb7fe640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73fc10b600 0x7f73fc19d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73faffd640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73fc10b600 0x7f73fc19d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73faffd640 1 -- 172.21.15.148:0/4089324545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73fc108ca0 msgr2=0x7f73fc19c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73faffd640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73fc108ca0 0x7f73fc19c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73faffd640 1 -- 172.21.15.148:0/4089324545 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc19dbe0 con 0x7f73fc06c230 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.414+0000 7f73fa7fc640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73fc108ca0 0x7f73fc19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.415+0000 7f73faffd640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73fc06c230 0x7f73fc19c1a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00db80 tx=0x7f73ec00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.415+0000 7f73f3fff640 1 -- 172.21.15.148:0/4089324545 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec017070 con 0x7f73fc06c230 2024-09-21T01:16:09.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.415+0000 7f73f3fff640 1 -- 172.21.15.148:0/4089324545 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73ec003b70 con 0x7f73fc06c230 2024-09-21T01:16:09.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.415+0000 7f740164d640 1 -- 172.21.15.148:0/4089324545 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc19ded0 con 0x7f73fc06c230 2024-09-21T01:16:09.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.415+0000 7f73f3fff640 1 -- 172.21.15.148:0/4089324545 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0106c0 con 0x7f73fc06c230 2024-09-21T01:16:09.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.415+0000 7f740164d640 1 -- 172.21.15.148:0/4089324545 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc1a45c0 con 0x7f73fc06c230 2024-09-21T01:16:09.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.416+0000 7f740164d640 1 -- 172.21.15.148:0/4089324545 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73fc0ffa20 con 0x7f73fc06c230 2024-09-21T01:16:09.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.417+0000 7f73f3fff640 1 -- 172.21.15.148:0/4089324545 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f73ec004020 con 0x7f73fc06c230 2024-09-21T01:16:09.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.418+0000 7f73f3fff640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f73e80b6510 0x7f73e80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:09.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.418+0000 7f73fa7fc640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f73e80b6510 0x7f73e80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:09.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.418+0000 7f73f3fff640 1 -- 172.21.15.148:0/4089324545 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f73ec0e7840 con 0x7f73fc06c230 2024-09-21T01:16:09.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.419+0000 7f73fa7fc640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f73e80b6510 0x7f73e80b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f73e4031440 tx=0x7f73e4005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:09.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.421+0000 7f73f3fff640 1 -- 172.21.15.148:0/4089324545 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73ec0ae0e0 con 0x7f73fc06c230 2024-09-21T01:16:09.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:09 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1910478807' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:16:09.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:09 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2278591821' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:16:09.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:09 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2602455299' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:16:09.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.653+0000 7f740164d640 1 -- 172.21.15.148:0/4089324545 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f73fc02e810 con 0x7f73fc06c230 2024-09-21T01:16:09.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.662+0000 7f73f3fff640 1 -- 172.21.15.148:0/4089324545 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v19) ==== 81+0+833530 (secure 0 0 0) 0x7f73ec0b24c0 con 0x7f73fc06c230 2024-09-21T01:16:09.671 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 19, 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: "active_gid": 14152, 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: "active_name": "x", 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: "active_addrs": { 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6800", 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 1101840134 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6801", 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 1101840134 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: "active_addr": "172.21.15.148:6801/1101840134", 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: "active_change": "2024-09-21T01:04:54.215901+0000", 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: "available": true, 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: "standbys": [ 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.673 INFO:teuthology.orchestra.run.smithi148.stdout: "gid": 24112, 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "z", 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr_features": 4540719139924082687, 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "available_modules": [ 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "alerts", 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.674 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.675 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.676 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.677 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.678 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.678 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.678 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.678 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.678 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.678 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.678 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.678 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.678 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.679 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.680 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_destination": { 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_destination", 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.681 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_from_name": { 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_from_name", 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "Ceph", 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email From: name", 2024-09-21T01:16:09.682 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_host": { 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_host", 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP server", 2024-09-21T01:16:09.683 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_password": { 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_password", 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Password to authenticate with", 2024-09-21T01:16:09.684 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_port": { 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_port", 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "465", 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP port", 2024-09-21T01:16:09.685 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_sender": { 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_sender", 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.686 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_ssl": { 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_ssl", 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.687 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_user": { 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_user", 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.688 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "User to authenticate as", 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "balancer", 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.690 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "active": { 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "active", 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_time": { 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_time", 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0000", 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_weekday": { 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_weekday", 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.693 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_max_iterations": { 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "25", 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "250", 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.694 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_metrics": { 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_metrics", 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.695 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_step": { 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_step", 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.5", 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0.001", 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "0.999", 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:16:09.696 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "end_time": { 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_time", 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2359", 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:16:09.697 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "end_weekday": { 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_weekday", 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:16:09.698 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.699 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.700 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.701 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.702 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.703 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "min_score": { 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_score", 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.704 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "upmap", 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.705 INFO:teuthology.orchestra.run.smithi148.stdout: "crush-compat", 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: "none", 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: "read", 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap", 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap-read" 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Balancer mode", 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.706 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_ids": { 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_ids", 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:16:09.708 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.709 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_deviation": { 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_deviation", 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:16:09.710 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_optimizations": { 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.711 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm", 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_down_multiplier": { 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_down_multiplier", 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.712 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_refresh_rate": { 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_refresh_rate", 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.713 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "20", 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_starting_port": { 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_starting_port", 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.714 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4721", 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_ptrace": { 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_ptrace", 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.715 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_interval": { 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_interval", 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.716 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.717 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.7", 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm_log_destination": { 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm_log_destination", 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.718 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "file", 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "file,syslog", 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "syslog" 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "cgroups_split": { 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cgroups_split", 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "config_checks_enabled": { 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_checks_enabled", 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.721 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "config_dashboard": { 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_dashboard", 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.722 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_alertmanager": { 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_alertmanager", 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.723 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_base": { 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_base", 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_elasticsearch": { 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "elasticsearch container image", 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.725 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_grafana": { 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_grafana", 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.726 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_haproxy": { 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_haproxy", 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "HAproxy container image", 2024-09-21T01:16:09.727 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_agent": { 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_collector": { 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:16:09.729 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_query": { 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.730 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger query container image", 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_keepalived": { 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_keepalived", 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.731 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Keepalived container image", 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_loki": { 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_loki", 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Loki container image", 2024-09-21T01:16:09.732 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_nginx": { 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_nginx", 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Nginx container image", 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_node_exporter": { 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_node_exporter", 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.734 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_nvmeof": { 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_nvmeof", 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Nvme-of container image", 2024-09-21T01:16:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:16:09.736 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_prometheus": { 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_prometheus", 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.737 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_promtail": { 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_promtail", 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.738 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Promtail container image", 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_samba": { 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_samba", 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.739 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_samba_metrics": { 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:16:09.740 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_snmp_gateway": { 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.741 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "container_init": { 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_init", 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.742 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "daemon_cache_timeout": { 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:09.743 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "900", 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.744 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "default_registry": { 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_registry", 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io", 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.745 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "device_cache_timeout": { 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_cache_timeout", 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1800", 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.746 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "device_enhanced_scan": { 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_enhanced_scan", 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.747 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "facts_cache_timeout": { 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "facts_cache_timeout", 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.748 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "grafana_dashboards_path": { 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.749 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "host_check_interval": { 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "host_check_interval", 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.750 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "hw_monitoring": { 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hw_monitoring", 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.751 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "inventory_list_all": { 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "inventory_list_all", 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.753 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.754 INFO:teuthology.orchestra.run.smithi148.stdout: "log_refresh_metadata": { 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_refresh_metadata", 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.755 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.756 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.757 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.758 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.759 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "*", 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.760 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "max_count_per_host": { 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_count_per_host", 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.761 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "max_osd_draining_count": { 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_osd_draining_count", 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.762 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "migration_current": { 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "migration_current", 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.763 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "internal - do not modify", 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "root", 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.764 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm-package", 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "root" 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "oob_default_addr": { 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "oob_default_addr", 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "169.254.1.1", 2024-09-21T01:16:09.765 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "prometheus_alerts_path": { 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.766 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_insecure": { 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_insecure", 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.767 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_password": { 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_password", 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.768 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_url": { 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_url", 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.769 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_username": { 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_username", 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.770 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "secure_monitoring_stack": { 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.771 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "service_discovery_port": { 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "service_discovery_port", 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8765", 2024-09-21T01:16:09.772 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.773 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_config_file": { 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_config_file", 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3", 2024-09-21T01:16:09.775 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_keepalive_interval": { 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7", 2024-09-21T01:16:09.776 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "use_agent": { 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_agent", 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.777 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "use_repo_digest": { 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_repo_digest", 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.778 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_failed_host_check": { 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.779 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_daemons": { 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.780 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_hosts": { 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.781 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crash", 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.782 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.783 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.785 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.786 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "retain_interval": { 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retain_interval", 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "31536000", 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_recent_interval": { 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_recent_interval", 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1209600", 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dashboard", 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.791 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.792 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.793 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.794 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.796 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.797 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.798 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.799 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.800 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.801 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.802 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.803 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.804 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.806 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_URL": { 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.807 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.808 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.809 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.810 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.811 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.812 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "[]", 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.813 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "{}", 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.814 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.815 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.816 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.817 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.818 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.819 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.820 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.821 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.822 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.824 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:16:09.825 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8", 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "45", 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.828 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.830 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.831 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:16:09.832 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.833 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:16:09.835 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "cross_origin_url": { 2024-09-21T01:16:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cross_origin_url", 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "crt_file": { 2024-09-21T01:16:09.837 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crt_file", 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "debug": { 2024-09-21T01:16:09.838 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "debug", 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.839 INFO:teuthology.orchestra.run.smithi148.stdout: "jwt_token_ttl": { 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "jwt_token_ttl", 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "28800", 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.840 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.841 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.842 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.843 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.844 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.846 INFO:teuthology.orchestra.run.smithi148.stdout: "motd": { 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "motd", 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "The message of the day", 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.847 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.848 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-21T01:16:09.849 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8080", 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.850 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-21T01:16:09.851 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl_server_port": { 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl_server_port", 2024-09-21T01:16:09.852 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8443", 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "sso_oauth2": { 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sso_oauth2", 2024-09-21T01:16:09.853 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-21T01:16:09.854 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "redirect", 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect" 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.855 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.856 INFO:teuthology.orchestra.run.smithi148.stdout: "url_prefix": { 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url_prefix", 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "devicehealth", 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_monitoring": { 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_monitoring", 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.858 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "monitor device health metrics", 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.859 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.860 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.861 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.862 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.863 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "mark_out_threshold": { 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mark_out_threshold", 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2419200", 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.864 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_name": { 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_name", 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "device_health_metrics", 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "retention_period": { 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retention_period", 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15552000", 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.866 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_frequency": { 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_frequency", 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "self_heal": { 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "self_heal", 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.869 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.870 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_threshold": { 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_threshold", 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7257600", 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "diskprediction_local", 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.872 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.874 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.875 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.876 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "predict_interval": { 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predict_interval", 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.877 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "predictor_model": { 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predictor_model", 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "prophetstor", 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.878 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.880 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "influx", 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": false, 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "batch_size": { 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "batch_size", 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5000", 2024-09-21T01:16:09.881 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "database": { 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "database", 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "ceph", 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.882 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": { 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hostname", 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.883 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "30", 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "5", 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.884 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.885 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.886 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.888 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.889 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "password": { 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "password", 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.890 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "port": { 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "port", 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8086", 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server port", 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.892 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "false", 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "threads": { 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threads", 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "32", 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "username": { 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "username", 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "verify_ssl": { 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "verify_ssl", 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "true", 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.896 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "insights", 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.897 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.898 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.899 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.900 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.901 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.902 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "iostat", 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.903 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.904 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.905 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.906 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.907 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.908 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "k8sevents", 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_event_retention_days": { 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7", 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "config_check_secs": { 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_check_secs", 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "10", 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.912 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.913 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.914 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.915 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.916 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "localpool", 2024-09-21T01:16:09.917 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "failure_domain": { 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "failure_domain", 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "host", 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:16:09.918 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.919 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.920 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.921 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.922 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "min_size": { 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_size", 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.924 INFO:teuthology.orchestra.run.smithi148.stdout: "num_rep": { 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "num_rep", 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3", 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_num": { 2024-09-21T01:16:09.925 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_num", 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "128", 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "prefix": { 2024-09-21T01:16:09.926 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prefix", 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.927 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "subtree": { 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "subtree", 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.928 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "rack", 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.929 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mds_autoscaler", 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.930 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.931 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.932 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.933 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.934 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.935 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirroring", 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.936 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.939 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.940 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.941 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "nfs", 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.942 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.943 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.944 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.945 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.947 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "fail_fs": { 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "fail_fs", 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:16:09.949 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.950 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.952 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.953 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.954 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator": { 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm", 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "rook", 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "test_orchestrator" 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.955 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Orchestrator backend", 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.956 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_perf_query", 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.957 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.958 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.959 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.960 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.961 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.962 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_support", 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.963 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.964 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.965 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.966 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.968 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_autoscaler", 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "threshold": { 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threshold", 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1.0", 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "scaling threshold", 2024-09-21T01:16:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "progress", 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_pg_recovery_event": { 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.983 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.984 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.985 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.985 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.985 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.985 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.985 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.985 INFO:teuthology.orchestra.run.smithi148.stdout: "max_completed_events": { 2024-09-21T01:16:09.985 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_completed_events", 2024-09-21T01:16:09.985 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.985 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "50", 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:09.986 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.987 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus", 2024-09-21T01:16:09.988 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "cache": { 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cache", 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.989 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "exclude_perf_counters": { 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "exclude_perf_counters", 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:16:09.990 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.992 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.993 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools": { 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools", 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:16:09.996 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "300", 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_interval": { 2024-09-21T01:16:09.997 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_interval", 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15.0", 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.998 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:09.999 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "9283", 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.000 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.001 INFO:teuthology.orchestra.run.smithi148.stdout: "stale_cache_strategy": { 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stale_cache_strategy", 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "log", 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "default", 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "default", 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "error" 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.004 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_support", 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.005 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.006 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.008 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_snap_create": { 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.010 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.011 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.012 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "trash_purge_schedule": { 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "trash_purge_schedule", 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.013 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "restful", 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.014 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_auth": { 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_auth", 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.015 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.016 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.017 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.018 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.019 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.020 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "max_requests": { 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_requests", 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.021 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.022 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.023 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.024 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rgw", 2024-09-21T01:16:10.025 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.026 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.028 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.029 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.030 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.031 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.032 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rook", 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.033 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.034 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.035 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.036 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.038 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "storage_class": { 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "storage_class", 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "local", 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "selftest", 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.041 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.042 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.043 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.044 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "roption1": { 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption1", 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.045 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "roption2": { 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption2", 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.046 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "xyz", 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption1": { 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption1", 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.047 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption2": { 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption2", 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.048 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption3": { 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption3", 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.049 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption4": { 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption4", 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.050 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption5": { 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption5", 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.051 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption6": { 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption6", 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.052 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption7": { 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption7", 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.053 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "42", 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.054 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "testkey": { 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testkey", 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.055 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "testlkey": { 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testlkey", 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.056 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "testnewline": { 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testnewline", 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.057 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smb", 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "internal_store_backend": { 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "internal_store_backend", 2024-09-21T01:16:10.058 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.059 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.060 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.061 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.062 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.063 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.064 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "update_orchestration": { 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "update_orchestration", 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.065 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snap_schedule", 2024-09-21T01:16:10.066 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_m_granularity": { 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_m_granularity", 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.067 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "dump_on_update": { 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dump_on_update", 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.068 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.069 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.070 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.071 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.072 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.073 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.074 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stats", 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.075 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.076 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.077 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.078 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.079 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.080 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "status", 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.081 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.082 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.083 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.084 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.085 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.086 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telegraf", 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "address": { 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "address", 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15", 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.089 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.090 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.091 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.092 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telemetry", 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_basic": { 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_basic", 2024-09-21T01:16:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_crash": { 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_crash", 2024-09-21T01:16:10.097 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_device": { 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_device", 2024-09-21T01:16:10.098 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_ident": { 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_ident", 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.099 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_perf": { 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_perf", 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.100 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "contact": { 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "contact", 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.101 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "description": { 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "description", 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.102 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "device_url": { 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_url", 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.103 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "24", 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "8", 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "last_opt_revision": { 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "last_opt_revision", 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1", 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard": { 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard", 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard_description": { 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard_description", 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "organization": { 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "organization", 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "proxy": { 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "proxy", 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "url": { 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url", 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "test_orchestrator", 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "volumes", 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_clones": { 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_clones", 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4", 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "periodic_async_work": { 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "periodic_async_work", 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Periodically check for async work", 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_delay": { 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix", 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "discovery_interval": { 2024-09-21T01:16:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "discovery_interval", 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "100", 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "identifier": { 2024-09-21T01:16:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "identifier", 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_host": { 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_host", 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_port": { 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_port", 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10051", 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_sender": { 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_sender", 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T01:16:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "gid": 24143, 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "y", 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr_features": 4540719139924082687, 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "available_modules": [ 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "alerts", 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_destination": { 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_destination", 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_from_name": { 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_from_name", 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "Ceph", 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email From: name", 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_host": { 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_host", 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP server", 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_password": { 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_password", 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Password to authenticate with", 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_port": { 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_port", 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "465", 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP port", 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_sender": { 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_sender", 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_ssl": { 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_ssl", 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_user": { 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_user", 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "User to authenticate as", 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "balancer", 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "active": { 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "active", 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_time": { 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_time", 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0000", 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_weekday": { 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_weekday", 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_max_iterations": { 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "25", 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "250", 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_metrics": { 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_metrics", 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_step": { 2024-09-21T01:16:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_step", 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.5", 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0.001", 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "0.999", 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "end_time": { 2024-09-21T01:16:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_time", 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2359", 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "end_weekday": { 2024-09-21T01:16:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_weekday", 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "min_score": { 2024-09-21T01:16:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_score", 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-21T01:16:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "upmap", 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "crush-compat", 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "none", 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "read", 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap", 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap-read" 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Balancer mode", 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_ids": { 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_ids", 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:16:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_deviation": { 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_deviation", 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:16:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_optimizations": { 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm", 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_down_multiplier": { 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_down_multiplier", 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_refresh_rate": { 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_refresh_rate", 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "20", 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_starting_port": { 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_starting_port", 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4721", 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_ptrace": { 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_ptrace", 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_interval": { 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_interval", 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.7", 2024-09-21T01:16:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm_log_destination": { 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm_log_destination", 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "file", 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "file,syslog", 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "syslog" 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "cgroups_split": { 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cgroups_split", 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "config_checks_enabled": { 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_checks_enabled", 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "config_dashboard": { 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_dashboard", 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.193 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_alertmanager": { 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_alertmanager", 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.194 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_base": { 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_base", 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.195 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_elasticsearch": { 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.196 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "elasticsearch container image", 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_grafana": { 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_grafana", 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.197 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_haproxy": { 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_haproxy", 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.198 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "HAproxy container image", 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_agent": { 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.199 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_collector": { 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.200 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_query": { 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger query container image", 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_keepalived": { 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_keepalived", 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.202 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Keepalived container image", 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_loki": { 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_loki", 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.203 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Loki container image", 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_nginx": { 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_nginx", 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.204 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Nginx container image", 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_node_exporter": { 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_node_exporter", 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.205 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_nvmeof": { 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_nvmeof", 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.206 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Nvme-of container image", 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:16:10.207 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_prometheus": { 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_prometheus", 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.208 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_promtail": { 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_promtail", 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.209 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Promtail container image", 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_samba": { 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_samba", 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.210 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_samba_metrics": { 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.211 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_snmp_gateway": { 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.212 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "container_init": { 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_init", 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "daemon_cache_timeout": { 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "900", 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.215 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "default_registry": { 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_registry", 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io", 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.216 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "device_cache_timeout": { 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_cache_timeout", 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1800", 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.217 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "device_enhanced_scan": { 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_enhanced_scan", 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.218 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "facts_cache_timeout": { 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "facts_cache_timeout", 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:16:10.219 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "grafana_dashboards_path": { 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.220 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "host_check_interval": { 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "host_check_interval", 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.221 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "hw_monitoring": { 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hw_monitoring", 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.222 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "inventory_list_all": { 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "inventory_list_all", 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.223 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.224 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "log_refresh_metadata": { 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_refresh_metadata", 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.225 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.226 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.227 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.228 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.229 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.230 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "*", 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "max_count_per_host": { 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_count_per_host", 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.231 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "max_osd_draining_count": { 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_osd_draining_count", 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.232 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "migration_current": { 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "migration_current", 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.233 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "internal - do not modify", 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.234 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "root", 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm-package", 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "root" 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "oob_default_addr": { 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "oob_default_addr", 2024-09-21T01:16:10.235 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "169.254.1.1", 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "prometheus_alerts_path": { 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.236 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_insecure": { 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_insecure", 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.237 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_password": { 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_password", 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.238 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_url": { 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_url", 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.239 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_username": { 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_username", 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.240 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "secure_monitoring_stack": { 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.241 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "service_discovery_port": { 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "service_discovery_port", 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8765", 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.242 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.243 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_config_file": { 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_config_file", 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.244 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3", 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.245 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_keepalive_interval": { 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7", 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.246 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "use_agent": { 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_agent", 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.247 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "use_repo_digest": { 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_repo_digest", 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.248 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_failed_host_check": { 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.249 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_daemons": { 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.250 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_hosts": { 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.251 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crash", 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.252 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.253 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.254 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.255 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.256 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "retain_interval": { 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retain_interval", 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.257 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "31536000", 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.258 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_recent_interval": { 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_recent_interval", 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.259 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1209600", 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dashboard", 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.260 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.263 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.264 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:16:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:16:10.266 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:16:10.267 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.268 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.269 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.270 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.271 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.272 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.273 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.274 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.275 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_URL": { 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.276 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.277 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.278 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.279 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.280 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.281 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "[]", 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.282 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "{}", 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.283 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.284 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.285 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.286 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.287 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.290 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.293 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:16:10.294 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.295 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8", 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.296 INFO:teuthology.orchestra.run.smithi148.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "45", 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:16:10.297 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:16:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:16:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:16:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:16:10.302 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:16:10.303 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:16:10.304 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "cross_origin_url": { 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cross_origin_url", 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.305 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "crt_file": { 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crt_file", 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.306 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "debug": { 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "debug", 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.307 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "jwt_token_ttl": { 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "jwt_token_ttl", 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.308 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "28800", 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.309 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.310 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.312 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.313 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.314 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "motd": { 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "motd", 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.315 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "The message of the day", 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.316 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.317 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8080", 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.318 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.319 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.320 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl_server_port": { 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl_server_port", 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8443", 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.321 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: "sso_oauth2": { 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sso_oauth2", 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.322 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "redirect", 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.323 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect" 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.324 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "url_prefix": { 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url_prefix", 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.325 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "devicehealth", 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.326 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_monitoring": { 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_monitoring", 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "monitor device health metrics", 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.328 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.329 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.330 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.331 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "mark_out_threshold": { 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mark_out_threshold", 2024-09-21T01:16:10.332 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2419200", 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_name": { 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_name", 2024-09-21T01:16:10.333 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "device_health_metrics", 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "retention_period": { 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retention_period", 2024-09-21T01:16:10.334 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15552000", 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_frequency": { 2024-09-21T01:16:10.335 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_frequency", 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "self_heal": { 2024-09-21T01:16:10.336 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "self_heal", 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:10.337 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.338 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_threshold": { 2024-09-21T01:16:10.339 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_threshold", 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7257600", 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "diskprediction_local", 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.342 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.343 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.344 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.345 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "predict_interval": { 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predict_interval", 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.346 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "predictor_model": { 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predictor_model", 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "prophetstor", 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.347 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.348 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.349 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "influx", 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": false, 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: "batch_size": { 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "batch_size", 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.350 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5000", 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "database": { 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "database", 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.351 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "ceph", 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": { 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hostname", 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.352 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.353 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "30", 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "5", 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.354 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.355 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.356 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.357 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.358 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "password": { 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "password", 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.359 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "port": { 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "port", 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8086", 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.360 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server port", 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.361 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "false", 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.362 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "threads": { 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threads", 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:10.363 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "32", 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "username": { 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "username", 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.364 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "verify_ssl": { 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "verify_ssl", 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "true", 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.365 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "insights", 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.366 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.367 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.368 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.369 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.370 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.372 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "iostat", 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.373 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.374 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.376 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.377 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.378 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "k8sevents", 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.379 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_event_retention_days": { 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7", 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.380 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "config_check_secs": { 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_check_secs", 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "10", 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.382 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.383 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.384 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.385 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.386 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "localpool", 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "failure_domain": { 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "failure_domain", 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "host", 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.388 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.389 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.390 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.392 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.393 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "min_size": { 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_size", 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:16:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "num_rep": { 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "num_rep", 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3", 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_num": { 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_num", 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "128", 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.396 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "prefix": { 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prefix", 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "subtree": { 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "subtree", 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "rack", 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.399 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mds_autoscaler", 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.402 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.403 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.404 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.405 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirroring", 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.406 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.407 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.408 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.409 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.411 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "nfs", 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.412 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.413 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.414 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.415 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.417 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.418 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "fail_fs": { 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "fail_fs", 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.419 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.420 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.422 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.423 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.424 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator": { 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm", 2024-09-21T01:16:10.425 INFO:teuthology.orchestra.run.smithi148.stdout: "rook", 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "test_orchestrator" 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Orchestrator backend", 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.426 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_perf_query", 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.427 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.428 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.429 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.430 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.431 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.432 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.433 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_support", 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.434 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.435 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.436 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.437 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.438 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.439 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_autoscaler", 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.440 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.441 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.442 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.443 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.444 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.445 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.446 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "threshold": { 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threshold", 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.447 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1.0", 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "scaling threshold", 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "progress", 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.448 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_pg_recovery_event": { 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.451 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.452 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.453 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.454 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "max_completed_events": { 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_completed_events", 2024-09-21T01:16:10.455 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "50", 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:10.456 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.457 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus", 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "cache": { 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cache", 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.459 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "exclude_perf_counters": { 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "exclude_perf_counters", 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:16:10.460 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.461 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.462 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.463 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools": { 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools", 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "300", 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.467 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_interval": { 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_interval", 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15.0", 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-21T01:16:10.468 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.469 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "9283", 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.470 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.471 INFO:teuthology.orchestra.run.smithi148.stdout: "stale_cache_strategy": { 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stale_cache_strategy", 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "log", 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-21T01:16:10.472 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "default", 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "default", 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "error" 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.473 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.474 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_support", 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.475 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.477 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.478 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.479 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_snap_create": { 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.480 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.481 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.482 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "trash_purge_schedule": { 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "trash_purge_schedule", 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.483 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.484 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.484 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.484 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.484 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.484 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.485 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "restful", 2024-09-21T01:16:10.485 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.485 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.485 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.485 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_auth": { 2024-09-21T01:16:10.485 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_auth", 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.486 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.487 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.488 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.489 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.490 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.491 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "max_requests": { 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_requests", 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.492 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.493 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.494 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.495 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rgw", 2024-09-21T01:16:10.496 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.497 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.498 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.499 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.500 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.503 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rook", 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.504 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.505 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.506 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.507 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.508 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.509 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "storage_class": { 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "storage_class", 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "local", 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.510 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "selftest", 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.511 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.512 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.513 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.514 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "roption1": { 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption1", 2024-09-21T01:16:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "roption2": { 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption2", 2024-09-21T01:16:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "xyz", 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption1": { 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption1", 2024-09-21T01:16:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption2": { 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption2", 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption3": { 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption3", 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption4": { 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption4", 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption5": { 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption5", 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption6": { 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption6", 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption7": { 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption7", 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "42", 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "testkey": { 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testkey", 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "testlkey": { 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testlkey", 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "testnewline": { 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testnewline", 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smb", 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "internal_store_backend": { 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "internal_store_backend", 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "update_orchestration": { 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "update_orchestration", 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snap_schedule", 2024-09-21T01:16:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_m_granularity": { 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_m_granularity", 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "dump_on_update": { 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dump_on_update", 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stats", 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "status", 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telegraf", 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "address": { 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "address", 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15", 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telemetry", 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_basic": { 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_basic", 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_crash": { 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_crash", 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_device": { 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_device", 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_ident": { 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_ident", 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_perf": { 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_perf", 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "contact": { 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "contact", 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "description": { 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "description", 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "device_url": { 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_url", 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "24", 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "8", 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "last_opt_revision": { 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "last_opt_revision", 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1", 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard": { 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard", 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard_description": { 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard_description", 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.581 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "organization": { 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "organization", 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "proxy": { 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "proxy", 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "url": { 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url", 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "test_orchestrator", 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "volumes", 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_clones": { 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_clones", 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4", 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "periodic_async_work": { 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "periodic_async_work", 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Periodically check for async work", 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_delay": { 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix", 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "discovery_interval": { 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "discovery_interval", 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "100", 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "identifier": { 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "identifier", 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_host": { 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_host", 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_port": { 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_port", 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10051", 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_sender": { 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_sender", 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T01:16:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "modules": [ 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm", 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "dashboard", 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "iostat", 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "nfs", 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "restful" 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "available_modules": [ 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "alerts", 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_destination": { 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_destination", 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_from_name": { 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_from_name", 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "Ceph", 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email From: name", 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_host": { 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_host", 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP server", 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_password": { 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_password", 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Password to authenticate with", 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_port": { 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_port", 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "465", 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP port", 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_sender": { 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_sender", 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_ssl": { 2024-09-21T01:16:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_ssl", 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_user": { 2024-09-21T01:16:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_user", 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "User to authenticate as", 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "balancer", 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "active": { 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "active", 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_time": { 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_time", 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0000", 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_weekday": { 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_weekday", 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_max_iterations": { 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "25", 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "250", 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_metrics": { 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_metrics", 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_step": { 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_step", 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.5", 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0.001", 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "0.999", 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:16:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "end_time": { 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_time", 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2359", 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:16:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "end_weekday": { 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_weekday", 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:16:10.642 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.643 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.644 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.645 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.646 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "min_score": { 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_score", 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.648 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "upmap", 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "crush-compat", 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "none", 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "read", 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap", 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap-read" 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.649 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Balancer mode", 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_ids": { 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_ids", 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.650 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.651 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.652 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_deviation": { 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_deviation", 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:16:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_optimizations": { 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:16:10.654 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm", 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_down_multiplier": { 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_down_multiplier", 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.655 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_refresh_rate": { 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_refresh_rate", 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.656 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "20", 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_starting_port": { 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_starting_port", 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.657 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4721", 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_ptrace": { 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_ptrace", 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.658 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_interval": { 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_interval", 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.659 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.7", 2024-09-21T01:16:10.660 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm_log_destination": { 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm_log_destination", 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.661 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "file", 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "file,syslog", 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "syslog" 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "cgroups_split": { 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cgroups_split", 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.662 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "config_checks_enabled": { 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_checks_enabled", 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.663 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "config_dashboard": { 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_dashboard", 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.664 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_alertmanager": { 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_alertmanager", 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.665 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_base": { 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_base", 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.666 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_elasticsearch": { 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.667 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "elasticsearch container image", 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_grafana": { 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_grafana", 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.668 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_haproxy": { 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_haproxy", 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.669 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "HAproxy container image", 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_agent": { 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.670 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_collector": { 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.671 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_query": { 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.672 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger query container image", 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_keepalived": { 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_keepalived", 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.673 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Keepalived container image", 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_loki": { 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_loki", 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.674 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Loki container image", 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_nginx": { 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_nginx", 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.675 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Nginx container image", 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_node_exporter": { 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_node_exporter", 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:16:10.676 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_nvmeof": { 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_nvmeof", 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:16:10.677 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Nvme-of container image", 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.678 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_prometheus": { 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_prometheus", 2024-09-21T01:16:10.679 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_promtail": { 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_promtail", 2024-09-21T01:16:10.680 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Promtail container image", 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_samba": { 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_samba", 2024-09-21T01:16:10.681 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_samba_metrics": { 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:16:10.682 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_snmp_gateway": { 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:16:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "container_init": { 2024-09-21T01:16:10.684 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_init", 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "daemon_cache_timeout": { 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:16:10.685 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:16:10.686 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "900", 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "default_registry": { 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_registry", 2024-09-21T01:16:10.687 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io", 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "device_cache_timeout": { 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_cache_timeout", 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.688 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1800", 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "device_enhanced_scan": { 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_enhanced_scan", 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.689 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "facts_cache_timeout": { 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "facts_cache_timeout", 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.690 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "grafana_dashboards_path": { 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.691 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "host_check_interval": { 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "host_check_interval", 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:10.692 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "hw_monitoring": { 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hw_monitoring", 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.693 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "inventory_list_all": { 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "inventory_list_all", 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.694 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.695 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.696 INFO:teuthology.orchestra.run.smithi148.stdout: "log_refresh_metadata": { 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_refresh_metadata", 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.697 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.698 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.699 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.700 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:16:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "*", 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:16:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "max_count_per_host": { 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_count_per_host", 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:16:10.703 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "max_osd_draining_count": { 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_osd_draining_count", 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:16:10.704 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "migration_current": { 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "migration_current", 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "internal - do not modify", 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.705 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "root", 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm-package", 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: "root" 2024-09-21T01:16:10.706 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "oob_default_addr": { 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "oob_default_addr", 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "169.254.1.1", 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.707 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "prometheus_alerts_path": { 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.708 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_insecure": { 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_insecure", 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.709 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_password": { 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_password", 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.710 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_url": { 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_url", 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_username": { 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_username", 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:16:10.712 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "secure_monitoring_stack": { 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:16:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "service_discovery_port": { 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "service_discovery_port", 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8765", 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:16:10.714 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.715 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_config_file": { 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_config_file", 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.716 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3", 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.717 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_keepalive_interval": { 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7", 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.718 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "use_agent": { 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_agent", 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "use_repo_digest": { 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_repo_digest", 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_failed_host_check": { 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.721 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_daemons": { 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_hosts": { 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.723 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crash", 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.724 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.725 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.726 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.727 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.728 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "retain_interval": { 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retain_interval", 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "31536000", 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:16:10.729 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.730 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_recent_interval": { 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_recent_interval", 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1209600", 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dashboard", 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.732 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.733 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.734 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.735 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.736 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.737 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.738 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.739 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.740 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.741 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.742 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.743 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.744 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.745 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.747 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_URL": { 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.748 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.749 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.750 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.751 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.752 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.753 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "[]", 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.754 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "{}", 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.755 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.756 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.757 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.758 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.763 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:16:10.764 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:16:10.765 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:16:10.766 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:16:10.767 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8", 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.768 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "45", 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.770 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.771 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.772 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.773 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.775 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.776 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "cross_origin_url": { 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cross_origin_url", 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.777 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "crt_file": { 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crt_file", 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.778 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "debug": { 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "debug", 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.779 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "jwt_token_ttl": { 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "jwt_token_ttl", 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "28800", 2024-09-21T01:16:10.780 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.781 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.782 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.783 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.784 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.785 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.786 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "motd": { 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "motd", 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "The message of the day", 2024-09-21T01:16:10.787 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.788 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.789 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8080", 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.791 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.792 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl_server_port": { 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl_server_port", 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8443", 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.793 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "sso_oauth2": { 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sso_oauth2", 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.794 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "redirect", 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect" 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.795 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.796 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "url_prefix": { 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url_prefix", 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.797 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "devicehealth", 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_monitoring": { 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_monitoring", 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.798 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "monitor device health metrics", 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.799 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.802 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.803 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "mark_out_threshold": { 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mark_out_threshold", 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2419200", 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.804 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_name": { 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_name", 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "device_health_metrics", 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.805 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "retention_period": { 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retention_period", 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15552000", 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.806 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_frequency": { 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_frequency", 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.807 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "self_heal": { 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "self_heal", 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.809 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.810 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_threshold": { 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_threshold", 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7257600", 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.811 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "diskprediction_local", 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.812 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.813 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.814 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.815 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.816 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "predict_interval": { 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predict_interval", 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "predictor_model": { 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predictor_model", 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.818 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "prophetstor", 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "influx", 2024-09-21T01:16:10.821 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": false, 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "batch_size": { 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "batch_size", 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5000", 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.822 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "database": { 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "database", 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "ceph", 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:16:10.823 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": { 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hostname", 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.824 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "30", 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "5", 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.825 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.826 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.827 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.828 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "password": { 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "password", 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.831 INFO:teuthology.orchestra.run.smithi148.stdout: "port": { 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "port", 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8086", 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server port", 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.832 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-21T01:16:10.833 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "false", 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "threads": { 2024-09-21T01:16:10.834 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threads", 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "32", 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "username": { 2024-09-21T01:16:10.835 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "username", 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "verify_ssl": { 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "verify_ssl", 2024-09-21T01:16:10.836 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "true", 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "insights", 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.838 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.839 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.840 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.841 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.842 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.843 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "iostat", 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.844 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.847 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.848 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.849 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "k8sevents", 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_event_retention_days": { 2024-09-21T01:16:10.850 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7", 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "config_check_secs": { 2024-09-21T01:16:10.851 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_check_secs", 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "10", 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.852 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.853 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.854 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.855 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.857 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "localpool", 2024-09-21T01:16:10.858 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "failure_domain": { 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "failure_domain", 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "host", 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.859 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.860 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.861 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.862 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.863 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.864 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.864 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.864 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.864 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.864 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.864 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.864 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.864 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.864 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.865 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.865 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.865 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.865 INFO:teuthology.orchestra.run.smithi148.stdout: "min_size": { 2024-09-21T01:16:10.865 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_size", 2024-09-21T01:16:10.865 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.865 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.865 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.865 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "num_rep": { 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "num_rep", 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.866 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3", 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_num": { 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_num", 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.867 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "128", 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "prefix": { 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prefix", 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.868 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.869 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "subtree": { 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "subtree", 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "rack", 2024-09-21T01:16:10.870 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mds_autoscaler", 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.871 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.872 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.873 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.874 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.875 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirroring", 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.878 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.879 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.880 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.881 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.882 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.883 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "nfs", 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.884 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.885 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.886 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.887 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.888 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.889 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: "fail_fs": { 2024-09-21T01:16:10.890 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "fail_fs", 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.891 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.892 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.893 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.895 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator": { 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.896 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm", 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "rook", 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "test_orchestrator" 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Orchestrator backend", 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.897 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.898 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_perf_query", 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.899 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.900 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.901 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.902 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.903 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.904 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_support", 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.905 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.906 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.907 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.908 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.909 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.910 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_autoscaler", 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.911 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.912 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.914 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.915 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.916 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.917 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "threshold": { 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threshold", 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1.0", 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.918 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "scaling threshold", 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "progress", 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_pg_recovery_event": { 2024-09-21T01:16:10.919 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-21T01:16:10.920 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.921 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.922 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.923 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.924 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.925 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "max_completed_events": { 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_completed_events", 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.926 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "50", 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.927 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.928 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus", 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.929 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "cache": { 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cache", 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.930 INFO:teuthology.orchestra.run.smithi148.stdout: "exclude_perf_counters": { 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "exclude_perf_counters", 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.931 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.932 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools": { 2024-09-21T01:16:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools", 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:16:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "300", 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_interval": { 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_interval", 2024-09-21T01:16:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15.0", 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.939 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.940 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "9283", 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.941 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "stale_cache_strategy": { 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stale_cache_strategy", 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.942 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "log", 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.943 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "default", 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "default", 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "error" 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-21T01:16:10.944 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.945 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_support", 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.946 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.947 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.948 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.949 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.950 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_snap_create": { 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.951 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.952 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "trash_purge_schedule": { 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "trash_purge_schedule", 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.954 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "restful", 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_auth": { 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_auth", 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "max_requests": { 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_requests", 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-21T01:16:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rgw", 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rook", 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "storage_class": { 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "storage_class", 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "local", 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "selftest", 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "roption1": { 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption1", 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "roption2": { 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption2", 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "xyz", 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption1": { 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption1", 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption2": { 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption2", 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption3": { 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption3", 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.990 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption4": { 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption4", 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.991 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption5": { 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption5", 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.992 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption6": { 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption6", 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.993 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption7": { 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption7", 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "42", 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.994 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.995 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "testkey": { 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testkey", 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.996 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "testlkey": { 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testlkey", 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.997 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "testnewline": { 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testnewline", 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:10.998 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smb", 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: "internal_store_backend": { 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "internal_store_backend", 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:10.999 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.000 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.003 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.005 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "update_orchestration": { 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "update_orchestration", 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.006 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snap_schedule", 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:11.007 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_m_granularity": { 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_m_granularity", 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "dump_on_update": { 2024-09-21T01:16:11.008 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dump_on_update", 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:11.009 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.010 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.011 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.012 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:11.013 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:11.014 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stats", 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.016 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.017 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.018 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.019 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.020 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.021 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "status", 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.022 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.024 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.026 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.027 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telegraf", 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: "address": { 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "address", 2024-09-21T01:16:11.028 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.029 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15", 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.030 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.031 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.032 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.033 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.034 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:11.035 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telemetry", 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:11.036 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_basic": { 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_basic", 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_crash": { 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_crash", 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.038 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_device": { 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_device", 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.039 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_ident": { 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_ident", 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_perf": { 2024-09-21T01:16:11.040 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_perf", 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "contact": { 2024-09-21T01:16:11.041 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "contact", 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "description": { 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "description", 2024-09-21T01:16:11.042 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "device_url": { 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_url", 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.043 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.044 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.045 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "24", 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "8", 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "last_opt_revision": { 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "last_opt_revision", 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.046 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1", 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard": { 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard", 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.047 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard_description": { 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard_description", 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.048 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.049 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.052 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.053 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "organization": { 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "organization", 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.054 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "proxy": { 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "proxy", 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.055 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.056 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "url": { 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url", 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.057 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "test_orchestrator", 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.058 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.059 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.060 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.061 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.062 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.064 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "volumes", 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.065 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.066 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.067 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.068 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.069 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_clones": { 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_clones", 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4", 2024-09-21T01:16:11.070 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "periodic_async_work": { 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "periodic_async_work", 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.071 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Periodically check for async work", 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_delay": { 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.072 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.073 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.074 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix", 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: "discovery_interval": { 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "discovery_interval", 2024-09-21T01:16:11.075 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "100", 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "identifier": { 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "identifier", 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.076 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.077 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.078 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.079 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.080 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-21T01:16:11.081 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.082 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "sqlite3_killpoint": { 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "dev", 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-21T01:16:11.083 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_host": { 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_host", 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-21T01:16:11.084 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_port": { 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_port", 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10051", 2024-09-21T01:16:11.085 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_sender": { 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_sender", 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:16:11.086 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: "services": { 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: "dashboard": "https://172.21.15.148:8443/" 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: "always_on_modules": { 2024-09-21T01:16:11.087 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus": [ 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "balancer", 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "devicehealth", 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator", 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_autoscaler", 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "progress", 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_support", 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "status", 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "telemetry", 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "volumes" 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific": [ 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "balancer", 2024-09-21T01:16:11.088 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "devicehealth", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_autoscaler", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "progress", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_support", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "status", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "telemetry", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "volumes" 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy": [ 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "balancer", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "devicehealth", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator", 2024-09-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_autoscaler", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "progress", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_support", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "status", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "telemetry", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "volumes" 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "reef": [ 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "balancer", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "devicehealth", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_autoscaler", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "progress", 2024-09-21T01:16:11.090 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_support", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "status", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "telemetry", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "volumes" 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "squid": [ 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "balancer", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "devicehealth", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_autoscaler", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "progress", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_support", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "status", 2024-09-21T01:16:11.091 INFO:teuthology.orchestra.run.smithi148.stdout: "telemetry", 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: "volumes" 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: "last_failure_osd_epoch": 3, 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: "active_clients": [ 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "devicehealth", 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 930323899 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T01:16:11.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "libcephsqlite", 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 1645736268 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_support", 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.093 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 3923660309 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "volumes", 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 3888291474 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.094 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T01:16:11.095 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:11.095 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T01:16:11.095 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:16:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.667+0000 7f740164d640 1 -- 172.21.15.148:0/4089324545 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f73e80b6510 msgr2=0x7f73e80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.667+0000 7f740164d640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f73e80b6510 0x7f73e80b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f73e4031440 tx=0x7f73e4005d50 comp rx=0 tx=0).stop 2024-09-21T01:16:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.667+0000 7f740164d640 1 -- 172.21.15.148:0/4089324545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73fc06c230 msgr2=0x7f73fc19c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.667+0000 7f740164d640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73fc06c230 0x7f73fc19c1a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00db80 tx=0x7f73ec00b630 comp rx=0 tx=0).stop 2024-09-21T01:16:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.667+0000 7f740164d640 1 -- 172.21.15.148:0/4089324545 shutdown_connections 2024-09-21T01:16:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.667+0000 7f740164d640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f73e80b6510 0x7f73e80b8a20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.667+0000 7f740164d640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73fc10b600 0x7f73fc19d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.667+0000 7f740164d640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73fc108ca0 0x7f73fc19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.667+0000 7f740164d640 1 --2- 172.21.15.148:0/4089324545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73fc06c230 0x7f73fc19c1a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.667+0000 7f740164d640 1 -- 172.21.15.148:0/4089324545 >> 172.21.15.148:0/4089324545 conn(0x7f73fc0fdf00 msgr2=0x7f73fc109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.668+0000 7f740164d640 1 -- 172.21.15.148:0/4089324545 shutdown_connections 2024-09-21T01:16:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:09.668+0000 7f740164d640 1 -- 172.21.15.148:0/4089324545 wait complete. 2024-09-21T01:16:11.138 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T01:16:11.138 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T01:16:11.139 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:10 smithi148 ceph-mon[31000]: pgmap v403: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2024-09-21T01:16:11.139 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:10 smithi148 ceph-mon[31000]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:16:11.139 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:10 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/4089324545' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:09 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1910478807' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:09 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2278591821' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:09 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2602455299' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:10 smithi157 ceph-mon[34140]: pgmap v403: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:10 smithi157 ceph-mon[34140]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:10 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/4089324545' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:09 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1910478807' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:09 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2278591821' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:09 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2602455299' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:10 smithi181 ceph-mon[34811]: pgmap v403: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2024-09-21T01:16:11.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:10 smithi181 ceph-mon[34811]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T01:16:11.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:10 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/4089324545' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:16:11.415 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:12.014 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:16:12.014 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:12.014 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 4, 2024-09-21T01:16:12.014 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 4, 2024-09-21T01:16:12.014 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 2992, 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 448, 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 4, 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 0, 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.003177039, 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.000042697, 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002188673, 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3, 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.004027124, 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001342374 2024-09-21T01:16:12.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 1, 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 54, 2024-09-21T01:16:12.016 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 89744, 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 3, 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 2, 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.006021249, 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.003998941, 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.001503476, 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 52, 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.002097649, 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000040339 2024-09-21T01:16:12.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 89744 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 76, 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 72, 2024-09-21T01:16:12.018 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 641680, 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 43072, 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 2, 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 1, 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.013825605, 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.005363678, 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.013162381, 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 71, 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.003459141, 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000048720 2024-09-21T01:16:12.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 641680, 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 43072 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 0, 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-21T01:16:12.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:12.021 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 148823, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 27, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-21T01:16:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 968, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 2, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 77, 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 630974, 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 77, 2024-09-21T01:16:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T01:16:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T01:16:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 77, 2024-09-21T01:16:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 630974, 2024-09-21T01:16:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T01:16:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:12.027 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:12.027 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:16:12.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:12 smithi148 ceph-mon[31000]: pgmap v404: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 687 KiB/s wr, 9 op/s 2024-09-21T01:16:12.691 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T01:16:12.691 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T01:16:12.691 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T01:16:12.691 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T01:16:12.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:12 smithi181 ceph-mon[34811]: pgmap v404: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 687 KiB/s wr, 9 op/s 2024-09-21T01:16:12.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:12 smithi157 ceph-mon[34140]: pgmap v404: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 687 KiB/s wr, 9 op/s 2024-09-21T01:16:12.939 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:13.472 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 81, 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 77, 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 643040, 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 46272, 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 4, 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 0, 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.017409169, 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.005809957, 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.017521035, 2024-09-21T01:16:13.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 76, 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.003904581, 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000051376 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 643040, 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 46272 2024-09-21T01:16:13.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 1, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 58, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 90448, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 3, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 2, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.006440817, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.004521867, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.001326793, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:13.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 56, 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.002666551, 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000047616 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 90448 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:13.476 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 4, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 4, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 2992, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 448, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 2, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 1, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.002208182, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.000046426, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002163778, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.003872171, 2024-09-21T01:16:13.477 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001290723 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 0, 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.478 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:13.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:13.480 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 148863, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 28, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-21T01:16:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 968, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 2, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:13.482 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 82, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 631624, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 82, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T01:16:13.483 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 82, 2024-09-21T01:16:13.484 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 631624, 2024-09-21T01:16:13.484 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T01:16:13.484 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:13.484 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:13.484 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:13.484 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:13.484 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:13.484 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:16:14.131 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T01:16:14.132 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T01:16:14.132 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T01:16:14.132 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T01:16:14.378 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:14.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:14 smithi148 ceph-mon[31000]: pgmap v405: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 1.7 MiB/s wr, 14 op/s 2024-09-21T01:16:14.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:14 smithi181 ceph-mon[34811]: pgmap v405: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 1.7 MiB/s wr, 14 op/s 2024-09-21T01:16:14.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:14 smithi157 ceph-mon[34140]: pgmap v405: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 1.7 MiB/s wr, 14 op/s 2024-09-21T01:16:14.920 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:16:14.920 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:14.920 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 4, 2024-09-21T01:16:14.920 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 4, 2024-09-21T01:16:14.920 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 2992, 2024-09-21T01:16:14.920 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 448, 2024-09-21T01:16:14.920 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 4, 2024-09-21T01:16:14.920 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 0, 2024-09-21T01:16:14.920 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.003066642, 2024-09-21T01:16:14.920 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.000037871, 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002116958, 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3, 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.003827993, 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001275997 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T01:16:14.921 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 77, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 73, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 641952, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 43712, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 2, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 1, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.016187661, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.006132207, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.015630668, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:14.922 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 72, 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.003764998, 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000052291 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 641952, 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 43712 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:14.923 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 1, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 55, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 89920, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 3, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 2, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.006005831, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.004047092, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.001403577, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 53, 2024-09-21T01:16:14.924 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.002820568, 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000053218 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 89920 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 0, 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-21T01:16:14.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:14.926 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:14.927 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 148823, 2024-09-21T01:16:14.928 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 27, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:14.929 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 968, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 2, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 78, 2024-09-21T01:16:14.930 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 631104, 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 78, 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 78, 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 631104, 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:14.931 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:16:15.566 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T01:16:15.567 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T01:16:15.567 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T01:16:15.567 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T01:16:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 0, 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 2, 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 0, 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 4, 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 0, 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.001059057, 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:16:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.000194430, 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:16:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 82, 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 78, 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 643312, 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 46912, 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 2, 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 1, 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.017146663, 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.006479753, 2024-09-21T01:16:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.016881950, 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 77, 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.004323216, 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000056145 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 643312, 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 46912 2024-09-21T01:16:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 5, 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 61, 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 3152, 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 91072, 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 3, 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 2, 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.007710069, 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.004071223, 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.003143671, 2024-09-21T01:16:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 60, 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.006223597, 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000103726 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 91072 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 0, 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 148840, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 28, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 968, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 2, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T01:16:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 83, 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 631754, 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 83, 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 83, 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 631754, 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T01:16:16.357 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T01:16:16.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:16 smithi148 ceph-mon[31000]: pgmap v406: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-09-21T01:16:16.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:16 smithi181 ceph-mon[34811]: pgmap v406: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-09-21T01:16:16.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:16 smithi157 ceph-mon[34140]: pgmap v406: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.3 MiB/s wr, 12 op/s 2024-09-21T01:16:17.015 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T01:16:17.015 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T01:16:17.015 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T01:16:17.015 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T01:16:17.265 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:16:17.764 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-21T01:16:17.764 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:17.764 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 606, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 432, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 854426, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 375945, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 27, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 6, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.091498385, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.033401642, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.042845260, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.017030398, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 428, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.672074872, 2024-09-21T01:16:17.765 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.001570268 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 329, 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000069207, 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000210 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 795392, 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 89632 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 469, 2024-09-21T01:16:17.766 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 501, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 171794, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 663606, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 34, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 5, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.056096047, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.022049233, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.031524471, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.005336756, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 502, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.348203610, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000693632 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.767 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 419, 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000096165, 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000229 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 181392 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 737, 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 564, 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 250827, 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 527646, 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 12, 2024-09-21T01:16:17.768 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 6, 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.083275942, 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.030485056, 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.038122130, 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.017365625, 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 563, 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.303133167, 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000538424 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 637, 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000135248, 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000212 2024-09-21T01:16:17.769 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 105824, 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 73696 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 1, 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-MDSRank": { 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 313, 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.075556581, 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000241394 2024-09-21T01:16:17.770 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-PurgeQueue": { 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 16, 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000384458, 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000024028 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: "request": 119, 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: "reply": 119, 2024-09-21T01:16:17.771 INFO:teuthology.orchestra.run.smithi157.stdout: "reply_latency": { 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 119, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.089378192, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000751077 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_reply": 0, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "forward": 0, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_complete": 0, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_keys": 0, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_commit": 50, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_split": 0, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_merge": 0, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes": 24, 2024-09-21T01:16:17.772 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_top": 5, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_bottom": 19, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pin_tail": 0, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pinned": 16, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_expired": 5, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_with_caps": 2, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": 2, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "subtrees": 2, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse": 222, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_hit": 213, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_forward": 0, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_discover": 0, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_remote_ino": 0, 2024-09-21T01:16:17.773 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_lock": 0, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "load_cent": 0, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "q": 0, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "exported": 1, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "exported_inodes": 5, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "imported": 1, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "imported_inodes": 0, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_dir_fetch": 0, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_backtrace_fetch": 36, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_peer_discover": 0, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rfiles": 4, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rbytes": 234, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rsnaps": 0, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_fetch": 36, 2024-09-21T01:16:17.774 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_set_tag": 0, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_inodes": 24, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_base_inodes": 3, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dirfrag_rstats": 21, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_file_inodes": 12, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_inode_file_caps": 3, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_revoke": 15, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_grant": 24, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps": 36, 2024-09-21T01:16:17.775 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps_dirty": 17, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_cap_release": 2, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "process_request_cap_release": 18 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_cache": { 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update": 0, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update_receipt": 0, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_try_discover": 0, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_send_discover": 0, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_handle_discover": 5, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays": 0, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_delayed": 0, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_created": 1, 2024-09-21T01:16:17.776 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_enqueued": 1, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_reintegrated": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_migrated": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_processing": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_started": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_completed": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_enqueue_scrub": 3, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_exportdir": 1, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_flush": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:16:17.777 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragstats": 0, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_inodestats": 0, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "uninline_started": 0, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "uninline_succeeded": 0, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "uninline_write_failed": 0 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_log": { 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "evlrg": 0, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "evadd": 88, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "evex": 78, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "evtrm": 78, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "ev": 10, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "evexg": 0, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "evexd": 2, 2024-09-21T01:16:17.778 INFO:teuthology.orchestra.run.smithi157.stdout: "segadd": 11, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "segex": 10, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "segtrm": 10, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "seg": 1, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "segmjr": 1, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "segexg": 0, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "segexd": 1, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "expos": 4405104, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "wrpos": 4430978, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "rdpos": 0, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "jlat": { 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 70, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.143149724, 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.002044996 2024-09-21T01:16:17.779 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "replayed": 0 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_mem": { 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "ino": 23, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "ino+": 32, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "ino-": 9, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "dir": 18, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "dir+": 20, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "dir-": 2, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "dn": 24, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "dn+": 30, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "dn-": 6, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "cap": 2, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "cap+": 20, 2024-09-21T01:16:17.780 INFO:teuthology.orchestra.run.smithi157.stdout: "cap-": 18, 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "rss": 121208, 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "heap": 336347136 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_server": { 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_client_request": 141, 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_server_request": 3, 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_request": 119, 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_session": 15, 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_peer_request": 8, 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "req_create_latency": { 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 8, 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.007633939, 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000954242 2024-09-21T01:16:17.781 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getattr_latency": { 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 87, 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.028676198, 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000329611 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getfilelock_latency": { 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "req_link_latency": { 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.782 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookup_latency": { 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookuphash_latency": { 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupino_latency": { 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1, 2024-09-21T01:16:17.783 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000140617, 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000140617 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupname_latency": { 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupparent_latency": { 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupsnap_latency": { 2024-09-21T01:16:17.784 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.785 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.785 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.785 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.785 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lssnap_latency": { 2024-09-21T01:16:17.785 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.785 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mkdir_latency": { 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 8, 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.015534354, 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.001941794 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mknod_latency": { 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.786 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mksnap_latency": { 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "req_open_latency": { 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1, 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000161762, 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000161762 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "req_readdir_latency": { 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.787 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rename_latency": { 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2, 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.002881612, 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.001440806 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "req_renamesnap_latency": { 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "req_snapdiff_latency": { 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.788 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmdir_latency": { 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1, 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.008335138, 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.008335138 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmsnap_latency": { 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmxattr_latency": { 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.789 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setattr_latency": { 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1, 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.001490204, 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.001490204 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setdirlayout_latency": { 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.790 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setfilelock_latency": { 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setlayout_latency": { 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setxattr_latency": { 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 10, 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.024524368, 2024-09-21T01:16:17.791 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.002452436 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "req_symlink_latency": { 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "req_unlink_latency": { 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:16:17.792 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getvxattr_latency": { 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_sessions": { 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "session_count": 1, 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "session_add": 3, 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "session_remove": 2, 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_open": 1, 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_stale": 0, 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "total_load": 24, 2024-09-21T01:16:17.793 INFO:teuthology.orchestra.run.smithi157.stdout: "average_load": 24, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "avg_session_uptime": 143, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "mdthresh_evicted": 0 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:17.794 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:17.795 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:17.796 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 299143, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 126, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 616, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 7, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 7504, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 155, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:17.797 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 95434, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 688, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "objecter": { 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "op_active": 0, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "op_laggy": 0, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send": 761, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send_bytes": 293698, 2024-09-21T01:16:17.798 INFO:teuthology.orchestra.run.smithi157.stdout: "op_resend": 37, 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "op_reply": 761, 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "op_latency": { 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 761, 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 19.896641879, 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.026145390 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "op_inflight": 0, 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "oplen_avg": { 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 761, 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 900 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "op": 761, 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "op_r": 43, 2024-09-21T01:16:17.799 INFO:teuthology.orchestra.run.smithi157.stdout: "op_w": 718, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "op_rmw": 0, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "op_pg": 0, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_stat": 31, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_create": 23, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_read": 4, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_write": 71, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writefull": 32, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writesame": 0, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_append": 0, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_zero": 0, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_truncate": 0, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_delete": 513, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_mapext": 0, 2024-09-21T01:16:17.800 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_sparse_read": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_clonerange": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_getxattr": 39, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_setxattr": 46, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_rmxattr": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_call": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_watch": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_notify": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_other": 0, 2024-09-21T01:16:17.801 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_active": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_send": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_resend": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_ping": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_active": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_send": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_resend": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_active": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_send": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_resend": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_active": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_send": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_resend": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "command_active": 0, 2024-09-21T01:16:17.802 INFO:teuthology.orchestra.run.smithi157.stdout: "command_send": 0, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "command_resend": 0, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "map_epoch": 76, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "map_full": 0, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "map_inc": 2, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_sessions": 12, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_open": 12, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_close": 0, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_laggy": 0, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_wr": 129, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_rd": 0, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_del": 12 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.803 INFO:teuthology.orchestra.run.smithi157.stdout: "oft": { 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_objs": 1, 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_updates": 0, 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_removes": 0 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "purge_queue": { 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops": 0, 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops_high_water": 1, 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing": 0, 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_high_water": 1, 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed_ops": 1, 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed": 1, 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_item_in_journal": 0 2024-09-21T01:16:17.804 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 1808, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 1081507, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 1808, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 1808, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 1081507, 2024-09-21T01:16:17.805 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_bytes": { 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:17.806 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 761, 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 293799, 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 761, 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 293799, 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_ops": { 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 1024, 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:17.807 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 761, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 761, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 761, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 761, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:16:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 1, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 101, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 1, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 1, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 101, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.809 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle-0x55b08a595380": { 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 88, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 236674, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 88, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 70, 2024-09-21T01:16:17.810 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 236674, 2024-09-21T01:16:17.811 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:17.811 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:17.811 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:17.811 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:17.811 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:17.811 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:17.811 INFO:teuthology.orchestra.run.smithi157.stdout: "trackedop": { 2024-09-21T01:16:17.811 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_ops_count": 0 2024-09-21T01:16:17.811 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:17.811 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-21T01:16:18.648 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:18 smithi157 ceph-mon[34140]: pgmap v407: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 14 MiB/s wr, 16 op/s 2024-09-21T01:16:18.678 INFO:tasks.check_counter:Daemon mds.b mds.exported=1 2024-09-21T01:16:18.678 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-21T01:16:18.678 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T01:16:18.678 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T01:16:18.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:18 smithi181 ceph-mon[34811]: pgmap v407: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 14 MiB/s wr, 16 op/s 2024-09-21T01:16:18.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:18 smithi148 ceph-mon[31000]: pgmap v407: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 14 MiB/s wr, 16 op/s 2024-09-21T01:16:18.928 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:16:19.410 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-21T01:16:19.410 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 93, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 85, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 675346, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 47780, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 5, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 1, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.020539396, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.006898269, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.021235988, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.000027136, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 84, 2024-09-21T01:16:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.005428081, 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000064620 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 674512, 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 47456 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 153, 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 209, 2024-09-21T01:16:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 39582, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 226893, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 5, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 4, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.025145242, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.010617577, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.007175022, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.005446092, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 208, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.014328400, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000068886 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 179824 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 545, 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 547, 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 338416, 2024-09-21T01:16:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 173368, 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 4, 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 3, 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.066614238, 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.030331226, 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.014815687, 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.016622310, 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 545, 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.023691847, 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000043471 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 1, 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-MDSRank": { 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2024-09-21T01:16:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1214, 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.036019566, 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000029670 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-PurgeQueue": { 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "request": 0, 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "reply": 0, 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "reply_latency": { 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_reply": 0, 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "forward": 0, 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_complete": 0, 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_keys": 0, 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_commit": 0, 2024-09-21T01:16:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_split": 0, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_merge": 0, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes": 6, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_top": 0, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_bottom": 6, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pin_tail": 0, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pinned": 6, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_expired": 0, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_with_caps": 0, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": 0, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "subtrees": 1, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse": 0, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_hit": 0, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_forward": 0, 2024-09-21T01:16:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_discover": 0, 2024-09-21T01:16:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:16:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_remote_ino": 0, 2024-09-21T01:16:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_lock": 0, 2024-09-21T01:16:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: "load_cent": 0, 2024-09-21T01:16:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: "q": 0, 2024-09-21T01:16:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: "exported": 0, 2024-09-21T01:16:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: "exported_inodes": 0, 2024-09-21T01:16:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: "imported": 0, 2024-09-21T01:16:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: "imported_inodes": 0, 2024-09-21T01:16:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_dir_fetch": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_peer_discover": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rfiles": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rbytes": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rsnaps": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_set_tag": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_file_inodes": 0, 2024-09-21T01:16:19.421 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps": 0, 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_cap_release": 0, 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: "process_request_cap_release": 0 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.422 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_cache": { 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update_receipt": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_try_discover": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_send_discover": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_handle_discover": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_delayed": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_created": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_enqueued": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_reintegrated": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_migrated": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_processing": 0, 2024-09-21T01:16:19.423 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_started": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_completed": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_exportdir": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_flush": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragstats": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_inodestats": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "uninline_started": 0, 2024-09-21T01:16:19.424 INFO:teuthology.orchestra.run.smithi157.stdout: "uninline_succeeded": 0, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "uninline_write_failed": 0 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_log": { 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "evlrg": 0, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "evadd": 0, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "evex": 0, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "evtrm": 0, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "ev": 97, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "evexg": 0, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "evexd": 0, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "segadd": 0, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "segex": 0, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "segtrm": 0, 2024-09-21T01:16:19.425 INFO:teuthology.orchestra.run.smithi157.stdout: "seg": 2, 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "segmjr": 2, 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "segexg": 0, 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "segexd": 0, 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "expos": 4194304, 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "wrpos": 4373323, 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "rdpos": 4370682, 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "jlat": { 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: "replayed": 97 2024-09-21T01:16:19.426 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_mem": { 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "ino": 5, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "ino+": 16, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "ino-": 11, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "dir": 2, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "dir+": 11, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "dir-": 9, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "dn": 6, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "dn+": 18, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "dn-": 12, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "cap": 0, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "cap+": 0, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "cap-": 0, 2024-09-21T01:16:19.427 INFO:teuthology.orchestra.run.smithi157.stdout: "rss": 116928, 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "heap": 315375616 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_server": { 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_client_request": 0, 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_server_request": 0, 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_request": 0, 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_session": 0, 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_peer_request": 0, 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "req_create_latency": { 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getattr_latency": { 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getfilelock_latency": { 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "req_link_latency": { 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.429 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookup_latency": { 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookuphash_latency": { 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupino_latency": { 2024-09-21T01:16:19.430 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupname_latency": { 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupparent_latency": { 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.431 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupsnap_latency": { 2024-09-21T01:16:19.432 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.432 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.432 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.432 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.432 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lssnap_latency": { 2024-09-21T01:16:19.432 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.432 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mkdir_latency": { 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mknod_latency": { 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.433 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mksnap_latency": { 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "req_open_latency": { 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "req_readdir_latency": { 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.434 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rename_latency": { 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: "req_renamesnap_latency": { 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.435 INFO:teuthology.orchestra.run.smithi157.stdout: "req_snapdiff_latency": { 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmdir_latency": { 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmsnap_latency": { 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.436 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.437 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.437 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmxattr_latency": { 2024-09-21T01:16:19.437 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.437 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.437 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.437 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.437 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setattr_latency": { 2024-09-21T01:16:19.437 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.437 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.437 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setdirlayout_latency": { 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setfilelock_latency": { 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setlayout_latency": { 2024-09-21T01:16:19.438 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setxattr_latency": { 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: "req_symlink_latency": { 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.439 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: "req_unlink_latency": { 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getvxattr_latency": { 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:19.440 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_sessions": { 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "session_count": 1, 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "session_add": 3, 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "session_remove": 2, 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_open": 2, 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_stale": 0, 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "total_load": 0, 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "average_load": 0, 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "avg_session_uptime": 5207, 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "mdthresh_evicted": 0 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2024-09-21T01:16:19.441 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:19.442 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:19.443 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 189293, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 50, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:19.444 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 7504, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 155, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 18802, 2024-09-21T01:16:19.445 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 165, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "objecter": { 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "op_active": 0, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "op_laggy": 0, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send": 694, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send_bytes": 21, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "op_resend": 3, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "op_reply": 694, 2024-09-21T01:16:19.446 INFO:teuthology.orchestra.run.smithi157.stdout: "op_latency": { 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 694, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.371993285, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000536013 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "op_inflight": 0, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "oplen_avg": { 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 694, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 695 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "op": 694, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "op_r": 694, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "op_w": 0, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "op_rmw": 0, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "op_pg": 0, 2024-09-21T01:16:19.447 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_stat": 384, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_create": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_read": 308, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_write": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writefull": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writesame": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_append": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_zero": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_truncate": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_delete": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_mapext": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_sparse_read": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_clonerange": 0, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_getxattr": 1, 2024-09-21T01:16:19.448 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_setxattr": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_rmxattr": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_call": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_watch": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_notify": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_other": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_active": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_send": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_resend": 0, 2024-09-21T01:16:19.449 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_ping": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_active": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_send": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_resend": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_active": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_send": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_resend": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_active": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_send": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_resend": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "command_active": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "command_send": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "command_resend": 0, 2024-09-21T01:16:19.450 INFO:teuthology.orchestra.run.smithi157.stdout: "map_epoch": 76, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "map_full": 0, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "map_inc": 2, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_sessions": 5, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_open": 5, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_close": 0, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_laggy": 0, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_wr": 0, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_rd": 2, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_del": 0 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "oft": { 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_objs": 0, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:16:19.451 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_updates": 0, 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_removes": 0 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "purge_queue": { 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops": 0, 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing": 0, 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_high_water": 0, 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed_ops": 0, 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed": 0, 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_item_in_journal": 0 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:19.452 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 787, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 974808, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 787, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 787, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 974808, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.453 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_bytes": { 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 694, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 179024, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 694, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 179024, 2024-09-21T01:16:19.454 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_ops": { 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 1024, 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:19.455 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 694, 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 694, 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 694, 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 694, 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2024-09-21T01:16:19.456 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.457 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle-0x564f598036c0": { 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:19.458 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:19.459 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:19.459 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:19.459 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:19.459 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:19.459 INFO:teuthology.orchestra.run.smithi157.stdout: "trackedop": { 2024-09-21T01:16:19.459 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_ops_count": 0 2024-09-21T01:16:19.459 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:19.459 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-21T01:16:19.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:19 smithi181 ceph-mon[34811]: pgmap v408: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 17 MiB/s wr, 13 op/s 2024-09-21T01:16:19.738 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:19 smithi157 ceph-mon[34140]: pgmap v408: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 17 MiB/s wr, 13 op/s 2024-09-21T01:16:19.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:19 smithi148 ceph-mon[31000]: pgmap v408: 97 pgs: 97 active+clean; 257 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 17 MiB/s wr, 13 op/s 2024-09-21T01:16:20.260 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T01:16:20.260 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T01:16:20.260 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T01:16:20.260 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T01:16:20.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:16:20.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:16:20.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:16:20.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:16:20.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:16:20.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:20 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:16:20.509 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:16:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:16:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:16:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:16:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:16:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:16:20.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:20 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:16:20.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:16:20.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:16:20.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:16:20.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:16:20.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:16:20.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:20 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' 2024-09-21T01:16:21.016 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-21T01:16:21.016 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:21.016 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 519, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 521, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 390409, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 165052, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 6, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 2, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.062049605, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.029696230, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.012949469, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.014373543, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 519, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.019252981, 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000037096 2024-09-21T01:16:21.017 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 96, 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 88, 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 676056, 2024-09-21T01:16:21.018 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 48314, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 4, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 3, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.019813847, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.007258892, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.019865731, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.000107532, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 87, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.009453089, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000108656 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.019 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 674400, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 46976 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 237, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 291, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 60295, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 253233, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 4, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 3, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.031352256, 2024-09-21T01:16:21.020 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.013369076, 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.007910189, 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.007753134, 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 290, 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.014349992, 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000049482 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 179456 2024-09-21T01:16:21.021 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 1, 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-MDSRank": { 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1264, 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.034821977, 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000027549 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-PurgeQueue": { 2024-09-21T01:16:21.022 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2024-09-21T01:16:21.023 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2024-09-21T01:16:21.023 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.023 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.025 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.025 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:21.025 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "request": 0, 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "reply": 0, 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "reply_latency": { 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_reply": 0, 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "forward": 0, 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_complete": 0, 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_keys": 0, 2024-09-21T01:16:21.026 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_commit": 0, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_split": 0, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_merge": 0, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes": 15, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_top": 5, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_bottom": 10, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pin_tail": 0, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pinned": 8, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_expired": 0, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_with_caps": 0, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": 0, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "subtrees": 2, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse": 0, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_hit": 0, 2024-09-21T01:16:21.027 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_forward": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_discover": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_remote_ino": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_lock": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "load_cent": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "q": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "exported": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "exported_inodes": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "imported": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "imported_inodes": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_dir_fetch": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_peer_discover": 0, 2024-09-21T01:16:21.028 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rfiles": 4, 2024-09-21T01:16:21.029 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rbytes": 234, 2024-09-21T01:16:21.029 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rsnaps": 0, 2024-09-21T01:16:21.029 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:16:21.029 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_set_tag": 0, 2024-09-21T01:16:21.029 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:16:21.029 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:16:21.029 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:16:21.029 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:16:21.029 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:16:21.029 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_file_inodes": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_cap_release": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "process_request_cap_release": 0 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_cache": { 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update": 0, 2024-09-21T01:16:21.030 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update_receipt": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_try_discover": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_send_discover": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_handle_discover": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_delayed": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_created": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_enqueued": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_reintegrated": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_migrated": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_processing": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:16:21.031 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_started": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_completed": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_exportdir": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_flush": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragstats": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_inodestats": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "uninline_started": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "uninline_succeeded": 0, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "uninline_write_failed": 0 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.032 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_log": { 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "evlrg": 0, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "evadd": 0, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "evex": 0, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "evtrm": 0, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "ev": 88, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "evexg": 0, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "evexd": 0, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "segadd": 0, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "segex": 0, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "segtrm": 0, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "seg": 2, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "segmjr": 11, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "segexg": 0, 2024-09-21T01:16:21.033 INFO:teuthology.orchestra.run.smithi157.stdout: "segexd": 0, 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "expos": 4405104, 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "wrpos": 4430978, 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "rdpos": 4429327, 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "jlat": { 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "replayed": 88 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_mem": { 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "ino": 14, 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "ino+": 20, 2024-09-21T01:16:21.034 INFO:teuthology.orchestra.run.smithi157.stdout: "ino-": 6, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "dir": 9, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "dir+": 11, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "dir-": 2, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "dn": 15, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "dn+": 20, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "dn-": 5, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "cap": 0, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "cap+": 0, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "cap-": 0, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "rss": 116760, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "heap": 315379712 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_server": { 2024-09-21T01:16:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_client_request": 0, 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_server_request": 0, 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_request": 0, 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_session": 0, 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_peer_request": 0, 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "req_create_latency": { 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getattr_latency": { 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.036 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getfilelock_latency": { 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "req_link_latency": { 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookup_latency": { 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.037 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookuphash_latency": { 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupino_latency": { 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupname_latency": { 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.038 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupparent_latency": { 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupsnap_latency": { 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lssnap_latency": { 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.039 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.040 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.040 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.040 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mkdir_latency": { 2024-09-21T01:16:21.040 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mknod_latency": { 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mksnap_latency": { 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.041 INFO:teuthology.orchestra.run.smithi157.stdout: "req_open_latency": { 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "req_readdir_latency": { 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rename_latency": { 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.042 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "req_renamesnap_latency": { 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "req_snapdiff_latency": { 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmdir_latency": { 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.043 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmsnap_latency": { 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmxattr_latency": { 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setattr_latency": { 2024-09-21T01:16:21.044 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setdirlayout_latency": { 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setfilelock_latency": { 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.045 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setlayout_latency": { 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setxattr_latency": { 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "req_symlink_latency": { 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.046 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: "req_unlink_latency": { 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getvxattr_latency": { 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:21.047 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_sessions": { 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "session_count": 1, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "session_add": 3, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "session_remove": 2, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_open": 2, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_stale": 0, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "total_load": 0, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "average_load": 0, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "avg_session_uptime": 5204, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "mdthresh_evicted": 0 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:21.048 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:21.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:21.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 189296, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 50, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:21.051 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 7504, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 155, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 54082, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 308, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2024-09-21T01:16:21.052 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "objecter": { 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "op_active": 0, 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "op_laggy": 0, 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send": 755, 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send_bytes": 26, 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "op_resend": 4, 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "op_reply": 755, 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "op_latency": { 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 755, 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.376993199, 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000499328 2024-09-21T01:16:21.053 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "op_inflight": 0, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "oplen_avg": { 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 755, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 756 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "op": 755, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "op_r": 755, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "op_w": 0, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "op_rmw": 0, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "op_pg": 0, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_stat": 471, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_create": 0, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_read": 281, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_write": 0, 2024-09-21T01:16:21.054 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writefull": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writesame": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_append": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_zero": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_truncate": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_delete": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_mapext": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_sparse_read": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_clonerange": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_getxattr": 2, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_setxattr": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_rmxattr": 0, 2024-09-21T01:16:21.055 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_call": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_watch": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_notify": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_other": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_active": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_send": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_resend": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_ping": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_active": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_send": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_resend": 0, 2024-09-21T01:16:21.056 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_active": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_send": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_resend": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_active": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_send": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_resend": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "command_active": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "command_send": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "command_resend": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "map_epoch": 76, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "map_full": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "map_inc": 2, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_sessions": 5, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_open": 5, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_close": 0, 2024-09-21T01:16:21.057 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_laggy": 0, 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_wr": 0, 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_rd": 2, 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_del": 0 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "oft": { 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_objs": 0, 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_updates": 0, 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_removes": 0 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "purge_queue": { 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops": 0, 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:16:21.058 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing": 0, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_high_water": 0, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed_ops": 0, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed": 0, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_item_in_journal": 0 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 848, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 1042740, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 848, 2024-09-21T01:16:21.059 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 848, 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 1042740, 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_bytes": { 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:21.060 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 755, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 236684, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 755, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 236684, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.061 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_ops": { 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 1024, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 755, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 755, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 755, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 755, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.062 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2024-09-21T01:16:21.063 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle-0x562692fc9450": { 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:21.064 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: "trackedop": { 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_ops_count": 0 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:21.065 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-21T01:16:21.662 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:21 smithi157 ceph-mon[34140]: pgmap v409: 97 pgs: 97 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 19 MiB/s wr, 15 op/s 2024-09-21T01:16:21.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:21 smithi181 ceph-mon[34811]: pgmap v409: 97 pgs: 97 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 19 MiB/s wr, 15 op/s 2024-09-21T01:16:21.828 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T01:16:21.829 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T01:16:21.829 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T01:16:21.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T01:16:21.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:21 smithi148 ceph-mon[31000]: pgmap v409: 97 pgs: 97 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 19 MiB/s wr, 15 op/s 2024-09-21T01:16:22.075 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:16:22.543 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-21T01:16:22.543 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:22.543 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 0, 2024-09-21T01:16:22.543 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 2, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 0, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 4, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 0, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.001103713, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.000237257, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.544 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 1, 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 61, 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 90976, 2024-09-21T01:16:22.545 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 3, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 2, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.006192096, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.004211895, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.001189140, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 59, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.003986777, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000067572 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:22.546 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 90976 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 88, 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 82, 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 646848, 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 48640, 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 2, 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 1, 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.023091168, 2024-09-21T01:16:22.547 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.007598675, 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.022205135, 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 82, 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.009151607, 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000111604 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 646848, 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 48640 2024-09-21T01:16:22.548 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 0, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:22.549 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:22.550 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:22.551 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 148823, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 27, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 968, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 2, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 85, 2024-09-21T01:16:22.553 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 632014, 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 85, 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 85, 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 632014, 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-09-21T01:16:22.554 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-21T01:16:23.220 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T01:16:23.221 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T01:16:23.221 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T01:16:23.221 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T01:16:23.481 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:16:23.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:23 smithi157 ceph-mon[34140]: pgmap v410: 97 pgs: 97 active+clean; 53 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 21 MiB/s wr, 20 op/s 2024-09-21T01:16:23.601 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:23 smithi181 ceph-mon[34811]: pgmap v410: 97 pgs: 97 active+clean; 53 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 21 MiB/s wr, 20 op/s 2024-09-21T01:16:23.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:23 smithi148 ceph-mon[31000]: pgmap v410: 97 pgs: 97 active+clean; 53 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 21 MiB/s wr, 20 op/s 2024-09-21T01:16:24.012 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T01:16:24.012 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:24.012 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 245, 2024-09-21T01:16:24.012 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 237, 2024-09-21T01:16:24.012 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 713000, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 273906, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 11, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.039739549, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.014186926, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.026361956, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.004333008, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 236, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.020678981, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000087622 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.013 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 26, 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000004990, 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000191 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 685024, 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 57072 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 158, 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 234, 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 54514, 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 307351, 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 12, 2024-09-21T01:16:24.014 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 6, 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.031682425, 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.013589579, 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.017808799, 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.001449429, 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 233, 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.026713448, 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000114649 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 196, 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000052126, 2024-09-21T01:16:24.015 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000265 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 39936, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 229856 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 259, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 281, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 89080, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 203554, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 13, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 5, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.037351616, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.015503511, 2024-09-21T01:16:24.016 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.018866384, 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.003316531, 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 279, 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.024826926, 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000088985 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 417, 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000117713, 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000282 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:16:24.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 211, 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.030125148, 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000142773 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-21T01:16:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 96, 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.003325047, 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000034635 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 17, 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 14, 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 14, 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.017339496, 2024-09-21T01:16:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001238535 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 3, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 11, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 16, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 16, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 15, 2024-09-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 2, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 2, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 2, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 3, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 29, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 24, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 3, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 1, 2024-09-21T01:16:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 1, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 5, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 5, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 8, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 214335722, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 5, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 1, 2024-09-21T01:16:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 1, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 4, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 17, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 14, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 80, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 63, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 3, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 9 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-21T01:16:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 4, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 5, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 5, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:16:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 1, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_started": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_succeeded": 0, 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_write_failed": 0 2024-09-21T01:16:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 98, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 98, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 2, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-09-21T01:16:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4373922, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 0, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 80, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.173795920, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.002172449 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 0 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 20, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 25, 2024-09-21T01:16:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 5, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 18, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 21, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 3, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 16, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 27, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 11, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 2, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 12, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 10, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 120152, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 325861376 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 27, 2024-09-21T01:16:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 1, 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 17, 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 10, 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 5, 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 4, 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.004268620, 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001067155 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3, 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000903940, 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000301313 2024-09-21T01:16:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1, 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000128658, 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000128658 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-21T01:16:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-21T01:16:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1, 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000390407, 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000390407 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1, 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.006647103, 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.006647103 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-21T01:16:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 4, 2024-09-21T01:16:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.005000768, 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001250192 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 3, 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 2, 2024-09-21T01:16:24.040 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 8, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 8, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 150, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:24.041 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:24.042 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:24.043 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 305420, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 113, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7504, 2024-09-21T01:16:24.044 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 155, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 81811, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 506, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-21T01:16:24.045 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 219, 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 193358, 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 27, 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 219, 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 219, 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.920981541, 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.004205395 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 219, 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 250 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.046 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 219, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 8, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 211, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 0, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 10, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 3, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 83, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 16, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 80, 2024-09-21T01:16:24.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 5, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 20, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:16:24.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-21T01:16:24.049 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 76, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 12, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 12, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 29, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 0, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 4 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.050 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 1, 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 64, 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 3, 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 68, 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 5, 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-21T01:16:24.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 658, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 783128, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 658, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 658, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 783128, 2024-09-21T01:16:24.052 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:24.053 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 219, 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 193863, 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 219, 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 193863, 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:24.054 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 219, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 219, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 219, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 219, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.055 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 5, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 505, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 5, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 3, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 505, 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:24.056 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x55fe09ea96c0": { 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 98, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 179618, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 98, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T01:16:24.057 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 80, 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 179618, 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: "trackedop": { 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:24.058 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T01:16:24.829 INFO:tasks.check_counter:Daemon mds.c mds.exported=1 2024-09-21T01:16:24.829 INFO:tasks.check_counter:Daemon mds.c mds.imported=1 2024-09-21T01:16:24.829 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T01:16:24.829 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T01:16:25.083 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:16:25.611 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T01:16:25.611 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:25.611 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 635, 2024-09-21T01:16:25.611 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 637, 2024-09-21T01:16:25.611 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 183593, 2024-09-21T01:16:25.611 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 201937, 2024-09-21T01:16:25.611 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 6, 2024-09-21T01:16:25.611 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-21T01:16:25.611 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.076833171, 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.034367218, 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.016261194, 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.020418080, 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 635, 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.029332877, 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000046193 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.612 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 95, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 87, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 675340, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 48794, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 3, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.020600432, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.007163460, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.020449213, 2024-09-21T01:16:25.613 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000075492, 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 86, 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.006765954, 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000078673 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 674784, 2024-09-21T01:16:25.614 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 48096 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 6, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 62, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 3420, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 181774, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.008103643, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.003540195, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.003849517, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000042519, 2024-09-21T01:16:25.615 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 61, 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.009050373, 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000148366 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 181456 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1126, 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.035828589, 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000031819 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T01:16:25.617 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-21T01:16:25.618 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-09-21T01:16:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 1, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-21T01:16:25.620 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:16:25.621 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-09-21T01:16:25.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-21T01:16:25.623 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-21T01:16:25.624 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_started": 0, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_succeeded": 0, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_write_failed": 0 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 3, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-09-21T01:16:25.625 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4195200, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 4194892, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.626 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 3 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 3, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 3, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 0, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 1, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 1, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 0, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 0, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 0, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 0, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-09-21T01:16:25.627 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 119664, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 315367424 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.628 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.629 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.630 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.632 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-21T01:16:25.632 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.632 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.632 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.632 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-21T01:16:25.632 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.632 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.632 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.633 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.634 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.635 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-21T01:16:25.636 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.637 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.638 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.639 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 1, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 0, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-09-21T01:16:25.640 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 1459, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:25.641 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:25.642 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 181159, 2024-09-21T01:16:25.643 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 44, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7504, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 155, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:25.644 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 8672, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 13, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 638, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 21, 2024-09-21T01:16:25.645 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 3, 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 638, 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 638, 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.311993780, 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000489018 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 638, 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 639 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 638, 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 638, 2024-09-21T01:16:25.646 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 387, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 249, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-21T01:16:25.647 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 1, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-21T01:16:25.648 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-21T01:16:25.649 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 76, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 4, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 4, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-21T01:16:25.650 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.651 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 732, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 788715, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 732, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 732, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 788715, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.652 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 638, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 901, 2024-09-21T01:16:25.653 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 638, 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 901, 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T01:16:25.654 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 638, 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 638, 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 638, 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 638, 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:16:25.655 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.656 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x5580ff189450": { 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T01:16:25.657 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T01:16:25.658 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:25.658 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:25.658 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:25.658 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:25.658 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:25.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:25.658 INFO:teuthology.orchestra.run.smithi181.stdout: "trackedop": { 2024-09-21T01:16:25.658 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-21T01:16:25.658 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:25.658 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T01:16:25.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:25 smithi181 ceph-mon[34811]: pgmap v411: 97 pgs: 97 active+clean; 987 KiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 20 MiB/s wr, 17 op/s 2024-09-21T01:16:25.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:25 smithi157 ceph-mon[34140]: pgmap v411: 97 pgs: 97 active+clean; 987 KiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 20 MiB/s wr, 17 op/s 2024-09-21T01:16:25.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:25 smithi148 ceph-mon[31000]: pgmap v411: 97 pgs: 97 active+clean; 987 KiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 20 MiB/s wr, 17 op/s 2024-09-21T01:16:26.284 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T01:16:26.285 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T01:16:26.285 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T01:16:26.285 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T01:16:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 235, 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 283, 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 719064, 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 118579, 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 7, 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.043220813, 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.018740394, 2024-09-21T01:16:27.033 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.025286701, 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.002080426, 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 282, 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.026345541, 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000093423 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 259, 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000077445, 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000299 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 685072, 2024-09-21T01:16:27.034 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 51456 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 18, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 75, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 4328, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 236370, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 11, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 5, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.011584125, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.004466482, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.005715242, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000542523, 2024-09-21T01:16:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 73, 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.015053435, 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000206211 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 9, 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000001674, 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000186 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 960, 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 181408 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 24, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 24, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 7730, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 86432, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 12, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 6, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.008135973, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.000793729, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.006777982, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000342986, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 23, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.021302762, 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000926207 2024-09-21T01:16:27.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 6, 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000644, 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000107 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.038 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 28, 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.001590795, 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000056814 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2, 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000027054, 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000013527 2024-09-21T01:16:27.039 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 1, 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 1, 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-21T01:16:27.040 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 11, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 10, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 10, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 10, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 1, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-09-21T01:16:27.041 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 1, 2024-09-21T01:16:27.042 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 8, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 214335722, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:16:27.043 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 1, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-21T01:16:27.044 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:16:27.045 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_started": 0, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_succeeded": 0, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_write_failed": 0 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 3, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-21T01:16:27.046 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 3, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 2, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4195200, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 0, 2024-09-21T01:16:27.047 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.003395947, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001697973 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 0 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 13, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 13, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 0, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 11, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 12, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 1, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 10, 2024-09-21T01:16:27.048 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 10, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 0, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 116864, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 324812800 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 1, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 1, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 2, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-21T01:16:27.049 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.052 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.053 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-21T01:16:27.053 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.053 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.053 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.053 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-21T01:16:27.053 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.053 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.054 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.055 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.056 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-21T01:16:27.057 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.059 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:16:27.060 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 1, 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 0, 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-09-21T01:16:27.061 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 141, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:27.062 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:27.063 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 230343, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 75, 2024-09-21T01:16:27.064 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7504, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 155, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T01:16:27.065 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 51192, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 198, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 37, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 11108, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 28, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 37, 2024-09-21T01:16:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 37, 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.233995335, 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.006324198 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 37, 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 59 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 37, 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 0, 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 37, 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-21T01:16:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 0, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 10, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 0, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 2, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 6, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 6, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-21T01:16:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 20, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-21T01:16:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 76, 2024-09-21T01:16:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 9, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 9, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 14, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 0, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 1 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 1, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-21T01:16:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T01:16:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 273, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 697429, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 273, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 273, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 697429, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 37, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 11108, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 37, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 11108, 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 37, 2024-09-21T01:16:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 37, 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 37, 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 37, 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T01:16:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x559276b1d450": { 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 3, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 896, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 3, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 896, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: "trackedop": { 2024-09-21T01:16:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-21T01:16:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:27.079 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T01:16:27.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:27 smithi181 ceph-mon[34811]: pgmap v412: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 18 MiB/s wr, 18 op/s 2024-09-21T01:16:27.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:27 smithi157 ceph-mon[34140]: pgmap v412: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 18 MiB/s wr, 18 op/s 2024-09-21T01:16:27.810 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-21T01:16:27.810 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-21T01:16:27.810 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T01:16:27.811 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T01:16:27.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:27 smithi148 ceph-mon[31000]: pgmap v412: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 18 MiB/s wr, 18 op/s 2024-09-21T01:16:28.055 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:16:28.548 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T01:16:28.548 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:16:28.548 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 0, 2024-09-21T01:16:28.548 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 2, 2024-09-21T01:16:28.548 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:16:28.548 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 0, 2024-09-21T01:16:28.548 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 0, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.000997105, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.000218797, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:28.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 90, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 84, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 647392, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 49920, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 2, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.022527038, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.007706106, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.021302477, 2024-09-21T01:16:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 84, 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.009610781, 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000114414 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 647392, 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 49920 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:16:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 1, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 63, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 91328, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 3, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.006674218, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.004961157, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.000713741, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 61, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.004111651, 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000067404 2024-09-21T01:16:28.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 91328 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 0, 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:16:28.553 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:16:28.554 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:16:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 148823, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 27, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T01:16:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 968, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 2, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T01:16:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 87, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 632274, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 87, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 87, 2024-09-21T01:16:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 632274, 2024-09-21T01:16:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T01:16:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T01:16:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T01:16:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T01:16:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T01:16:28.559 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T01:16:29.142 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T01:16:29.142 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T01:16:29.142 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T01:16:29.154 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T01:16:29.154 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:16:29.154 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:16:29.173 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T01:16:29.173 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:16:29.230 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T01:16:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:29.614 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:29 smithi148 ceph-mon[31000]: pgmap v413: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7.7 MiB/s wr, 13 op/s 2024-09-21T01:16:29.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:29 smithi181 ceph-mon[34811]: pgmap v413: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7.7 MiB/s wr, 13 op/s 2024-09-21T01:16:29.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:29 smithi157 ceph-mon[34140]: pgmap v413: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7.7 MiB/s wr, 13 op/s 2024-09-21T01:16:30.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.030+0000 7fa3d699d640 1 -- 172.21.15.148:0/3152581655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3d01092d0 msgr2=0x7fa3d01096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.030+0000 7fa3d699d640 1 --2- 172.21.15.148:0/3152581655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3d01092d0 0x7fa3d01096e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009900 tx=0x7fa3c002a410 comp rx=0 tx=0).stop 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.030+0000 7fa3d699d640 1 -- 172.21.15.148:0/3152581655 shutdown_connections 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.030+0000 7fa3d699d640 1 --2- 172.21.15.148:0/3152581655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3d01092d0 0x7fa3d01096e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.030+0000 7fa3d699d640 1 --2- 172.21.15.148:0/3152581655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3d0109c20 0x7fa3d0110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.030+0000 7fa3d699d640 1 --2- 172.21.15.148:0/3152581655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3d0103990 0x7fa3d0103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.030+0000 7fa3d699d640 1 -- 172.21.15.148:0/3152581655 >> 172.21.15.148:0/3152581655 conn(0x7fa3d00ff3e0 msgr2=0x7fa3d0101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.030+0000 7fa3d699d640 1 -- 172.21.15.148:0/3152581655 shutdown_connections 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.030+0000 7fa3d699d640 1 -- 172.21.15.148:0/3152581655 wait complete. 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d699d640 1 Processor -- start 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d699d640 1 -- start start 2024-09-21T01:16:30.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d699d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3d0103990 0x7fa3d019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d699d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3d01092d0 0x7fa3d019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d699d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3d0109c20 0x7fa3d019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d699d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01138e0 con 0x7fa3d01092d0 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d699d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d0113760 con 0x7fa3d0109c20 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d699d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d0113a60 con 0x7fa3d0103990 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d519a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3d01092d0 0x7fa3d019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d519a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3d01092d0 0x7fa3d019a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33424/0 (socket says 172.21.15.148:33424) 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.031+0000 7fa3d519a640 1 -- 172.21.15.148:0/3995967874 learned_addr learned my addr 172.21.15.148:0/3995967874 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d599b640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3d0103990 0x7fa3d019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d619c640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3d0109c20 0x7fa3d019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d519a640 1 -- 172.21.15.148:0/3995967874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3d0103990 msgr2=0x7fa3d019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d519a640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3d0103990 0x7fa3d019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d519a640 1 -- 172.21.15.148:0/3995967874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3d0109c20 msgr2=0x7fa3d019fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d519a640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3d0109c20 0x7fa3d019fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d519a640 1 -- 172.21.15.148:0/3995967874 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d01a01a0 con 0x7fa3d01092d0 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d619c640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3d0109c20 0x7fa3d019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d519a640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3d01092d0 0x7fa3d019a890 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa3c002a930 tx=0x7fa3c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3c6ffd640 1 -- 172.21.15.148:0/3995967874 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c003f030 con 0x7fa3d01092d0 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3c6ffd640 1 -- 172.21.15.148:0/3995967874 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c0003aa0 con 0x7fa3d01092d0 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d699d640 1 -- 172.21.15.148:0/3995967874 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d01a0430 con 0x7fa3d01092d0 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3c6ffd640 1 -- 172.21.15.148:0/3995967874 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0035070 con 0x7fa3d01092d0 2024-09-21T01:16:30.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.032+0000 7fa3d699d640 1 -- 172.21.15.148:0/3995967874 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d01a0910 con 0x7fa3d01092d0 2024-09-21T01:16:30.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.033+0000 7fa3d699d640 1 -- 172.21.15.148:0/3995967874 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d0103da0 con 0x7fa3d01092d0 2024-09-21T01:16:30.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.035+0000 7fa3c6ffd640 1 -- 172.21.15.148:0/3995967874 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7fa3c0042030 con 0x7fa3d01092d0 2024-09-21T01:16:30.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.036+0000 7fa3c6ffd640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa3bc0b6540 0x7fa3bc0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.036+0000 7fa3d599b640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa3bc0b6540 0x7fa3bc0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.036+0000 7fa3c6ffd640 1 -- 172.21.15.148:0/3995967874 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fa3c0107e40 con 0x7fa3d01092d0 2024-09-21T01:16:30.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.036+0000 7fa3d599b640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa3bc0b6540 0x7fa3bc0b8a50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00abe0 tx=0x7fa3cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:30.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.039+0000 7fa3c6ffd640 1 -- 172.21.15.148:0/3995967874 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3c00ce6e0 con 0x7fa3d01092d0 2024-09-21T01:16:30.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.228+0000 7fa3d699d640 1 -- 172.21.15.148:0/3995967874 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa3d010ba10 con 0x7fa3d01092d0 2024-09-21T01:16:30.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.228+0000 7fa3c6ffd640 1 -- 172.21.15.148:0/3995967874 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v76) ==== 81+0+601 (secure 0 0 0) 0x7fa3c00d2ac0 con 0x7fa3d01092d0 2024-09-21T01:16:30.230 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/745630392 2024-09-22T01:04:54.215776+0000 2024-09-21T01:16:30.230 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/1196614580 2024-09-22T01:04:54.215776+0000 2024-09-21T01:16:30.230 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1864845687 2024-09-22T01:04:54.215776+0000 2024-09-21T01:16:30.230 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/1638470562 2024-09-22T01:04:28.140797+0000 2024-09-21T01:16:30.231 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3851857915 2024-09-22T01:04:28.140797+0000 2024-09-21T01:16:30.231 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/1638470562 2024-09-22T01:04:28.140797+0000 2024-09-21T01:16:30.231 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/1196614580 2024-09-22T01:04:54.215776+0000 2024-09-21T01:16:30.231 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3953192821 2024-09-22T01:04:54.215776+0000 2024-09-21T01:16:30.231 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2712136637 2024-09-22T01:04:28.140797+0000 2024-09-21T01:16:30.231 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2946963019 2024-09-22T01:04:28.140797+0000 2024-09-21T01:16:30.231 INFO:teuthology.orchestra.run.smithi148.stderr:listed 10 entries 2024-09-21T01:16:30.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.230+0000 7fa3d699d640 1 -- 172.21.15.148:0/3995967874 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa3bc0b6540 msgr2=0x7fa3bc0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.230+0000 7fa3d699d640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa3bc0b6540 0x7fa3bc0b8a50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00abe0 tx=0x7fa3cc00a2d0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.230+0000 7fa3d699d640 1 -- 172.21.15.148:0/3995967874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3d01092d0 msgr2=0x7fa3d019a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.230+0000 7fa3d699d640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3d01092d0 0x7fa3d019a890 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa3c002a930 tx=0x7fa3c0004270 comp rx=0 tx=0).stop 2024-09-21T01:16:30.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.230+0000 7fa3d699d640 1 -- 172.21.15.148:0/3995967874 shutdown_connections 2024-09-21T01:16:30.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.230+0000 7fa3d699d640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fa3bc0b6540 0x7fa3bc0b8a50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.230+0000 7fa3d699d640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3d01092d0 0x7fa3d019a890 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.231+0000 7fa3d699d640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3d0109c20 0x7fa3d019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.231+0000 7fa3d699d640 1 --2- 172.21.15.148:0/3995967874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3d0103990 0x7fa3d019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.231+0000 7fa3d699d640 1 -- 172.21.15.148:0/3995967874 >> 172.21.15.148:0/3995967874 conn(0x7fa3d00ff3e0 msgr2=0x7fa3d0101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:30.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.231+0000 7fa3d699d640 1 -- 172.21.15.148:0/3995967874 shutdown_connections 2024-09-21T01:16:30.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:30.231+0000 7fa3d699d640 1 -- 172.21.15.148:0/3995967874 wait complete. 2024-09-21T01:16:30.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:30 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/3995967874' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:16:30.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:30 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/3995967874' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:16:30.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:30 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/3995967874' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:16:30.957 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T01:16:30.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:16:30.957 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T01:16:31.000 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T01:16:31.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:16:31.000 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T01:16:31.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:16:31.063 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-09-21T01:16:31.119 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T01:16:31.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:16:31.120 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:16:31.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:16:31.185 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2024-09-21T01:16:31.288 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T01:16:31.299 INFO:tasks.cephadm:Teardown begin 2024-09-21T01:16:31.299 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T01:16:31.300 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:16:31.550 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:31.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:31 smithi148 ceph-mon[31000]: pgmap v414: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-09-21T01:16:31.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:31 smithi181 ceph-mon[34811]: pgmap v414: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-09-21T01:16:31.743 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:31 smithi157 ceph-mon[34140]: pgmap v414: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5.0 MiB/s wr, 12 op/s 2024-09-21T01:16:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.040+0000 7f20df919640 1 -- 172.21.15.148:0/3973175559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20d8107b70 msgr2=0x7f20d8107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.040+0000 7f20df919640 1 --2- 172.21.15.148:0/3973175559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20d8107b70 0x7f20d8107f80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009900 tx=0x7f20c802a410 comp rx=0 tx=0).stop 2024-09-21T01:16:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.040+0000 7f20df919640 1 -- 172.21.15.148:0/3973175559 shutdown_connections 2024-09-21T01:16:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.040+0000 7f20df919640 1 --2- 172.21.15.148:0/3973175559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20d8107b70 0x7f20d8107f80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.040+0000 7f20df919640 1 --2- 172.21.15.148:0/3973175559 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d81084c0 0x7f20d810ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.040+0000 7f20df919640 1 --2- 172.21.15.148:0/3973175559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d8102230 0x7f20d8102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.040+0000 7f20df919640 1 -- 172.21.15.148:0/3973175559 >> 172.21.15.148:0/3973175559 conn(0x7f20d8079e40 msgr2=0x7f20d807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.040+0000 7f20df919640 1 -- 172.21.15.148:0/3973175559 shutdown_connections 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.040+0000 7f20df919640 1 -- 172.21.15.148:0/3973175559 wait complete. 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.040+0000 7f20df919640 1 Processor -- start 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20df919640 1 -- start start 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20df919640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20d8102230 0x7f20d8199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20df919640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d8107b70 0x7f20d8199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20df919640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d81084c0 0x7f20d819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20df919640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f20d81121a0 con 0x7f20d8102230 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20df919640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f20d8112020 con 0x7f20d8107b70 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20df919640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f20d8112320 con 0x7f20d81084c0 2024-09-21T01:16:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dd6b5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20d8102230 0x7f20d8199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dd6b5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20d8102230 0x7f20d8199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33444/0 (socket says 172.21.15.148:33444) 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dd6b5640 1 -- 172.21.15.148:0/132169937 learned_addr learned my addr 172.21.15.148:0/132169937 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20ddeb6640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d81084c0 0x7f20d819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dceb4640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d8107b70 0x7f20d8199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dd6b5640 1 -- 172.21.15.148:0/132169937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d81084c0 msgr2=0x7f20d819ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dd6b5640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d81084c0 0x7f20d819ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dd6b5640 1 -- 172.21.15.148:0/132169937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d8107b70 msgr2=0x7f20d8199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dd6b5640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d8107b70 0x7f20d8199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dd6b5640 1 -- 172.21.15.148:0/132169937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d819f3b0 con 0x7f20d8102230 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20ddeb6640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d81084c0 0x7f20d819ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dceb4640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d8107b70 0x7f20d8199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.041+0000 7f20dd6b5640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20d8102230 0x7f20d8199470 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f20d400b4a0 tx=0x7f20d400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.042+0000 7f20ce7fc640 1 -- 172.21.15.148:0/132169937 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d4014070 con 0x7f20d8102230 2024-09-21T01:16:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.042+0000 7f20df919640 1 -- 172.21.15.148:0/132169937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d819f6a0 con 0x7f20d8102230 2024-09-21T01:16:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.042+0000 7f20ce7fc640 1 -- 172.21.15.148:0/132169937 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20d4010ac0 con 0x7f20d8102230 2024-09-21T01:16:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.042+0000 7f20ce7fc640 1 -- 172.21.15.148:0/132169937 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d4017c20 con 0x7f20d8102230 2024-09-21T01:16:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.042+0000 7f20df919640 1 -- 172.21.15.148:0/132169937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d8105980 con 0x7f20d8102230 2024-09-21T01:16:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.043+0000 7f20df919640 1 -- 172.21.15.148:0/132169937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d8102640 con 0x7f20d8102230 2024-09-21T01:16:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.044+0000 7f20ce7fc640 1 -- 172.21.15.148:0/132169937 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f20d4017070 con 0x7f20d8102230 2024-09-21T01:16:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.045+0000 7f20ce7fc640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f20c40b6590 0x7f20c40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.046+0000 7f20dceb4640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f20c40b6590 0x7f20c40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.046+0000 7f20ce7fc640 1 -- 172.21.15.148:0/132169937 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f20d40e69a0 con 0x7f20d8102230 2024-09-21T01:16:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.046+0000 7f20dceb4640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f20c40b6590 0x7f20c40b8aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f20c8000c00 tx=0x7f20c8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.049+0000 7f20ce7fc640 1 -- 172.21.15.148:0/132169937 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20d40ad240 con 0x7f20d8102230 2024-09-21T01:16:32.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.263+0000 7f20df919640 1 -- 172.21.15.148:0/132169937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20d819a5a0 con 0x7f20d8102230 2024-09-21T01:16:32.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.263+0000 7f20ce7fc640 1 -- 172.21.15.148:0/132169937 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11928 (secure 0 0 0) 0x7f20d40b1620 con 0x7f20d8102230 2024-09-21T01:16:32.265 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:16:32.265 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":26,"btime":"2024-09-21T01:16:09:341424+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:16:08.658965+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24631,24646,24665]},"id":1}]} 2024-09-21T01:16:32.266 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 26 2024-09-21T01:16:32.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.265+0000 7f20df919640 1 -- 172.21.15.148:0/132169937 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f20c40b6590 msgr2=0x7f20c40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:32.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.265+0000 7f20df919640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f20c40b6590 0x7f20c40b8aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f20c8000c00 tx=0x7f20c8031400 comp rx=0 tx=0).stop 2024-09-21T01:16:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.265+0000 7f20df919640 1 -- 172.21.15.148:0/132169937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20d8102230 msgr2=0x7f20d8199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.265+0000 7f20df919640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20d8102230 0x7f20d8199470 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f20d400b4a0 tx=0x7f20d400b960 comp rx=0 tx=0).stop 2024-09-21T01:16:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.265+0000 7f20df919640 1 -- 172.21.15.148:0/132169937 shutdown_connections 2024-09-21T01:16:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.266+0000 7f20df919640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f20c40b6590 0x7f20c40b8aa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.266+0000 7f20df919640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20d81084c0 0x7f20d819ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.266+0000 7f20df919640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d8107b70 0x7f20d8199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.266+0000 7f20df919640 1 --2- 172.21.15.148:0/132169937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20d8102230 0x7f20d8199470 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.266+0000 7f20df919640 1 -- 172.21.15.148:0/132169937 >> 172.21.15.148:0/132169937 conn(0x7f20d8079e40 msgr2=0x7f20d8100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.266+0000 7f20df919640 1 -- 172.21.15.148:0/132169937 shutdown_connections 2024-09-21T01:16:32.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:32.266+0000 7f20df919640 1 -- 172.21.15.148:0/132169937 wait complete. 2024-09-21T01:16:32.613 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:32 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/132169937' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:32.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:32 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/132169937' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:32.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:32 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/132169937' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:33.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:16:33.289 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:33.683 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:33 smithi148 ceph-mon[31000]: pgmap v415: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-09-21T01:16:33.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:33 smithi181 ceph-mon[34811]: pgmap v415: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-09-21T01:16:33.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:33 smithi157 ceph-mon[34140]: pgmap v415: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.0 MiB/s wr, 11 op/s 2024-09-21T01:16:33.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.771+0000 7f0784ce8640 1 -- 172.21.15.148:0/3906181908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0780109e30 msgr2=0x7f0780110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:33.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.771+0000 7f0784ce8640 1 --2- 172.21.15.148:0/3906181908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0780109e30 0x7f0780110660 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0778009900 tx=0x7f077802a410 comp rx=0 tx=0).stop 2024-09-21T01:16:33.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.771+0000 7f0784ce8640 1 -- 172.21.15.148:0/3906181908 shutdown_connections 2024-09-21T01:16:33.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.771+0000 7f0784ce8640 1 --2- 172.21.15.148:0/3906181908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0780109e30 0x7f0780110660 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:33.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.771+0000 7f0784ce8640 1 --2- 172.21.15.148:0/3906181908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07801094e0 0x7f07801098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:33.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.771+0000 7f0784ce8640 1 --2- 172.21.15.148:0/3906181908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0780103ba0 0x7f0780103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:33.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.771+0000 7f0784ce8640 1 -- 172.21.15.148:0/3906181908 >> 172.21.15.148:0/3906181908 conn(0x7f07800ff630 msgr2=0x7f0780101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:33.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.771+0000 7f0784ce8640 1 -- 172.21.15.148:0/3906181908 shutdown_connections 2024-09-21T01:16:33.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.771+0000 7f0784ce8640 1 -- 172.21.15.148:0/3906181908 wait complete. 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.772+0000 7f0784ce8640 1 Processor -- start 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.772+0000 7f0784ce8640 1 -- start start 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.772+0000 7f0784ce8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0780103ba0 0x7f0780075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f0784ce8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07801094e0 0x7f0780075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f0784ce8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0780109e30 0x7f0780076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f0784ce8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0780113bb0 con 0x7f07801094e0 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f0784ce8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0780113a30 con 0x7f0780109e30 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f0784ce8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0780113d30 con 0x7f0780103ba0 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077dd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07801094e0 0x7f0780075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077dd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07801094e0 0x7f0780075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33462/0 (socket says 172.21.15.148:33462) 2024-09-21T01:16:33.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077dd9b640 1 -- 172.21.15.148:0/266993113 learned_addr learned my addr 172.21.15.148:0/266993113 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077e59c640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0780103ba0 0x7f0780075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077ed9d640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0780109e30 0x7f0780076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077dd9b640 1 -- 172.21.15.148:0/266993113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0780103ba0 msgr2=0x7f0780075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077dd9b640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0780103ba0 0x7f0780075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077dd9b640 1 -- 172.21.15.148:0/266993113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0780109e30 msgr2=0x7f0780076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077dd9b640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0780109e30 0x7f0780076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077dd9b640 1 -- 172.21.15.148:0/266993113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07801a8860 con 0x7f07801094e0 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077ed9d640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0780109e30 0x7f0780076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f077dd9b640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07801094e0 0x7f0780075c50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0774006fd0 tx=0x7f077400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f076f7fe640 1 -- 172.21.15.148:0/266993113 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0774011830 con 0x7f07801094e0 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f076f7fe640 1 -- 172.21.15.148:0/266993113 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0774016070 con 0x7f07801094e0 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f076f7fe640 1 -- 172.21.15.148:0/266993113 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0774010e00 con 0x7f07801094e0 2024-09-21T01:16:33.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.773+0000 7f0784ce8640 1 -- 172.21.15.148:0/266993113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07801a8b50 con 0x7f07801094e0 2024-09-21T01:16:33.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.774+0000 7f0784ce8640 1 -- 172.21.15.148:0/266993113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07801a9040 con 0x7f07801094e0 2024-09-21T01:16:33.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.774+0000 7f0784ce8640 1 -- 172.21.15.148:0/266993113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0780104030 con 0x7f07801094e0 2024-09-21T01:16:33.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.776+0000 7f076f7fe640 1 -- 172.21.15.148:0/266993113 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f07740119d0 con 0x7f07801094e0 2024-09-21T01:16:33.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.777+0000 7f076f7fe640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f07680b6510 0x7f07680b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:33.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.777+0000 7f077e59c640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f07680b6510 0x7f07680b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:33.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.777+0000 7f076f7fe640 1 -- 172.21.15.148:0/266993113 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f07740e6f00 con 0x7f07801094e0 2024-09-21T01:16:33.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.777+0000 7f077e59c640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f07680b6510 0x7f07680b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0780077160 tx=0x7f077000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:33.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.780+0000 7f076f7fe640 1 -- 172.21.15.148:0/266993113 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07740ad7a0 con 0x7f07801094e0 2024-09-21T01:16:33.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.993+0000 7f0784ce8640 1 -- 172.21.15.148:0/266993113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0780076a10 con 0x7f07801094e0 2024-09-21T01:16:33.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.994+0000 7f076f7fe640 1 -- 172.21.15.148:0/266993113 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11928 (secure 0 0 0) 0x7f0780076a10 con 0x7f07801094e0 2024-09-21T01:16:33.996 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:16:33.996 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":26,"btime":"2024-09-21T01:16:09:341424+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14715,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4022731495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4022731495},{"type":"v1","addr":"172.21.15.148:6835","nonce":4022731495}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/540984210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":540984210},{"type":"v1","addr":"172.21.15.148:6837","nonce":540984210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/1439710769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":1439710769},{"type":"v1","addr":"172.21.15.148:6839","nonce":1439710769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/3203788018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":3203788018},{"type":"v1","addr":"172.21.15.148:6841","nonce":3203788018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1970203304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1970203304},{"type":"v1","addr":"172.21.15.157:6833","nonce":1970203304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/791050985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":791050985},{"type":"v1","addr":"172.21.15.181:6833","nonce":791050985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:12:11.894283+0000","modified":"2024-09-21T01:16:08.658965+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24646,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/2996859376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2996859376},{"type":"v1","addr":"172.21.15.157:6835","nonce":2996859376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/685827281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":685827281},{"type":"v1","addr":"172.21.15.181:6835","nonce":685827281}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/3732138486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":3732138486},{"type":"v1","addr":"172.21.15.157:6837","nonce":3732138486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6837/3446561094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3446561094},{"type":"v1","addr":"172.21.15.181:6837","nonce":3446561094}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24646":{"gid":24646,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6839/2036386246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":2036386246},{"type":"v1","addr":"172.21.15.181:6839","nonce":2036386246}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6839/762884269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":762884269},{"type":"v1","addr":"172.21.15.157:6839","nonce":762884269}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24631,24646,24665]},"id":1}]} 2024-09-21T01:16:33.996 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 26 2024-09-21T01:16:33.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 -- 172.21.15.148:0/266993113 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f07680b6510 msgr2=0x7f07680b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:33.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f07680b6510 0x7f07680b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0780077160 tx=0x7f077000d040 comp rx=0 tx=0).stop 2024-09-21T01:16:33.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 -- 172.21.15.148:0/266993113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07801094e0 msgr2=0x7f0780075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:33.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07801094e0 0x7f0780075c50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0774006fd0 tx=0x7f077400b8e0 comp rx=0 tx=0).stop 2024-09-21T01:16:33.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 -- 172.21.15.148:0/266993113 shutdown_connections 2024-09-21T01:16:33.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f07680b6510 0x7f07680b8a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:33.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07801094e0 0x7f0780075c50 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:33.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0780109e30 0x7f0780076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:33.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 --2- 172.21.15.148:0/266993113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0780103ba0 0x7f0780075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:33.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 -- 172.21.15.148:0/266993113 >> 172.21.15.148:0/266993113 conn(0x7f07800ff630 msgr2=0x7f0780101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:33.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.996+0000 7f0784ce8640 1 -- 172.21.15.148:0/266993113 shutdown_connections 2024-09-21T01:16:33.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:33.997+0000 7f0784ce8640 1 -- 172.21.15.148:0/266993113 wait complete. 2024-09-21T01:16:34.579 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:34 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/266993113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:34.607 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:16:34.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:34 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/266993113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:34.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:34 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/266993113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:34.856 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.315+0000 7fb5e8782640 1 -- 172.21.15.148:0/3664785904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e0102ad0 msgr2=0x7fb5e0102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.315+0000 7fb5e8782640 1 --2- 172.21.15.148:0/3664785904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e0102ad0 0x7fb5e0102ee0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009900 tx=0x7fb5dc02a410 comp rx=0 tx=0).stop 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.315+0000 7fb5e8782640 1 -- 172.21.15.148:0/3664785904 shutdown_connections 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.315+0000 7fb5e8782640 1 --2- 172.21.15.148:0/3664785904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e0108d10 0x7fb5e010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.315+0000 7fb5e8782640 1 --2- 172.21.15.148:0/3664785904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e01083c0 0x7fb5e01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.315+0000 7fb5e8782640 1 --2- 172.21.15.148:0/3664785904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e0102ad0 0x7fb5e0102ee0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.315+0000 7fb5e8782640 1 -- 172.21.15.148:0/3664785904 >> 172.21.15.148:0/3664785904 conn(0x7fb5e00796d0 msgr2=0x7fb5e0079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.315+0000 7fb5e8782640 1 -- 172.21.15.148:0/3664785904 shutdown_connections 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.315+0000 7fb5e8782640 1 -- 172.21.15.148:0/3664785904 wait complete. 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e8782640 1 Processor -- start 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e8782640 1 -- start start 2024-09-21T01:16:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e8782640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e0102ad0 0x7fb5e019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e8782640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e01083c0 0x7fb5e019b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e8782640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e0108d10 0x7fb5e019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e8782640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e01129d0 con 0x7fb5e01083c0 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e8782640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e0112850 con 0x7fb5e0102ad0 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e8782640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e0112b50 con 0x7fb5e0108d10 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e651e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e0102ad0 0x7fb5e019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e5d1d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e01083c0 0x7fb5e019b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e651e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e0102ad0 0x7fb5e019b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:32842/0 (socket says 172.21.15.148:32842) 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e651e640 1 -- 172.21.15.148:0/1504252697 learned_addr learned my addr 172.21.15.148:0/1504252697 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e6d1f640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e0108d10 0x7fb5e019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e6d1f640 1 -- 172.21.15.148:0/1504252697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e0102ad0 msgr2=0x7fb5e019b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e6d1f640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e0102ad0 0x7fb5e019b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e6d1f640 1 -- 172.21.15.148:0/1504252697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e01083c0 msgr2=0x7fb5e019b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e6d1f640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e01083c0 0x7fb5e019b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e6d1f640 1 -- 172.21.15.148:0/1504252697 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e01a65b0 con 0x7fb5e0108d10 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.316+0000 7fb5e5d1d640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e01083c0 0x7fb5e019b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.317+0000 7fb5e6d1f640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e0108d10 0x7fb5e019bd20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800da10 tx=0x7fb5d800ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.317+0000 7fb5d77fe640 1 -- 172.21.15.148:0/1504252697 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800bd70 con 0x7fb5e0108d10 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.317+0000 7fb5e8782640 1 -- 172.21.15.148:0/1504252697 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e01a68a0 con 0x7fb5e0108d10 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.317+0000 7fb5d77fe640 1 -- 172.21.15.148:0/1504252697 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5d8003e20 con 0x7fb5e0108d10 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.317+0000 7fb5d77fe640 1 -- 172.21.15.148:0/1504252697 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d80106c0 con 0x7fb5e0108d10 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.317+0000 7fb5e8782640 1 -- 172.21.15.148:0/1504252697 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e01a6de0 con 0x7fb5e0108d10 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.318+0000 7fb5e8782640 1 -- 172.21.15.148:0/1504252697 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e0103d00 con 0x7fb5e0108d10 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.320+0000 7fb5d77fe640 1 -- 172.21.15.148:0/1504252697 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7fb5d8004270 con 0x7fb5e0108d10 2024-09-21T01:16:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.320+0000 7fb5d77fe640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5cc0b6510 0x7fb5cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:35.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.320+0000 7fb5e651e640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5cc0b6510 0x7fb5cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:35.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.321+0000 7fb5d77fe640 1 -- 172.21.15.148:0/1504252697 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7fb5d80e7a50 con 0x7fb5e0108d10 2024-09-21T01:16:35.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.321+0000 7fb5e651e640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5cc0b6510 0x7fb5cc0b8a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009230 tx=0x7fb5dc0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:35.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.324+0000 7fb5d77fe640 1 -- 172.21.15.148:0/1504252697 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5d80ae2f0 con 0x7fb5e0108d10 2024-09-21T01:16:35.509 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:35 smithi148 ceph-mon[31000]: pgmap v416: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T01:16:35.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.508+0000 7fb5e8782640 1 -- 172.21.15.148:0/1504252697 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5e0102ee0 con 0x7fb5e0108d10 2024-09-21T01:16:35.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.509+0000 7fb5d77fe640 1 -- 172.21.15.148:0/1504252697 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22837 (secure 0 0 0) 0x7fb5e0102ee0 con 0x7fb5e0108d10 2024-09-21T01:16:35.510 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T01:16:35.511 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":76,"fsid":"3872f802-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:04:06.062226+0000","modified":"2024-09-21T01:12:55.664651+0000","last_up_change":"2024-09-21T01:11:23.325292+0000","last_in_change":"2024-09-21T01:11:00.576048+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:07:42.541158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:12:07.562738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:12:09.877690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1e35550a-2857-479e-9465-d64c90a2f2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6803","nonce":2331338222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6805","nonce":2331338222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6809","nonce":2331338222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2331338222},{"type":"v1","addr":"172.21.15.148:6807","nonce":2331338222}]},"public_addr":"172.21.15.148:6803/2331338222","cluster_addr":"172.21.15.148:6805/2331338222","heartbeat_back_addr":"172.21.15.148:6809/2331338222","heartbeat_front_addr":"172.21.15.148:6807/2331338222","state":["exists","up"]},{"osd":1,"uuid":"a2d43be5-822d-4353-bb16-35d6d61e9488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6801","nonce":2914779788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6803","nonce":2914779788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6807","nonce":2914779788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2914779788},{"type":"v1","addr":"172.21.15.157:6805","nonce":2914779788}]},"public_addr":"172.21.15.157:6801/2914779788","cluster_addr":"172.21.15.157:6803/2914779788","heartbeat_back_addr":"172.21.15.157:6807/2914779788","heartbeat_front_addr":"172.21.15.157:6805/2914779788","state":["exists","up"]},{"osd":2,"uuid":"c23db819-7af8-4b21-9a9b-8ff53251d19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6801","nonce":3636676499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6803","nonce":3636676499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6807","nonce":3636676499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3636676499},{"type":"v1","addr":"172.21.15.181:6805","nonce":3636676499}]},"public_addr":"172.21.15.181:6801/3636676499","cluster_addr":"172.21.15.181:6803/3636676499","heartbeat_back_addr":"172.21.15.181:6807/3636676499","heartbeat_front_addr":"172.21.15.181:6805/3636676499","state":["exists","up"]},{"osd":3,"uuid":"09b1f0c6-d745-4a7f-af0b-e27ba52e188c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6811","nonce":2214807650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6813","nonce":2214807650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6817","nonce":2214807650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":2214807650},{"type":"v1","addr":"172.21.15.148:6815","nonce":2214807650}]},"public_addr":"172.21.15.148:6811/2214807650","cluster_addr":"172.21.15.148:6813/2214807650","heartbeat_back_addr":"172.21.15.148:6817/2214807650","heartbeat_front_addr":"172.21.15.148:6815/2214807650","state":["exists","up"]},{"osd":4,"uuid":"65e3c06a-76f8-4b6d-8856-4e956f2117d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6809","nonce":3232117147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6811","nonce":3232117147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6815","nonce":3232117147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3232117147},{"type":"v1","addr":"172.21.15.157:6813","nonce":3232117147}]},"public_addr":"172.21.15.157:6809/3232117147","cluster_addr":"172.21.15.157:6811/3232117147","heartbeat_back_addr":"172.21.15.157:6815/3232117147","heartbeat_front_addr":"172.21.15.157:6813/3232117147","state":["exists","up"]},{"osd":5,"uuid":"25df0d7b-fd64-493b-8bfd-b2c5cde2cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6809","nonce":1383691858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6811","nonce":1383691858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6815","nonce":1383691858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1383691858},{"type":"v1","addr":"172.21.15.181:6813","nonce":1383691858}]},"public_addr":"172.21.15.181:6809/1383691858","cluster_addr":"172.21.15.181:6811/1383691858","heartbeat_back_addr":"172.21.15.181:6815/1383691858","heartbeat_front_addr":"172.21.15.181:6813/1383691858","state":["exists","up"]},{"osd":6,"uuid":"f1846682-e854-4fd3-9b8e-6a390dcdf5b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6819","nonce":2007504486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6821","nonce":2007504486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6825","nonce":2007504486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2007504486},{"type":"v1","addr":"172.21.15.148:6823","nonce":2007504486}]},"public_addr":"172.21.15.148:6819/2007504486","cluster_addr":"172.21.15.148:6821/2007504486","heartbeat_back_addr":"172.21.15.148:6825/2007504486","heartbeat_front_addr":"172.21.15.148:6823/2007504486","state":["exists","up"]},{"osd":7,"uuid":"0b053ed6-f9b4-4f89-ade9-4288c71f105f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6817","nonce":1505346368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6819","nonce":1505346368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6823","nonce":1505346368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1505346368},{"type":"v1","addr":"172.21.15.157:6821","nonce":1505346368}]},"public_addr":"172.21.15.157:6817/1505346368","cluster_addr":"172.21.15.157:6819/1505346368","heartbeat_back_addr":"172.21.15.157:6823/1505346368","heartbeat_front_addr":"172.21.15.157:6821/1505346368","state":["exists","up"]},{"osd":8,"uuid":"98ad5627-aac2-47e2-a3c0-e09529875c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6817","nonce":1103366396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6819","nonce":1103366396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6823","nonce":1103366396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1103366396},{"type":"v1","addr":"172.21.15.181:6821","nonce":1103366396}]},"public_addr":"172.21.15.181:6817/1103366396","cluster_addr":"172.21.15.181:6819/1103366396","heartbeat_back_addr":"172.21.15.181:6823/1103366396","heartbeat_front_addr":"172.21.15.181:6821/1103366396","state":["exists","up"]},{"osd":9,"uuid":"491086e1-cbc8-4904-bfeb-81cfa2b27b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6827","nonce":1373400085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6829","nonce":1373400085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6833","nonce":1373400085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1373400085},{"type":"v1","addr":"172.21.15.148:6831","nonce":1373400085}]},"public_addr":"172.21.15.148:6827/1373400085","cluster_addr":"172.21.15.148:6829/1373400085","heartbeat_back_addr":"172.21.15.148:6833/1373400085","heartbeat_front_addr":"172.21.15.148:6831/1373400085","state":["exists","up"]},{"osd":10,"uuid":"a9e9086f-2176-415b-ae99-ad3fbf5e3698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6825","nonce":3455888690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6827","nonce":3455888690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6831","nonce":3455888690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3455888690},{"type":"v1","addr":"172.21.15.157:6829","nonce":3455888690}]},"public_addr":"172.21.15.157:6825/3455888690","cluster_addr":"172.21.15.157:6827/3455888690","heartbeat_back_addr":"172.21.15.157:6831/3455888690","heartbeat_front_addr":"172.21.15.157:6829/3455888690","state":["exists","up"]},{"osd":11,"uuid":"4bcfec34-f542-4554-8fb2-d05eb39e1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6825","nonce":2872762977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6827","nonce":2872762977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6831","nonce":2872762977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":2872762977},{"type":"v1","addr":"172.21.15.181:6829","nonce":2872762977}]},"public_addr":"172.21.15.181:6825/2872762977","cluster_addr":"172.21.15.181:6827/2872762977","heartbeat_back_addr":"172.21.15.181:6831/2872762977","heartbeat_front_addr":"172.21.15.181:6829/2872762977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:06:47.793739+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:13.415669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:07:38.943333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:03.980112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:28.872102+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:53.200642+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:19.359688+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:44.083656+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:07.916840+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:33.102060+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:57.508983+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:21.819625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/745630392":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/1864845687":"2024-09-22T01:04:54.215776+0000","172.21.15.148:6801/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/3851857915":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1638470562":"2024-09-22T01:04:28.140797+0000","172.21.15.148:6800/1196614580":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/3953192821":"2024-09-22T01:04:54.215776+0000","172.21.15.148:0/2712136637":"2024-09-22T01:04:28.140797+0000","172.21.15.148:0/2946963019":"2024-09-22T01:04:28.140797+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 -- 172.21.15.148:0/1504252697 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5cc0b6510 msgr2=0x7fb5cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5cc0b6510 0x7fb5cc0b8a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009230 tx=0x7fb5dc0058d0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 -- 172.21.15.148:0/1504252697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e0108d10 msgr2=0x7fb5e019bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e0108d10 0x7fb5e019bd20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800da10 tx=0x7fb5d800ded0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 -- 172.21.15.148:0/1504252697 shutdown_connections 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7fb5cc0b6510 0x7fb5cc0b8a20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e01083c0 0x7fb5e019b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e0108d10 0x7fb5e019bd20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 --2- 172.21.15.148:0/1504252697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e0102ad0 0x7fb5e019b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 -- 172.21.15.148:0/1504252697 >> 172.21.15.148:0/1504252697 conn(0x7fb5e00796d0 msgr2=0x7fb5e0106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 -- 172.21.15.148:0/1504252697 shutdown_connections 2024-09-21T01:16:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:35.512+0000 7fb5e8782640 1 -- 172.21.15.148:0/1504252697 wait complete. 2024-09-21T01:16:35.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:35 smithi181 ceph-mon[34811]: pgmap v416: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T01:16:35.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:35 smithi157 ceph-mon[34140]: pgmap v416: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T01:16:36.210 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T01:16:36.458 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:36.734 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:36 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/1504252697' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:16:36.740 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:36 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/1504252697' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:16:36.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.974+0000 7f5e7e96f640 1 -- 172.21.15.148:0/819540029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e781083a0 msgr2=0x7f5e781087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:36.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.974+0000 7f5e7e96f640 1 --2- 172.21.15.148:0/819540029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e781083a0 0x7f5e781087b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009900 tx=0x7f5e6c02a410 comp rx=0 tx=0).stop 2024-09-21T01:16:36.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.974+0000 7f5e7e96f640 1 -- 172.21.15.148:0/819540029 shutdown_connections 2024-09-21T01:16:36.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.974+0000 7f5e7e96f640 1 --2- 172.21.15.148:0/819540029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e781083a0 0x7f5e781087b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:36.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.974+0000 7f5e7e96f640 1 --2- 172.21.15.148:0/819540029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e78108cf0 0x7f5e7810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:36.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.974+0000 7f5e7e96f640 1 --2- 172.21.15.148:0/819540029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e78102a60 0x7f5e78102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:36.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.974+0000 7f5e7e96f640 1 -- 172.21.15.148:0/819540029 >> 172.21.15.148:0/819540029 conn(0x7f5e78079730 msgr2=0x7f5e78079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:36.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.974+0000 7f5e7e96f640 1 -- 172.21.15.148:0/819540029 shutdown_connections 2024-09-21T01:16:36.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.974+0000 7f5e7e96f640 1 -- 172.21.15.148:0/819540029 wait complete. 2024-09-21T01:16:36.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e7e96f640 1 Processor -- start 2024-09-21T01:16:36.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e7e96f640 1 -- start start 2024-09-21T01:16:36.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e7e96f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e78102a60 0x7f5e78199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:36.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e7e96f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e781083a0 0x7f5e781998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:36.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e7e96f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e78108cf0 0x7f5e7819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:36.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e7e96f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5e78112960 con 0x7f5e781083a0 2024-09-21T01:16:36.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e7e96f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5e781127e0 con 0x7f5e78102a60 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e7e96f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5e78112ae0 con 0x7f5e78108cf0 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e777fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e781083a0 0x7f5e781998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e777fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e781083a0 0x7f5e781998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56016/0 (socket says 172.21.15.148:56016) 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.975+0000 7f5e777fe640 1 -- 172.21.15.148:0/328696503 learned_addr learned my addr 172.21.15.148:0/328696503 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e7cf0c640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e78108cf0 0x7f5e7819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e77fff640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e78102a60 0x7f5e78199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e777fe640 1 -- 172.21.15.148:0/328696503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e78108cf0 msgr2=0x7f5e7819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e777fe640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e78108cf0 0x7f5e7819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e777fe640 1 -- 172.21.15.148:0/328696503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e78102a60 msgr2=0x7f5e78199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e777fe640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e78102a60 0x7f5e78199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e777fe640 1 -- 172.21.15.148:0/328696503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7819f2c0 con 0x7f5e781083a0 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e7cf0c640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e78108cf0 0x7f5e7819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e77fff640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e78102a60 0x7f5e78199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e777fe640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e781083a0 0x7f5e781998f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c032fd0 tx=0x7f5e6c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e757fa640 1 -- 172.21.15.148:0/328696503 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c03f030 con 0x7f5e781083a0 2024-09-21T01:16:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e757fa640 1 -- 172.21.15.148:0/328696503 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e6c004490 con 0x7f5e781083a0 2024-09-21T01:16:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e7e96f640 1 -- 172.21.15.148:0/328696503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7819f550 con 0x7f5e781083a0 2024-09-21T01:16:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e757fa640 1 -- 172.21.15.148:0/328696503 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c035070 con 0x7f5e781083a0 2024-09-21T01:16:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.976+0000 7f5e7e96f640 1 -- 172.21.15.148:0/328696503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7806ae60 con 0x7f5e781083a0 2024-09-21T01:16:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.978+0000 7f5e7e96f640 1 -- 172.21.15.148:0/328696503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e78103ce0 con 0x7f5e781083a0 2024-09-21T01:16:36.980 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:36 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/1504252697' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:16:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.979+0000 7f5e757fa640 1 -- 172.21.15.148:0/328696503 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f5e6c042030 con 0x7f5e781083a0 2024-09-21T01:16:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.979+0000 7f5e757fa640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e600b6510 0x7f5e600b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.980+0000 7f5e757fa640 1 -- 172.21.15.148:0/328696503 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8219+0+0 (secure 0 0 0) 0x7f5e6c1075b0 con 0x7f5e781083a0 2024-09-21T01:16:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.980+0000 7f5e77fff640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e600b6510 0x7f5e600b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.980+0000 7f5e77fff640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e600b6510 0x7f5e600b8a20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5e68005fd0 tx=0x7f5e68005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:36.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:36.984+0000 7f5e757fa640 1 -- 172.21.15.148:0/328696503 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e6c0cde50 con 0x7f5e781083a0 2024-09-21T01:16:37.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.199+0000 7f5e7e96f640 1 -- 172.21.15.148:0/328696503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5e7806b880 con 0x7f5e781083a0 2024-09-21T01:16:37.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.202+0000 7f5e757fa640 1 -- 172.21.15.148:0/328696503 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f5e6c0d2230 con 0x7f5e781083a0 2024-09-21T01:16:37.202 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T01:16:37.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.204+0000 7f5e7e96f640 1 -- 172.21.15.148:0/328696503 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e600b6510 msgr2=0x7f5e600b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.204+0000 7f5e7e96f640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e600b6510 0x7f5e600b8a20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5e68005fd0 tx=0x7f5e68005ea0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.204+0000 7f5e7e96f640 1 -- 172.21.15.148:0/328696503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e781083a0 msgr2=0x7f5e781998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.204+0000 7f5e7e96f640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e781083a0 0x7f5e781998f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c032fd0 tx=0x7f5e6c004270 comp rx=0 tx=0).stop 2024-09-21T01:16:37.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.205+0000 7f5e7e96f640 1 -- 172.21.15.148:0/328696503 shutdown_connections 2024-09-21T01:16:37.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.205+0000 7f5e7e96f640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e600b6510 0x7f5e600b8a20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.205+0000 7f5e7e96f640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e781083a0 0x7f5e781998f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.205+0000 7f5e7e96f640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e78108cf0 0x7f5e7819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.205+0000 7f5e7e96f640 1 --2- 172.21.15.148:0/328696503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e78102a60 0x7f5e78199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.205+0000 7f5e7e96f640 1 -- 172.21.15.148:0/328696503 >> 172.21.15.148:0/328696503 conn(0x7f5e78079730 msgr2=0x7f5e781043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:37.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.205+0000 7f5e7e96f640 1 -- 172.21.15.148:0/328696503 shutdown_connections 2024-09-21T01:16:37.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:37.205+0000 7f5e7e96f640 1 -- 172.21.15.148:0/328696503 wait complete. 2024-09-21T01:16:37.363 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:37 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a[30996]: 2024-09-21T01:16:37.200+0000 7f4404d23640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:16:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mon[34811]: pgmap v417: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T01:16:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/328696503' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:16:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mon[34811]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:16:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mon[34811]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:16:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/328696503' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:16:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mon[34811]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:16:37.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mon[34811]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T01:16:37.731 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i[63930]: ignoring --setuser ceph since I am not root 2024-09-21T01:16:37.731 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i[63930]: ignoring --setgroup ceph since I am not root 2024-09-21T01:16:37.731 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mds[63934]: --2- 172.21.15.181:0/3795572825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565187137180 0x565187d26000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x565187148ba0 tx=0x56518706e480 comp rx=0 tx=0).write_message sending message m=0x565186ffc8c0 seq=3 auth(proto 2 2 bytes epoch 0) 2024-09-21T01:16:37.731 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mds[63934]: -- 172.21.15.181:0/3795572825 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565182f8f860 con 0x565187137180 2024-09-21T01:16:37.731 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i[63930]: starting mds.i at 2024-09-21T01:16:37.731 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c[63663]: ignoring --setuser ceph since I am not root 2024-09-21T01:16:37.732 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c[63663]: ignoring --setgroup ceph since I am not root 2024-09-21T01:16:37.732 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mds[63667]: -- 172.21.15.181:0/2825207409 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e0c9805860 con 0x55e0cd9ada80 2024-09-21T01:16:37.732 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c[63663]: starting mds.c at 2024-09-21T01:16:37.732 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f[63394]: ignoring --setuser ceph since I am not root 2024-09-21T01:16:37.732 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f[63394]: ignoring --setgroup ceph since I am not root 2024-09-21T01:16:37.732 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mds[63398]: -- 172.21.15.181:0/570260821 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564a80314ea0 con 0x564a844b3600 2024-09-21T01:16:37.732 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-mds[63398]: -- 172.21.15.181:0/570260821 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564a8030b860 con 0x564a844b3600 2024-09-21T01:16:37.732 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:16:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f[63394]: starting mds.f at 2024-09-21T01:16:37.740 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e[62018]: ignoring --setuser ceph since I am not root 2024-09-21T01:16:37.740 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e[62018]: ignoring --setgroup ceph since I am not root 2024-09-21T01:16:37.740 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-mds[62022]: -- 172.21.15.157:0/2751090339 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562c49d5d860 con 0x562c4df05180 2024-09-21T01:16:37.740 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e[62018]: starting mds.e at 2024-09-21T01:16:37.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-mon[34140]: pgmap v417: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T01:16:37.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/328696503' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:16:37.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-mon[34140]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:16:37.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-mon[34140]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:16:37.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/328696503' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:16:37.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-mon[34140]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:16:37.741 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-mon[34140]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T01:16:37.741 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b[62559]: ignoring --setuser ceph since I am not root 2024-09-21T01:16:37.741 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b[62559]: ignoring --setgroup ceph since I am not root 2024-09-21T01:16:37.742 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-mds[62563]: -- 172.21.15.157:0/1337239901 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564cc8d69860 con 0x564cccf11a80 2024-09-21T01:16:37.742 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b[62559]: starting mds.b at 2024-09-21T01:16:37.742 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h[62288]: ignoring --setuser ceph since I am not root 2024-09-21T01:16:37.742 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h[62288]: ignoring --setgroup ceph since I am not root 2024-09-21T01:16:37.742 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-mds[62292]: -- 172.21.15.157:0/3499156319 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564fe1bb5860 con 0x564fe5d5d180 2024-09-21T01:16:37.742 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:16:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h[62288]: starting mds.h at 2024-09-21T01:16:37.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:37 smithi148 ceph-mon[31000]: pgmap v417: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T01:16:37.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:37 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/328696503' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:16:37.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:37 smithi148 ceph-mon[31000]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:16:37.839 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:37 smithi148 ceph-mon[31000]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:16:37.839 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:37 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/328696503' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:16:37.839 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:37 smithi148 ceph-mon[31000]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:16:37.839 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:37 smithi148 ceph-mon[31000]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T01:16:37.866 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T01:16:38.112 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:38.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.591+0000 7f5e9b607640 1 -- 172.21.15.148:0/681395117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e94102a80 msgr2=0x7f5e94102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:38.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.591+0000 7f5e9b607640 1 --2- 172.21.15.148:0/681395117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e94102a80 0x7f5e94102e90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009900 tx=0x7f5e9002a410 comp rx=0 tx=0).stop 2024-09-21T01:16:38.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.591+0000 7f5e9b607640 1 -- 172.21.15.148:0/681395117 shutdown_connections 2024-09-21T01:16:38.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.591+0000 7f5e9b607640 1 --2- 172.21.15.148:0/681395117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e94108d10 0x7f5e9410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:38.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.591+0000 7f5e9b607640 1 --2- 172.21.15.148:0/681395117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e941083c0 0x7f5e941087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.591+0000 7f5e9b607640 1 --2- 172.21.15.148:0/681395117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e94102a80 0x7f5e94102e90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.591+0000 7f5e9b607640 1 -- 172.21.15.148:0/681395117 >> 172.21.15.148:0/681395117 conn(0x7f5e94079740 msgr2=0x7f5e94079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.592+0000 7f5e9b607640 1 -- 172.21.15.148:0/681395117 shutdown_connections 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.592+0000 7f5e9b607640 1 -- 172.21.15.148:0/681395117 wait complete. 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.592+0000 7f5e9b607640 1 Processor -- start 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.592+0000 7f5e9b607640 1 -- start start 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.592+0000 7f5e9b607640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e94102a80 0x7f5e9419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.592+0000 7f5e9b607640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e941083c0 0x7f5e9419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.592+0000 7f5e9b607640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e94108d10 0x7f5e9419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.592+0000 7f5e9b607640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5e94112980 con 0x7f5e94102a80 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.592+0000 7f5e9b607640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5e94112800 con 0x7f5e94108d10 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e9b607640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5e94112b00 con 0x7f5e941083c0 2024-09-21T01:16:38.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e993a3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e94102a80 0x7f5e9419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e993a3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e94102a80 0x7f5e9419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56042/0 (socket says 172.21.15.148:56042) 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e993a3640 1 -- 172.21.15.148:0/2506762058 learned_addr learned my addr 172.21.15.148:0/2506762058 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e98ba2640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e941083c0 0x7f5e9419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e99ba4640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e94108d10 0x7f5e9419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e993a3640 1 -- 172.21.15.148:0/2506762058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e941083c0 msgr2=0x7f5e9419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e993a3640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e941083c0 0x7f5e9419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e993a3640 1 -- 172.21.15.148:0/2506762058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e94108d10 msgr2=0x7f5e9419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e993a3640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e94108d10 0x7f5e9419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e993a3640 1 -- 172.21.15.148:0/2506762058 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e941a03f0 con 0x7f5e94102a80 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e98ba2640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e941083c0 0x7f5e9419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e993a3640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e94102a80 0x7f5e9419a480 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5e90005940 tx=0x7f5e900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e8a7fc640 1 -- 172.21.15.148:0/2506762058 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9003f030 con 0x7f5e94102a80 2024-09-21T01:16:38.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e8a7fc640 1 -- 172.21.15.148:0/2506762058 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e90003cb0 con 0x7f5e94102a80 2024-09-21T01:16:38.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e8a7fc640 1 -- 172.21.15.148:0/2506762058 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90035070 con 0x7f5e94102a80 2024-09-21T01:16:38.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e9b607640 1 -- 172.21.15.148:0/2506762058 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e941a0680 con 0x7f5e94102a80 2024-09-21T01:16:38.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.593+0000 7f5e9b607640 1 -- 172.21.15.148:0/2506762058 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e941a6e40 con 0x7f5e94102a80 2024-09-21T01:16:38.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.594+0000 7f5e9b607640 1 -- 172.21.15.148:0/2506762058 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e94103d00 con 0x7f5e94102a80 2024-09-21T01:16:38.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.596+0000 7f5e8a7fc640 1 -- 172.21.15.148:0/2506762058 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f5e90042030 con 0x7f5e94102a80 2024-09-21T01:16:38.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.597+0000 7f5e8a7fc640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e800b6510 0x7f5e800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:38.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.597+0000 7f5e98ba2640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e800b6510 0x7f5e800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:38.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.597+0000 7f5e8a7fc640 1 -- 172.21.15.148:0/2506762058 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8477+0+0 (secure 0 0 0) 0x7f5e90107fc0 con 0x7f5e94102a80 2024-09-21T01:16:38.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.597+0000 7f5e98ba2640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e800b6510 0x7f5e800b8a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5e840058c0 tx=0x7f5e84005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:38.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.600+0000 7f5e8a7fc640 1 -- 172.21.15.148:0/2506762058 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e900ce760 con 0x7f5e94102a80 2024-09-21T01:16:38.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:38.814+0000 7f5e9b607640 1 -- 172.21.15.148:0/2506762058 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5e941a7010 con 0x7f5e94102a80 2024-09-21T01:16:39.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.209+0000 7f5e8a7fc640 1 -- 172.21.15.148:0/2506762058 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f5e900d2b40 con 0x7f5e94102a80 2024-09-21T01:16:39.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.212+0000 7f5e9b607640 1 -- 172.21.15.148:0/2506762058 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e800b6510 msgr2=0x7f5e800b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:39.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.212+0000 7f5e9b607640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e800b6510 0x7f5e800b8a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5e840058c0 tx=0x7f5e84005850 comp rx=0 tx=0).stop 2024-09-21T01:16:39.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.212+0000 7f5e9b607640 1 -- 172.21.15.148:0/2506762058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e94102a80 msgr2=0x7f5e9419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:39.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.212+0000 7f5e9b607640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e94102a80 0x7f5e9419a480 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5e90005940 tx=0x7f5e900042f0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.213+0000 7f5e9b607640 1 -- 172.21.15.148:0/2506762058 shutdown_connections 2024-09-21T01:16:39.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.213+0000 7f5e9b607640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f5e800b6510 0x7f5e800b8a20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.213+0000 7f5e9b607640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e94108d10 0x7f5e9419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.213+0000 7f5e9b607640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e941083c0 0x7f5e9419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.213+0000 7f5e9b607640 1 --2- 172.21.15.148:0/2506762058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e94102a80 0x7f5e9419a480 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.213+0000 7f5e9b607640 1 -- 172.21.15.148:0/2506762058 >> 172.21.15.148:0/2506762058 conn(0x7f5e94079740 msgr2=0x7f5e94101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:39.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.213+0000 7f5e9b607640 1 -- 172.21.15.148:0/2506762058 shutdown_connections 2024-09-21T01:16:39.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:39.213+0000 7f5e9b607640 1 -- 172.21.15.148:0/2506762058 wait complete. 2024-09-21T01:16:39.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.181:6834/2697245401,v1:172.21.15.181:6837/2697245401] up:boot 2024-09-21T01:16:39.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.181:6835/1820372540,v1:172.21.15.181:6838/1820372540] up:boot 2024-09-21T01:16:39.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.181:6836/1211266647,v1:172.21.15.181:6839/1211266647] up:boot 2024-09-21T01:16:39.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.157:6834/1326274042,v1:172.21.15.157:6835/1326274042] up:boot 2024-09-21T01:16:39.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.157:6836/1976703553,v1:172.21.15.157:6837/1976703553] up:boot 2024-09-21T01:16:39.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: mds.? [v2:172.21.15.157:6838/4108306954,v1:172.21.15.157:6839/4108306954] up:boot 2024-09-21T01:16:39.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T01:16:39.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:16:39.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:16:39.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:16:39.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:16:39.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:16:39.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:16:39.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:39 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2506762058' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:16:39.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.181:6834/2697245401,v1:172.21.15.181:6837/2697245401] up:boot 2024-09-21T01:16:39.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.181:6835/1820372540,v1:172.21.15.181:6838/1820372540] up:boot 2024-09-21T01:16:39.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.181:6836/1211266647,v1:172.21.15.181:6839/1211266647] up:boot 2024-09-21T01:16:39.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.157:6834/1326274042,v1:172.21.15.157:6835/1326274042] up:boot 2024-09-21T01:16:39.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.157:6836/1976703553,v1:172.21.15.157:6837/1976703553] up:boot 2024-09-21T01:16:39.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: mds.? [v2:172.21.15.157:6838/4108306954,v1:172.21.15.157:6839/4108306954] up:boot 2024-09-21T01:16:39.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T01:16:39.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:16:39.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:16:39.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:16:39.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:16:39.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:16:39.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:16:39.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:39 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2506762058' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:16:39.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.181:6834/2697245401,v1:172.21.15.181:6837/2697245401] up:boot 2024-09-21T01:16:39.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.181:6835/1820372540,v1:172.21.15.181:6838/1820372540] up:boot 2024-09-21T01:16:39.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.181:6836/1211266647,v1:172.21.15.181:6839/1211266647] up:boot 2024-09-21T01:16:39.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.157:6834/1326274042,v1:172.21.15.157:6835/1326274042] up:boot 2024-09-21T01:16:39.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.157:6836/1976703553,v1:172.21.15.157:6837/1976703553] up:boot 2024-09-21T01:16:39.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: mds.? [v2:172.21.15.157:6838/4108306954,v1:172.21.15.157:6839/4108306954] up:boot 2024-09-21T01:16:39.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T01:16:39.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:16:39.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:16:39.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:16:39.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:16:39.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:16:39.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: from='mgr.14152 172.21.15.148:0/2607125083' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:16:39.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:39 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2506762058' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:16:39.962 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T01:16:40.211 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:40.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:40 smithi148 ceph-mon[31000]: pgmap v419: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 7 op/s 2024-09-21T01:16:40.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:40 smithi148 ceph-mon[31000]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:16:40.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:40 smithi148 ceph-mon[31000]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:16:40.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:40 smithi148 ceph-mon[31000]: Cluster is now healthy 2024-09-21T01:16:40.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:40 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2506762058' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:16:40.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:40 smithi148 ceph-mon[31000]: fsmap 12 up:standby 2024-09-21T01:16:40.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:40 smithi181 ceph-mon[34811]: pgmap v419: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 7 op/s 2024-09-21T01:16:40.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:40 smithi181 ceph-mon[34811]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:16:40.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:40 smithi181 ceph-mon[34811]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:16:40.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:40 smithi181 ceph-mon[34811]: Cluster is now healthy 2024-09-21T01:16:40.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:40 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2506762058' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:16:40.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:40 smithi181 ceph-mon[34811]: fsmap 12 up:standby 2024-09-21T01:16:40.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:40 smithi157 ceph-mon[34140]: pgmap v419: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 7 op/s 2024-09-21T01:16:40.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:40 smithi157 ceph-mon[34140]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:16:40.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:40 smithi157 ceph-mon[34140]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:16:40.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:40 smithi157 ceph-mon[34140]: Cluster is now healthy 2024-09-21T01:16:40.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:40 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2506762058' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:16:40.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:40 smithi157 ceph-mon[34140]: fsmap 12 up:standby 2024-09-21T01:16:40.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.685+0000 7f9c74cd0640 1 -- 172.21.15.148:0/3543031959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c70108dd0 msgr2=0x7f9c7010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:40.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.685+0000 7f9c74cd0640 1 --2- 172.21.15.148:0/3543031959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c70108dd0 0x7f9c7010f600 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009ca0 tx=0x7f9c6802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:16:40.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.686+0000 7f9c74cd0640 1 -- 172.21.15.148:0/3543031959 shutdown_connections 2024-09-21T01:16:40.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.686+0000 7f9c74cd0640 1 --2- 172.21.15.148:0/3543031959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c70108dd0 0x7f9c7010f600 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:40.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.686+0000 7f9c74cd0640 1 --2- 172.21.15.148:0/3543031959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c70108480 0x7f9c70108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:40.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.686+0000 7f9c74cd0640 1 --2- 172.21.15.148:0/3543031959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c70102b40 0x7f9c70102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:40.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.686+0000 7f9c74cd0640 1 -- 172.21.15.148:0/3543031959 >> 172.21.15.148:0/3543031959 conn(0x7f9c70079750 msgr2=0x7f9c70079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:40.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.686+0000 7f9c74cd0640 1 -- 172.21.15.148:0/3543031959 shutdown_connections 2024-09-21T01:16:40.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.686+0000 7f9c74cd0640 1 -- 172.21.15.148:0/3543031959 wait complete. 2024-09-21T01:16:40.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.686+0000 7f9c74cd0640 1 Processor -- start 2024-09-21T01:16:40.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c74cd0640 1 -- start start 2024-09-21T01:16:40.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c74cd0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c70102b40 0x7f9c70199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:40.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c74cd0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c70108480 0x7f9c70199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:40.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c74cd0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c70108dd0 0x7f9c7019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:40.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c74cd0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701129a0 con 0x7f9c70108dd0 2024-09-21T01:16:40.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c74cd0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70112820 con 0x7f9c70108480 2024-09-21T01:16:40.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c74cd0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70112b20 con 0x7f9c70102b40 2024-09-21T01:16:40.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c6ed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c70108dd0 0x7f9c7019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c6ed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c70108dd0 0x7f9c7019ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56064/0 (socket says 172.21.15.148:56064) 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c6ed9d640 1 -- 172.21.15.148:0/797664629 learned_addr learned my addr 172.21.15.148:0/797664629 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c6dd9b640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c70108480 0x7f9c70199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c6e59c640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c70102b40 0x7f9c70199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c6ed9d640 1 -- 172.21.15.148:0/797664629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c70102b40 msgr2=0x7f9c70199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c6ed9d640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c70102b40 0x7f9c70199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c6ed9d640 1 -- 172.21.15.148:0/797664629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c70108480 msgr2=0x7f9c70199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c6ed9d640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c70108480 0x7f9c70199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.687+0000 7f9c6ed9d640 1 -- 172.21.15.148:0/797664629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7019f240 con 0x7f9c70108dd0 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.688+0000 7f9c6ed9d640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c70108dd0 0x7f9c7019ebd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9c68005cc0 tx=0x7f9c6802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.688+0000 7f9c5f7fe640 1 -- 172.21.15.148:0/797664629 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68003bf0 con 0x7f9c70108dd0 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.688+0000 7f9c5f7fe640 1 -- 172.21.15.148:0/797664629 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c68003d90 con 0x7f9c70108dd0 2024-09-21T01:16:40.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.688+0000 7f9c74cd0640 1 -- 172.21.15.148:0/797664629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7019f4d0 con 0x7f9c70108dd0 2024-09-21T01:16:40.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.688+0000 7f9c5f7fe640 1 -- 172.21.15.148:0/797664629 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6802fb20 con 0x7f9c70108dd0 2024-09-21T01:16:40.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.688+0000 7f9c74cd0640 1 -- 172.21.15.148:0/797664629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c7019fa10 con 0x7f9c70108dd0 2024-09-21T01:16:40.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.689+0000 7f9c74cd0640 1 -- 172.21.15.148:0/797664629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c70103dc0 con 0x7f9c70108dd0 2024-09-21T01:16:40.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.691+0000 7f9c5f7fe640 1 -- 172.21.15.148:0/797664629 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f9c68004580 con 0x7f9c70108dd0 2024-09-21T01:16:40.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.691+0000 7f9c5f7fe640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c580b6540 0x7f9c580b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:40.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.691+0000 7f9c6e59c640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c580b6540 0x7f9c580b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:40.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.691+0000 7f9c5f7fe640 1 -- 172.21.15.148:0/797664629 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8477+0+0 (secure 0 0 0) 0x7f9c68108850 con 0x7f9c70108dd0 2024-09-21T01:16:40.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.692+0000 7f9c6e59c640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c580b6540 0x7f9c580b8a50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000abe0 tx=0x7f9c6000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:40.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.695+0000 7f9c5f7fe640 1 -- 172.21.15.148:0/797664629 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9c680ceff0 con 0x7f9c70108dd0 2024-09-21T01:16:40.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:40.872+0000 7f9c74cd0640 1 -- 172.21.15.148:0/797664629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9c70102f50 con 0x7f9c70108dd0 2024-09-21T01:16:41.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.217+0000 7f9c5f7fe640 1 -- 172.21.15.148:0/797664629 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) ==== 181+0+0 (secure 0 0 0) 0x7f9c70102f50 con 0x7f9c70108dd0 2024-09-21T01:16:41.218 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2024-09-21T01:16:41.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.220+0000 7f9c74cd0640 1 -- 172.21.15.148:0/797664629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c580b6540 msgr2=0x7f9c580b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.220+0000 7f9c74cd0640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c580b6540 0x7f9c580b8a50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000abe0 tx=0x7f9c6000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.220+0000 7f9c74cd0640 1 -- 172.21.15.148:0/797664629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c70108dd0 msgr2=0x7f9c7019ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.220+0000 7f9c74cd0640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c70108dd0 0x7f9c7019ebd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9c68005cc0 tx=0x7f9c6802f380 comp rx=0 tx=0).stop 2024-09-21T01:16:41.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.221+0000 7f9c74cd0640 1 -- 172.21.15.148:0/797664629 shutdown_connections 2024-09-21T01:16:41.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.221+0000 7f9c74cd0640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f9c580b6540 0x7f9c580b8a50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.221+0000 7f9c74cd0640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c70108dd0 0x7f9c7019ebd0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.221+0000 7f9c74cd0640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c70108480 0x7f9c70199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.221+0000 7f9c74cd0640 1 --2- 172.21.15.148:0/797664629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c70102b40 0x7f9c70199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.221+0000 7f9c74cd0640 1 -- 172.21.15.148:0/797664629 >> 172.21.15.148:0/797664629 conn(0x7f9c70079750 msgr2=0x7f9c70104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:41.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.221+0000 7f9c74cd0640 1 -- 172.21.15.148:0/797664629 shutdown_connections 2024-09-21T01:16:41.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:41.221+0000 7f9c74cd0640 1 -- 172.21.15.148:0/797664629 wait complete. 2024-09-21T01:16:41.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:41 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/797664629' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:16:41.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:41 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/797664629' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:16:41.520 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:41 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/797664629' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:16:41.941 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 3872f802-77b5-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T01:16:42.188 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:42.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:42 smithi181 ceph-mon[34811]: pgmap v420: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 7 op/s 2024-09-21T01:16:42.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:42 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/797664629' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:16:42.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:42 smithi181 ceph-mon[34811]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:16:42.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:42 smithi157 ceph-mon[34140]: pgmap v420: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 7 op/s 2024-09-21T01:16:42.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:42 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/797664629' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:16:42.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:42 smithi157 ceph-mon[34140]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:16:42.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:42 smithi148 ceph-mon[31000]: pgmap v420: 97 pgs: 97 active+clean; 988 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 7 op/s 2024-09-21T01:16:42.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:42 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/797664629' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:16:42.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:42 smithi148 ceph-mon[31000]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:16:42.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.676+0000 7f1554db8640 1 -- 172.21.15.148:0/2637740715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15501083a0 msgr2=0x7f15501087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.676+0000 7f1554db8640 1 --2- 172.21.15.148:0/2637740715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15501083a0 0x7f15501087b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1544009900 tx=0x7f154402a410 comp rx=0 tx=0).stop 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.676+0000 7f1554db8640 1 -- 172.21.15.148:0/2637740715 shutdown_connections 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.676+0000 7f1554db8640 1 --2- 172.21.15.148:0/2637740715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15501083a0 0x7f15501087b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.676+0000 7f1554db8640 1 --2- 172.21.15.148:0/2637740715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1550108cf0 0x7f155010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.676+0000 7f1554db8640 1 --2- 172.21.15.148:0/2637740715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1550102a60 0x7f1550102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.676+0000 7f1554db8640 1 -- 172.21.15.148:0/2637740715 >> 172.21.15.148:0/2637740715 conn(0x7f1550079730 msgr2=0x7f1550079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.676+0000 7f1554db8640 1 -- 172.21.15.148:0/2637740715 shutdown_connections 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.676+0000 7f1554db8640 1 -- 172.21.15.148:0/2637740715 wait complete. 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f1554db8640 1 Processor -- start 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f1554db8640 1 -- start start 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f1554db8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1550102a60 0x7f155019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f1554db8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15501083a0 0x7f155019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:42.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f1554db8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1550108cf0 0x7f155019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f1554db8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1550112960 con 0x7f15501083a0 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f1554db8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f15501127e0 con 0x7f1550102a60 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f1554db8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1550112ae0 con 0x7f1550108cf0 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f154dd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15501083a0 0x7f155019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f154dd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15501083a0 0x7f155019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56082/0 (socket says 172.21.15.148:56082) 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f154dd9b640 1 -- 172.21.15.148:0/2452100506 learned_addr learned my addr 172.21.15.148:0/2452100506 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f154e59c640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1550102a60 0x7f155019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f154ed9d640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1550108cf0 0x7f155019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f154dd9b640 1 -- 172.21.15.148:0/2452100506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1550108cf0 msgr2=0x7f155019bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f154dd9b640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1550108cf0 0x7f155019bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f154dd9b640 1 -- 172.21.15.148:0/2452100506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1550102a60 msgr2=0x7f155019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:42.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f154dd9b640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1550102a60 0x7f155019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.677+0000 7f154dd9b640 1 -- 172.21.15.148:0/2452100506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15501a65f0 con 0x7f15501083a0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.678+0000 7f154dd9b640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15501083a0 0x7f155019b870 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1544032fd0 tx=0x7f1544004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.678+0000 7f153f7fe640 1 -- 172.21.15.148:0/2452100506 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154403f030 con 0x7f15501083a0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.678+0000 7f153f7fe640 1 -- 172.21.15.148:0/2452100506 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1544004490 con 0x7f15501083a0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.678+0000 7f1554db8640 1 -- 172.21.15.148:0/2452100506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15501a6880 con 0x7f15501083a0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.678+0000 7f153f7fe640 1 -- 172.21.15.148:0/2452100506 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544035070 con 0x7f15501083a0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.678+0000 7f1554db8640 1 -- 172.21.15.148:0/2452100506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15501a6d60 con 0x7f15501083a0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.679+0000 7f1554db8640 1 -- 172.21.15.148:0/2452100506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1550102e70 con 0x7f15501083a0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.681+0000 7f153f7fe640 1 -- 172.21.15.148:0/2452100506 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154513+0+0 (secure 0 0 0) 0x7f1544042030 con 0x7f15501083a0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.681+0000 7f153f7fe640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15380b6510 0x7f15380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.682+0000 7f154e59c640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15380b6510 0x7f15380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.682+0000 7f153f7fe640 1 -- 172.21.15.148:0/2452100506 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7981+0+0 (secure 0 0 0) 0x7f1544107a90 con 0x7f15501083a0 2024-09-21T01:16:42.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.682+0000 7f154e59c640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15380b6510 0x7f15380b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f155006b9e0 tx=0x7f1540009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:42.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.684+0000 7f153f7fe640 1 -- 172.21.15.148:0/2452100506 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15440d2850 con 0x7f15501083a0 2024-09-21T01:16:42.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:42.866+0000 7f1554db8640 1 -- 172.21.15.148:0/2452100506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f155002e640 con 0x7f15501083a0 2024-09-21T01:16:43.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.224+0000 7f153f7fe640 1 -- 172.21.15.148:0/2452100506 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) ==== 169+0+0 (secure 0 0 0) 0x7f15440d7790 con 0x7f15501083a0 2024-09-21T01:16:43.225 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2024-09-21T01:16:43.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.227+0000 7f1554db8640 1 -- 172.21.15.148:0/2452100506 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15380b6510 msgr2=0x7f15380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.227+0000 7f1554db8640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15380b6510 0x7f15380b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f155006b9e0 tx=0x7f1540009680 comp rx=0 tx=0).stop 2024-09-21T01:16:43.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.227+0000 7f1554db8640 1 -- 172.21.15.148:0/2452100506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15501083a0 msgr2=0x7f155019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.227+0000 7f1554db8640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15501083a0 0x7f155019b870 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1544032fd0 tx=0x7f1544004270 comp rx=0 tx=0).stop 2024-09-21T01:16:43.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.228+0000 7f1554db8640 1 -- 172.21.15.148:0/2452100506 shutdown_connections 2024-09-21T01:16:43.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.228+0000 7f1554db8640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.148:6800/1101840134,v1:172.21.15.148:6801/1101840134] conn(0x7f15380b6510 0x7f15380b8a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.228+0000 7f1554db8640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15501083a0 0x7f155019b870 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.228+0000 7f1554db8640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1550108cf0 0x7f155019bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.228+0000 7f1554db8640 1 --2- 172.21.15.148:0/2452100506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1550102a60 0x7f155019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.228+0000 7f1554db8640 1 -- 172.21.15.148:0/2452100506 >> 172.21.15.148:0/2452100506 conn(0x7f1550079730 msgr2=0x7f1550104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.228+0000 7f1554db8640 1 -- 172.21.15.148:0/2452100506 shutdown_connections 2024-09-21T01:16:43.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T01:16:43.228+0000 7f1554db8640 1 -- 172.21.15.148:0/2452100506 wait complete. 2024-09-21T01:16:43.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:43 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2452100506' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:16:43.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:43 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2452100506' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:16:43.504 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:43 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2452100506' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:16:43.815 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:16:43.841 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:16:43.868 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:16:43.897 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T01:16:43.897 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:16:43.914 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:16:43.929 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:16:43.953 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T01:16:43.953 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T01:16:43.953 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.a 2024-09-21T01:16:44.113 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:43 smithi148 systemd[1]: Stopping Ceph mon.a for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:16:44.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:44 smithi181 ceph-mon[34811]: pgmap v422: 65 pgs: 65 active+clean; 577 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:16:44.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:44 smithi181 ceph-mon[34811]: from='client.? 172.21.15.148:0/2452100506' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:16:44.480 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:44 smithi181 ceph-mon[34811]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:16:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:44 smithi157 ceph-mon[34140]: pgmap v422: 65 pgs: 65 active+clean; 577 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:16:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:44 smithi157 ceph-mon[34140]: from='client.? 172.21.15.148:0/2452100506' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:16:44.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:44 smithi157 ceph-mon[34140]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:16:44.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:44 smithi148 ceph-mon[31000]: pgmap v422: 65 pgs: 65 active+clean; 577 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:16:44.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:44 smithi148 ceph-mon[31000]: from='client.? 172.21.15.148:0/2452100506' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:16:44.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:44 smithi148 ceph-mon[31000]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:16:44.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:44 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a[30996]: 2024-09-21T01:16:44.249+0000 7f440a52e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:16:44.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:44 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a[30996]: 2024-09-21T01:16:44.249+0000 7f440a52e640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T01:16:44.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:44 smithi148 podman[89156]: 2024-09-21 01:16:44.280203615 +0000 UTC m=+0.138408083 container died b56d7e839ccb10f4124276441e3dce7a5a40d01a6f210c82ad0a68f7a54c24a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:16:44.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:44 smithi148 podman[89156]: 2024-09-21 01:16:44.791841084 +0000 UTC m=+0.650045544 container cleanup b56d7e839ccb10f4124276441e3dce7a5a40d01a6f210c82ad0a68f7a54c24a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:16:44.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 21 01:16:44 smithi148 bash[89156]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-a 2024-09-21T01:16:45.135 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T01:16:45.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:16:45.184 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T01:16:45.185 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T01:16:45.185 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.b 2024-09-21T01:16:45.490 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:45 smithi157 systemd[1]: Stopping Ceph mon.b for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:16:45.855 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:45 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-b[34135]: 2024-09-21T01:16:45.513+0000 7f4cb736c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:16:45.856 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:45 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-b[34135]: 2024-09-21T01:16:45.513+0000 7f4cb736c640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T01:16:45.856 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:45 smithi157 podman[64921]: 2024-09-21 01:16:45.585278343 +0000 UTC m=+0.212257719 container died 536e2bd2bddf0ba866b13932ca1c7f706cb2e7ec6ce3510c3d05d51f2604717c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T01:16:46.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:46 smithi157 podman[64921]: 2024-09-21 01:16:46.046980811 +0000 UTC m=+0.673960228 container cleanup 536e2bd2bddf0ba866b13932ca1c7f706cb2e7ec6ce3510c3d05d51f2604717c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-b, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:16:46.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Sep 21 01:16:46 smithi157 bash[64921]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-b 2024-09-21T01:16:46.467 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T01:16:46.514 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:16:46.514 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T01:16:46.514 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T01:16:46.514 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.c 2024-09-21T01:16:46.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:46 smithi181 systemd[1]: Stopping Ceph mon.c for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:16:47.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:46 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-c[34807]: 2024-09-21T01:16:46.842+0000 7fa66f9c8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:16:47.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:46 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-c[34807]: 2024-09-21T01:16:46.842+0000 7fa66f9c8640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T01:16:47.230 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:47 smithi181 podman[66215]: 2024-09-21 01:16:47.088561405 +0000 UTC m=+0.374578785 container died b2348bede97b3a509455014b5235a2f0683d1254a02e74885224d1477987b312 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T01:16:47.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:47 smithi181 podman[66215]: 2024-09-21 01:16:47.543692831 +0000 UTC m=+0.829710209 container cleanup b2348bede97b3a509455014b5235a2f0683d1254a02e74885224d1477987b312 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T01:16:47.730 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 01:16:47 smithi181 bash[66215]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mon-c 2024-09-21T01:16:48.026 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T01:16:48.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:16:48.079 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T01:16:48.079 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T01:16:48.080 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.x 2024-09-21T01:16:48.364 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:16:48 smithi148 systemd[1]: Stopping Ceph mgr.x for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:16:48.732 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:16:48 smithi148 podman[89278]: 2024-09-21 01:16:48.453721171 +0000 UTC m=+0.170080702 container died 64a898c42ae5f2a2010d410b6600f6c09eabb551c3746403659e9f361ed38413 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T01:16:49.113 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:16:48 smithi148 podman[89278]: 2024-09-21 01:16:48.91358977 +0000 UTC m=+0.629949357 container cleanup 64a898c42ae5f2a2010d410b6600f6c09eabb551c3746403659e9f361ed38413 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T01:16:49.113 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 21 01:16:48 smithi148 bash[89278]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-x 2024-09-21T01:16:49.353 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T01:16:49.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:16:49.388 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T01:16:49.388 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T01:16:49.388 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.y 2024-09-21T01:16:49.706 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:16:49 smithi157 systemd[1]: Stopping Ceph mgr.y for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:16:49.960 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:16:49 smithi157 podman[65047]: 2024-09-21 01:16:49.705993119 +0000 UTC m=+0.126765660 container died 6f70a2281cf5ab3d9e624e9b3c85ba5bfe6944f568ce3da8c7b546a45987d1e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:16:50.240 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:16:50 smithi157 podman[65047]: 2024-09-21 01:16:50.118523713 +0000 UTC m=+0.539296242 container cleanup 6f70a2281cf5ab3d9e624e9b3c85ba5bfe6944f568ce3da8c7b546a45987d1e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T01:16:50.240 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Sep 21 01:16:50 smithi157 bash[65047]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-y 2024-09-21T01:16:50.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T01:16:50.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:16:50.548 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T01:16:50.548 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T01:16:50.548 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.z 2024-09-21T01:16:50.887 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:16:50 smithi181 systemd[1]: Stopping Ceph mgr.z for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:16:51.149 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:16:50 smithi181 podman[66339]: 2024-09-21 01:16:50.886344238 +0000 UTC m=+0.147721925 container died afd1a6783ed9619db061c16b13286bd6f50829d4d4dde143da3c731d802efca4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-z, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T01:16:51.480 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:16:51 smithi181 podman[66339]: 2024-09-21 01:16:51.298821413 +0000 UTC m=+0.560199101 container cleanup afd1a6783ed9619db061c16b13286bd6f50829d4d4dde143da3c731d802efca4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T01:16:51.480 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 01:16:51 smithi181 bash[66339]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mgr-z 2024-09-21T01:16:51.676 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T01:16:51.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:16:51.711 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T01:16:51.712 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T01:16:51.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.0 2024-09-21T01:16:52.010 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:51 smithi148 systemd[1]: Stopping Ceph osd.0 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:16:52.363 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:52 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0[46418]: 2024-09-21T01:16:52.009+0000 7f2dbf81a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:16:52.363 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:52 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0[46418]: 2024-09-21T01:16:52.009+0000 7f2dbf81a640 -1 osd.0 79 *** Got signal Terminated *** 2024-09-21T01:16:52.363 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:52 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0[46418]: 2024-09-21T01:16:52.009+0000 7f2dbf81a640 -1 osd.0 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:16:57.603 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:57 smithi148 podman[89400]: 2024-09-21 01:16:57.340539274 +0000 UTC m=+5.436798990 container died 621bd46d84bacd1d0d503f07243bf18156a7643938dcc0a6dab834703e0a419e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:16:57.863 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:57 smithi148 podman[89400]: 2024-09-21 01:16:57.7854012 +0000 UTC m=+5.881660949 container cleanup 621bd46d84bacd1d0d503f07243bf18156a7643938dcc0a6dab834703e0a419e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T01:16:57.863 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:57 smithi148 bash[89400]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0 2024-09-21T01:16:58.363 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:57 smithi148 podman[89416]: 2024-09-21 01:16:57.995243027 +0000 UTC m=+0.648988922 container remove 621bd46d84bacd1d0d503f07243bf18156a7643938dcc0a6dab834703e0a419e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T01:16:58.715 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:58 smithi148 podman[89503]: 2024-09-21 01:16:58.30764842 +0000 UTC m=+0.015406637 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:16:58.715 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:58 smithi148 podman[89503]: 2024-09-21 01:16:58.429448081 +0000 UTC m=+0.137206288 container create abda50840db5f4af87ccc7dfbb8963c3fee4a52f5118f2557d61a993f7de3b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T01:16:58.715 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:58 smithi148 podman[89503]: 2024-09-21 01:16:58.640337351 +0000 UTC m=+0.348095565 container init abda50840db5f4af87ccc7dfbb8963c3fee4a52f5118f2557d61a993f7de3b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T01:16:58.715 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:58 smithi148 podman[89503]: 2024-09-21 01:16:58.643819129 +0000 UTC m=+0.351577336 container start abda50840db5f4af87ccc7dfbb8963c3fee4a52f5118f2557d61a993f7de3b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T01:16:58.715 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:58 smithi148 podman[89503]: 2024-09-21 01:16:58.715086415 +0000 UTC m=+0.422844633 container attach abda50840db5f4af87ccc7dfbb8963c3fee4a52f5118f2557d61a993f7de3b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T01:16:59.113 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 21 01:16:58 smithi148 podman[89527]: 2024-09-21 01:16:58.855619387 +0000 UTC m=+0.016797095 container died abda50840db5f4af87ccc7dfbb8963c3fee4a52f5118f2557d61a993f7de3b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T01:16:59.435 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T01:16:59.478 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:16:59.478 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T01:16:59.478 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T01:16:59.478 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.1 2024-09-21T01:16:59.781 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:16:59 smithi157 systemd[1]: Stopping Ceph osd.1 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:17:00.240 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:16:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1[38086]: 2024-09-21T01:16:59.780+0000 7fc87b2a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:17:00.240 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:16:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1[38086]: 2024-09-21T01:16:59.780+0000 7fc87b2a9640 -1 osd.1 79 *** Got signal Terminated *** 2024-09-21T01:17:00.241 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:16:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1[38086]: 2024-09-21T01:16:59.780+0000 7fc87b2a9640 -1 osd.1 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:17:05.407 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:05 smithi157 podman[65172]: 2024-09-21 01:17:05.12269027 +0000 UTC m=+5.452361465 container died 0287cc72429aee51923478927f995bc8d3bd641cd9c4e065ef07967e570424c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:17:05.746 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:05 smithi157 podman[65172]: 2024-09-21 01:17:05.622991188 +0000 UTC m=+5.952662374 container cleanup 0287cc72429aee51923478927f995bc8d3bd641cd9c4e065ef07967e570424c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T01:17:05.747 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:05 smithi157 bash[65172]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1 2024-09-21T01:17:06.146 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:05 smithi157 podman[65187]: 2024-09-21 01:17:05.832830589 +0000 UTC m=+0.706922782 container remove 0287cc72429aee51923478927f995bc8d3bd641cd9c4e065ef07967e570424c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:17:06.398 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:06 smithi157 podman[65272]: 2024-09-21 01:17:06.049465413 +0000 UTC m=+0.015946804 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:17:06.399 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:06 smithi157 podman[65272]: 2024-09-21 01:17:06.169139477 +0000 UTC m=+0.135620860 container create 6f140aa834c6c9f7b2b4adefc2c5c9eaedae6058863882817864da697e006a6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T01:17:06.399 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:06 smithi157 podman[65272]: 2024-09-21 01:17:06.394440812 +0000 UTC m=+0.360922195 container init 6f140aa834c6c9f7b2b4adefc2c5c9eaedae6058863882817864da697e006a6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:17:06.399 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:06 smithi157 podman[65272]: 2024-09-21 01:17:06.397852656 +0000 UTC m=+0.364334036 container start 6f140aa834c6c9f7b2b4adefc2c5c9eaedae6058863882817864da697e006a6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T01:17:06.741 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:06 smithi157 podman[65272]: 2024-09-21 01:17:06.494379952 +0000 UTC m=+0.460861348 container attach 6f140aa834c6c9f7b2b4adefc2c5c9eaedae6058863882817864da697e006a6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T01:17:06.741 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:06 smithi157 podman[65272]: 2024-09-21 01:17:06.586794767 +0000 UTC m=+0.553276148 container died 6f140aa834c6c9f7b2b4adefc2c5c9eaedae6058863882817864da697e006a6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T01:17:07.121 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T01:17:07.144 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:07 smithi157 podman[65296]: 2024-09-21 01:17:07.098288379 +0000 UTC m=+0.501021546 container remove 6f140aa834c6c9f7b2b4adefc2c5c9eaedae6058863882817864da697e006a6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:17:07.145 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:07 smithi157 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-21T01:17:07.145 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:07 smithi157 systemd[1]: Stopped Ceph osd.1 for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:17:07.145 INFO:journalctl@ceph.osd.1.smithi157.stdout:Sep 21 01:17:07 smithi157 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.1.service: Consumed 5.715s CPU time. 2024-09-21T01:17:07.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:17:07.160 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T01:17:07.160 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T01:17:07.160 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.2 2024-09-21T01:17:07.462 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:07 smithi181 systemd[1]: Stopping Ceph osd.2 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:17:07.729 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:07 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2[39225]: 2024-09-21T01:17:07.460+0000 7f4658e70640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:17:07.730 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:07 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2[39225]: 2024-09-21T01:17:07.460+0000 7f4658e70640 -1 osd.2 79 *** Got signal Terminated *** 2024-09-21T01:17:07.730 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:07 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2[39225]: 2024-09-21T01:17:07.461+0000 7f4658e70640 -1 osd.2 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:17:13.062 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:12 smithi181 podman[66465]: 2024-09-21 01:17:12.764758775 +0000 UTC m=+5.409719309 container died 03a0da39bc16a219592e26d5803332baf22685ec6681d4a1bc92c4acff85975c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T01:17:13.446 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:13 smithi181 podman[66465]: 2024-09-21 01:17:13.161280282 +0000 UTC m=+5.806240815 container cleanup 03a0da39bc16a219592e26d5803332baf22685ec6681d4a1bc92c4acff85975c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T01:17:13.446 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:13 smithi181 bash[66465]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2 2024-09-21T01:17:13.730 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:13 smithi181 podman[66483]: 2024-09-21 01:17:13.446053756 +0000 UTC m=+0.672245076 container remove 03a0da39bc16a219592e26d5803332baf22685ec6681d4a1bc92c4acff85975c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T01:17:14.049 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:13 smithi181 podman[66570]: 2024-09-21 01:17:13.780216469 +0000 UTC m=+0.112448706 container create 82f898e527083c5da5349df4b257c179d8a6c101872fcec3cbcd9cd3320b27a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T01:17:14.049 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:13 smithi181 podman[66570]: 2024-09-21 01:17:13.683673991 +0000 UTC m=+0.015906235 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:17:14.480 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:14 smithi181 podman[66570]: 2024-09-21 01:17:14.049614822 +0000 UTC m=+0.381847057 container init 82f898e527083c5da5349df4b257c179d8a6c101872fcec3cbcd9cd3320b27a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T01:17:14.480 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:14 smithi181 podman[66570]: 2024-09-21 01:17:14.053429646 +0000 UTC m=+0.385661881 container start 82f898e527083c5da5349df4b257c179d8a6c101872fcec3cbcd9cd3320b27a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T01:17:14.480 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:14 smithi181 podman[66570]: 2024-09-21 01:17:14.141078977 +0000 UTC m=+0.473311213 container attach 82f898e527083c5da5349df4b257c179d8a6c101872fcec3cbcd9cd3320b27a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T01:17:14.481 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 01:17:14 smithi181 podman[66570]: 2024-09-21 01:17:14.24905961 +0000 UTC m=+0.581291858 container died 82f898e527083c5da5349df4b257c179d8a6c101872fcec3cbcd9cd3320b27a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-21T01:17:14.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T01:17:14.910 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:17:14.911 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T01:17:14.911 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T01:17:14.911 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.3 2024-09-21T01:17:15.205 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:14 smithi148 systemd[1]: Stopping Ceph osd.3 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:17:15.613 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:15 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3[52517]: 2024-09-21T01:17:15.204+0000 7f40f8193640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:17:15.613 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:15 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3[52517]: 2024-09-21T01:17:15.204+0000 7f40f8193640 -1 osd.3 79 *** Got signal Terminated *** 2024-09-21T01:17:15.613 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:15 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3[52517]: 2024-09-21T01:17:15.204+0000 7f40f8193640 -1 osd.3 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:17:18.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:18 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:18.343+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:18.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:18 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:18.593+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:19.613 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:19 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3[52517]: 2024-09-21T01:17:19.323+0000 7f40f477e640 -1 osd.3 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:53.655453+0000 front 2024-09-21T01:16:53.655495+0000 (oldest deadline 2024-09-21T01:17:18.856147+0000) 2024-09-21T01:17:19.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:19 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:19.316+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:19.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:19 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:19.589+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:19.981 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:19 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:19.658+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:20.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:20 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:20.304+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:20.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:20 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:20.629+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:20.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:20 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:20.629+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:21.030 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:20 smithi148 podman[89619]: 2024-09-21 01:17:20.734514375 +0000 UTC m=+5.628459254 container stop eff5c66ef626d9ec7e6c0c3e90539fc0dccce5f562b807d5ac68bad97aca055d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T01:17:21.030 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:20 smithi148 podman[89619]: 2024-09-21 01:17:20.764133588 +0000 UTC m=+5.658078471 container died eff5c66ef626d9ec7e6c0c3e90539fc0dccce5f562b807d5ac68bad97aca055d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T01:17:21.327 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:21 smithi148 podman[89619]: 2024-09-21 01:17:21.196033552 +0000 UTC m=+6.089978429 container cleanup eff5c66ef626d9ec7e6c0c3e90539fc0dccce5f562b807d5ac68bad97aca055d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:17:21.327 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:21 smithi148 bash[89619]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3 2024-09-21T01:17:21.614 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:21 smithi148 podman[89635]: 2024-09-21 01:17:21.364143588 +0000 UTC m=+0.621485753 container remove eff5c66ef626d9ec7e6c0c3e90539fc0dccce5f562b807d5ac68bad97aca055d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T01:17:21.615 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:21 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:21.325+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:21.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:21 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:21.318+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:21.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:21 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:21.653+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:21.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:21 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:21.621+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:22.113 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:21 smithi148 podman[89726]: 2024-09-21 01:17:21.708211989 +0000 UTC m=+0.016328742 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:17:22.113 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:21 smithi148 podman[89726]: 2024-09-21 01:17:21.815213375 +0000 UTC m=+0.123330169 container create 324414dab3bf3066d0eaac0526ad79cbc9793de5b899784986847f59cdd8a1ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:17:22.114 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:22 smithi148 podman[89726]: 2024-09-21 01:17:22.042964488 +0000 UTC m=+0.351081247 container init 324414dab3bf3066d0eaac0526ad79cbc9793de5b899784986847f59cdd8a1ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T01:17:22.114 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:22 smithi148 podman[89726]: 2024-09-21 01:17:22.046341422 +0000 UTC m=+0.354458177 container start 324414dab3bf3066d0eaac0526ad79cbc9793de5b899784986847f59cdd8a1ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T01:17:22.376 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:22 smithi148 podman[89726]: 2024-09-21 01:17:22.137039401 +0000 UTC m=+0.445156174 container attach 324414dab3bf3066d0eaac0526ad79cbc9793de5b899784986847f59cdd8a1ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T01:17:22.376 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 21 01:17:22 smithi148 podman[89726]: 2024-09-21 01:17:22.246900039 +0000 UTC m=+0.555016792 container died 324414dab3bf3066d0eaac0526ad79cbc9793de5b899784986847f59cdd8a1ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:17:22.377 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:22 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:22.278+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:22.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:22 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:22.299+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:22.863 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T01:17:22.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:17:22.904 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T01:17:22.904 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T01:17:22.904 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.4 2024-09-21T01:17:22.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:22.686+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:22.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:22.664+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:23.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:22 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:22.741+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:23.226 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:22 smithi157 systemd[1]: Stopping Ceph osd.4 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:17:23.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:23 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:23.265+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:23.490 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:23 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4[44493]: 2024-09-21T01:17:23.225+0000 7fc6a561a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:17:23.490 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:23 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4[44493]: 2024-09-21T01:17:23.225+0000 7fc6a561a640 -1 osd.4 79 *** Got signal Terminated *** 2024-09-21T01:17:23.490 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:23 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4[44493]: 2024-09-21T01:17:23.225+0000 7fc6a561a640 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:17:23.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:23 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:23.231+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:23.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:23 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:23.730+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:23.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:23 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:23.653+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:24.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:23 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:23.696+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:24.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:24 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:24.262+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:24.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:24 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:24.271+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:24.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:24 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:24.696+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:24.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:24 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:24.654+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:25.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:24 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:24.725+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:25.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:25 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:25.225+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:25.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:25 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:25.221+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:25.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:25 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:25.677+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:25.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:25 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:25.677+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:25.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:25 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:25.632+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:26.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:25 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:25.768+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:26.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:26 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:26.229+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:26.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:26 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:26.213+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:26.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:26 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:26.213+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:26.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:26 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:26.638+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:26.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:26 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:26.638+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:26.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:26 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:26.606+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:26.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:26 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:26.606+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:27.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:26 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:26.782+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:27.240 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:26 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4[44493]: 2024-09-21T01:17:26.904+0000 7fc69dbfd640 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:02.216639+0000 front 2024-09-21T01:17:02.216699+0000 (oldest deadline 2024-09-21T01:17:26.316816+0000) 2024-09-21T01:17:27.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:27 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:27.207+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:27.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:27 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:27.207+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:27.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:27 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:27.477+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:27.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:27 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:27.646+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:27.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:27 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:27.646+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:27.730 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:27 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:27.686+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:27.731 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:27 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:27.686+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:27.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:27 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:27.247+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:27.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:27 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:27.247+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:28.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:27 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:27.745+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:28.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:27 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:27.745+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:28.240 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:27 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4[44493]: 2024-09-21T01:17:27.947+0000 7fc69dbfd640 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:02.216639+0000 front 2024-09-21T01:17:02.216699+0000 (oldest deadline 2024-09-21T01:17:26.316816+0000) 2024-09-21T01:17:28.585 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:28 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:28.280+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:28.585 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:28 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:28.280+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:28.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:28 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:28.238+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:28.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:28 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:28.238+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:28.868 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:28 smithi157 podman[65376]: 2024-09-21 01:17:28.585005398 +0000 UTC m=+5.483436817 container died 3ce4c327bd6cf01a16423dc3f6e035ec561b5a1b57a751d46732c0009dee56d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T01:17:28.980 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:28 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:28.522+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:28.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:28 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:28.648+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:28.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:28 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:28.648+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:28.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:28 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:28.627+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:28.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:28 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:28.627+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:29.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:28 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:28.790+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:29.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:28 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:28.790+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:29.234 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:29 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:29.106+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:29.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:28 smithi157 podman[65376]: 2024-09-21 01:17:28.966375395 +0000 UTC m=+5.864806812 container cleanup 3ce4c327bd6cf01a16423dc3f6e035ec561b5a1b57a751d46732c0009dee56d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T01:17:29.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:28 smithi157 bash[65376]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4 2024-09-21T01:17:29.490 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:29 smithi157 podman[65392]: 2024-09-21 01:17:29.234351095 +0000 UTC m=+0.645909487 container remove 3ce4c327bd6cf01a16423dc3f6e035ec561b5a1b57a751d46732c0009dee56d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T01:17:29.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:29 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:29.251+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:29.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:29 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:29.251+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:29.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:29 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:29.231+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:29.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:29 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:29.231+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:29.842 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:29 smithi157 podman[65482]: 2024-09-21 01:17:29.49082829 +0000 UTC m=+0.016168327 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:17:29.842 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:29 smithi157 podman[65482]: 2024-09-21 01:17:29.593956006 +0000 UTC m=+0.119296027 container create 743447a12f8db0cf93ae34433ffa1ee764f591d1a6c39fe8be1d904dbcd29f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:17:29.842 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:29 smithi157 podman[65482]: 2024-09-21 01:17:29.838156492 +0000 UTC m=+0.363496514 container init 743447a12f8db0cf93ae34433ffa1ee764f591d1a6c39fe8be1d904dbcd29f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:17:29.842 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:29 smithi157 podman[65482]: 2024-09-21 01:17:29.841625258 +0000 UTC m=+0.366965285 container start 743447a12f8db0cf93ae34433ffa1ee764f591d1a6c39fe8be1d904dbcd29f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T01:17:29.980 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:29 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:29.502+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:29.981 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:29 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:29.632+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:29.981 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:29 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:29.632+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:29.981 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:29 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:29.660+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:29.981 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:29 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:29.660+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:30.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:29 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:29.800+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:30.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:29 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:29.800+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:30.240 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:30 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:30.074+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:30.241 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:29 smithi157 podman[65482]: 2024-09-21 01:17:29.937978797 +0000 UTC m=+0.463318819 container attach 743447a12f8db0cf93ae34433ffa1ee764f591d1a6c39fe8be1d904dbcd29f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T01:17:30.241 INFO:journalctl@ceph.osd.4.smithi157.stdout:Sep 21 01:17:30 smithi157 podman[65482]: 2024-09-21 01:17:30.030372279 +0000 UTC m=+0.555712301 container died 743447a12f8db0cf93ae34433ffa1ee764f591d1a6c39fe8be1d904dbcd29f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:17:30.575 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:30 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:30.261+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:30.589 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:30 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:30.261+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:30.599 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T01:17:30.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:30.276+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:30.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:30.276+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:30.641 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:17:30.641 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T01:17:30.641 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T01:17:30.641 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.5 2024-09-21T01:17:30.965 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:30 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:30.516+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:30.965 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:30 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:30.630+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:30.965 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:30 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:30.630+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:30.966 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:30 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:30.593+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:30.966 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:30 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:30.593+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:30.966 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:30 smithi181 systemd[1]: Stopping Ceph osd.5 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:17:31.114 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:30.809+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:31.114 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:30 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:30.809+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:31.230 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:30 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:30.964+0000 7f83d977e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:17:31.230 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:30 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:30.964+0000 7f83d977e640 -1 osd.5 79 *** Got signal Terminated *** 2024-09-21T01:17:31.230 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:30 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:30.964+0000 7f83d977e640 -1 osd.5 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:17:31.304 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:31 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:31.042+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:31.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:31 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:31.288+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:31.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:31 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:31.288+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:31.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:31 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:31.304+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:31.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:31 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:31.304+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:31.980 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:31 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:31.491+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:31.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:31 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:31.620+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:31.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:31 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:31.620+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:31.981 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:31 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:31.613+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:31.981 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:31 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:31.613+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:32.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:31 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:31.817+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:32.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:31 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:31.817+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:32.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:32 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:32.090+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:32.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:32 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:32.333+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:32.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:32 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:32.333+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:32.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:32 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:32.297+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:32.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:32 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:32.297+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:32.980 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:32 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:32.491+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:32.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:32 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:32.599+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:32.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:32 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:32.599+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:32.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:32 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:32.565+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:32.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:32 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:32.565+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:33.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:32 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:32.851+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:33.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:32 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:32.851+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:33.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:33 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:33.044+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:33.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:33 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:33.284+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:33.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:33 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:33.284+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:33.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:33 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:33.284+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:33.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:33 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:33.288+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:33.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:33 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:33.288+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:33.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:33 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:33.463+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:33.730 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:33 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:33.605+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:33.730 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:33 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:33.605+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:33.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:33 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:33.519+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:33.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:33 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:33.519+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:34.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:33 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:33.856+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:34.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:33 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:33.856+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:34.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:34 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:34.042+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:34.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:34 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:34.261+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:34.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:34 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:34.261+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:34.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:34 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:34.261+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:34.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:34.258+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:34.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:34.258+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:34.730 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:34 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:34.608+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:34.730 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:34 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:34.608+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:34.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:34 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:34.418+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:34.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:34 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:34.418+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:34.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:34 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:34.557+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:34.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:34 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:34.557+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:35.114 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:34.838+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:35.114 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:34 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:34.838+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:35.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:35 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:35.055+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:35.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:35 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:35.302+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:35.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:35 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:35.302+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:35.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:35 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:35.302+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:35.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:35 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:35.215+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:35.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:35 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:35.215+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:35.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:35 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:35.416+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:35.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:35 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:35.416+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:35.730 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:35 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:35.560+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:55.680181+0000 front 2024-09-21T01:16:55.680034+0000 (oldest deadline 2024-09-21T01:17:17.979973+0000) 2024-09-21T01:17:35.730 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:35 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5[45829]: 2024-09-21T01:17:35.560+0000 7f83d1d61640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:01.481156+0000 front 2024-09-21T01:17:01.481101+0000 (oldest deadline 2024-09-21T01:17:25.581038+0000) 2024-09-21T01:17:35.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:35 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:35.552+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:35.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:35 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:35.552+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:36.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:35 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:35.816+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:36.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:35 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:35.816+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:36.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:35 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:35.816+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.276048+0000 front 2024-09-21T01:17:12.276265+0000 (oldest deadline 2024-09-21T01:17:35.176138+0000) 2024-09-21T01:17:36.335 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:36 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:36.008+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:36.336 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:36 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:36.008+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:36.590 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:36 smithi181 podman[66684]: 2024-09-21 01:17:36.329613372 +0000 UTC m=+5.491875399 container died 8d0c77c91597bd25b80047ca0576a635d63c438dc0158728da58bd489ee20a81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T01:17:36.591 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:36 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:36.380+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:36.591 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:36 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:36.380+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:36.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:36 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:36.223+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:36.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:36 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:36.223+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:36.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:36 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:36.223+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:36.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:36 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:36.334+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:36.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:36 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:36.334+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:36.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:36 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:36.334+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:36.966 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:36 smithi181 podman[66684]: 2024-09-21 01:17:36.722478316 +0000 UTC m=+5.884740330 container cleanup 8d0c77c91597bd25b80047ca0576a635d63c438dc0158728da58bd489ee20a81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T01:17:36.966 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:36 smithi181 bash[66684]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5 2024-09-21T01:17:36.966 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:36 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:36.589+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:36.966 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:36 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:36.589+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:37.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:36 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:36.787+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:37.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:36 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:36.787+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:37.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:36 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:36.787+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.276048+0000 front 2024-09-21T01:17:12.276265+0000 (oldest deadline 2024-09-21T01:17:35.176138+0000) 2024-09-21T01:17:37.230 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:36 smithi181 podman[66699]: 2024-09-21 01:17:36.965317705 +0000 UTC m=+0.629080192 container remove 8d0c77c91597bd25b80047ca0576a635d63c438dc0158728da58bd489ee20a81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T01:17:37.312 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:37.020+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:37.312 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:37.020+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:37.581 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:37 smithi181 podman[66785]: 2024-09-21 01:17:37.185220515 +0000 UTC m=+0.016106092 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:17:37.581 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:37 smithi181 podman[66785]: 2024-09-21 01:17:37.29113536 +0000 UTC m=+0.122020927 container create c6b159b2bd55208a88837fea674bae0d5014e9edc3ab900e16cab37bf495c8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T01:17:37.581 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:37 smithi181 podman[66785]: 2024-09-21 01:17:37.510209535 +0000 UTC m=+0.341095113 container init c6b159b2bd55208a88837fea674bae0d5014e9edc3ab900e16cab37bf495c8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:17:37.581 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:37 smithi181 podman[66785]: 2024-09-21 01:17:37.513655203 +0000 UTC m=+0.344540774 container start c6b159b2bd55208a88837fea674bae0d5014e9edc3ab900e16cab37bf495c8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:17:37.582 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:37.362+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:37.582 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:37.362+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:37.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:37 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:37.242+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:37.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:37 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:37.242+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:37.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:37 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:37.242+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:37.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:37.311+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:37.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:37.311+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:37.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:37 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:37.311+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:37.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:37.580+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:37.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:37 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:37.580+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:37.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:37 smithi181 podman[66785]: 2024-09-21 01:17:37.593535494 +0000 UTC m=+0.424421078 container attach c6b159b2bd55208a88837fea674bae0d5014e9edc3ab900e16cab37bf495c8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T01:17:37.980 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 01:17:37 smithi181 podman[66785]: 2024-09-21 01:17:37.702388591 +0000 UTC m=+0.533274160 container died c6b159b2bd55208a88837fea674bae0d5014e9edc3ab900e16cab37bf495c8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T01:17:38.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:37 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:37.783+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:38.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:37 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:37.783+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:38.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:37 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:37.783+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.276048+0000 front 2024-09-21T01:17:12.276265+0000 (oldest deadline 2024-09-21T01:17:35.176138+0000) 2024-09-21T01:17:38.269 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:38 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:38.016+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:38.269 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:38 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:38.016+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:38.285 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T01:17:38.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:17:38.323 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T01:17:38.323 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T01:17:38.323 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.6 2024-09-21T01:17:38.549 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:38 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:38.358+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:38.549 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:38 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:38.358+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:38.608 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:38 smithi148 systemd[1]: Stopping Ceph osd.6 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:17:38.608 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:38 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:38.286+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:38.608 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:38 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:38.286+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:38.608 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:38 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:38.286+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:38.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:38 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:38.269+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:38.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:38 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:38.269+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:38.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:38 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:38.269+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:38.863 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:38 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:38.607+0000 7f3399aba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:17:38.863 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:38 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:38.607+0000 7f3399aba640 -1 osd.6 79 *** Got signal Terminated *** 2024-09-21T01:17:38.863 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:38 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:38.607+0000 7f3399aba640 -1 osd.6 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:17:38.863 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:38 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:38.735+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:38.863 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:38 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:38.735+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:38.863 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:38 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:38.735+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.276048+0000 front 2024-09-21T01:17:12.276265+0000 (oldest deadline 2024-09-21T01:17:35.176138+0000) 2024-09-21T01:17:38.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:38 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:38.548+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:38.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:38 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:38.548+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:38.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:38 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:38.548+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:39.276 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:38 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:38.995+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:39.276 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:38 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:38.995+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:39.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:39 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:39.296+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:39.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:39 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:39.296+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:39.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:39 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:39.296+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:39.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:39 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:39.352+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:39.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:39 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:39.352+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:39.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:39 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:39.544+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:39.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:39 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:39.544+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:39.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:39 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:39.544+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:39.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:39 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:39.276+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:39.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:39 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:39.276+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:39.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:39 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:39.276+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:40.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:39 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:39.760+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:40.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:39 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:39.760+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:40.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:39 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:39.760+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.276048+0000 front 2024-09-21T01:17:12.276265+0000 (oldest deadline 2024-09-21T01:17:35.176138+0000) 2024-09-21T01:17:40.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:40 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:40.273+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:40.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:40 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:40.273+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:40.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:40 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:40.273+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:40.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:40 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:40.025+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:40.491 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:40 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:40.025+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:40.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:40 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:40.294+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:40.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:40 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:40.294+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:40.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:40 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:40.294+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:40.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:40 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:40.373+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:40.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:40 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:40.373+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:40.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:40 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:40.568+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:40.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:40 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:40.568+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:40.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:40 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:40.568+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:41.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:40 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:40.766+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:41.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:40 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:40.766+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:41.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:40 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:40.766+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.276048+0000 front 2024-09-21T01:17:12.276265+0000 (oldest deadline 2024-09-21T01:17:35.176138+0000) 2024-09-21T01:17:41.285 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:41 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:41.025+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:41.285 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:41 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:41.025+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:41.285 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:41 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:41.025+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:41.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:41 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:41.329+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:41.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:41 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:41.329+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:41.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:41 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:41.329+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:41.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:41 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:41.559+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:41.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:41 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:41.559+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:41.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:41 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:41.559+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:41.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:41 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:41.398+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:41.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:41 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:41.398+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:41.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:41 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:41.285+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:41.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:41 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:41.285+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:41.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:41 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:41.285+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:42.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:41 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:41.776+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:42.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:41 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:41.776+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:42.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:41 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:41.776+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.276048+0000 front 2024-09-21T01:17:12.276265+0000 (oldest deadline 2024-09-21T01:17:35.176138+0000) 2024-09-21T01:17:42.114 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:41 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:41.776+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:15.176621+0000 front 2024-09-21T01:17:15.176554+0000 (oldest deadline 2024-09-21T01:17:41.076646+0000) 2024-09-21T01:17:42.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:42 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:42.055+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:42.491 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:42 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:42.055+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:42.491 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:42 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:42.055+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:42.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:42 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:42.277+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:42.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:42 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:42.277+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:42.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:42 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:42.277+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:42.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:42 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:42.576+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:42.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:42 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:42.576+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:42.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:42 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:42.576+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:42.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:42 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:42.375+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:42.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:42 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:42.375+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:42.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:42 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:42.375+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:42.738 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:42 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:42.370+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:42.738 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:42 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:42.370+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:42.739 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:42 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:42.370+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:43.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:42 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:42.738+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.072118+0000 front 2024-09-21T01:16:56.072197+0000 (oldest deadline 2024-09-21T01:17:21.972339+0000) 2024-09-21T01:17:43.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:42 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:42.738+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.774455+0000 front 2024-09-21T01:17:04.774701+0000 (oldest deadline 2024-09-21T01:17:27.074322+0000) 2024-09-21T01:17:43.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:42 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:42.738+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.276048+0000 front 2024-09-21T01:17:12.276265+0000 (oldest deadline 2024-09-21T01:17:35.176138+0000) 2024-09-21T01:17:43.113 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:42 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6[59093]: 2024-09-21T01:17:42.738+0000 7f339209d640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:15.176621+0000 front 2024-09-21T01:17:15.176554+0000 (oldest deadline 2024-09-21T01:17:41.076646+0000) 2024-09-21T01:17:43.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:43 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:43.097+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:43.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:43 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:43.097+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:43.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:43 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:43.097+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:43.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:43 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:43.307+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:43.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:43 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:43.307+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:43.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:43 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:43.307+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:43.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:43 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:43.353+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:43.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:43 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:43.353+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:43.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:43 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:43.353+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:43.631 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:43 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:43.533+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:43.631 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:43 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:43.533+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:43.631 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:43 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:43.533+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:43.631 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:43 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:43.339+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:43.632 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:43 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:43.339+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:43.632 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:43 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:43.339+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:44.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:44 smithi148 podman[89840]: 2024-09-21 01:17:44.058705472 +0000 UTC m=+5.534808155 container died 01b17111167b3bd09beadf00aa5ce51180ab9d5c8872ee1febb64dbd14e03545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:17:44.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:44 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:44.122+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:44.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:44 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:44.122+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:44.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:44 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:44.122+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:44.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:44 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:44.275+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:44.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:44 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:44.275+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:44.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:44 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:44.275+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:44.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:44 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:44.275+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:44.613 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:44 smithi148 podman[89840]: 2024-09-21 01:17:44.548761179 +0000 UTC m=+6.024863862 container cleanup 01b17111167b3bd09beadf00aa5ce51180ab9d5c8872ee1febb64dbd14e03545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:17:44.613 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:44 smithi148 bash[89840]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6 2024-09-21T01:17:44.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:44 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:44.385+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:44.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:44 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:44.385+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:44.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:44 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:44.385+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:44.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:44 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:44.385+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:44.643 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:44 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:44.347+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:44.643 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:44 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:44.347+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:44.643 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:44 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:44.347+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:44.643 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:44 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:44.502+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:44.643 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:44 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:44.502+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:44.643 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:44 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:44.502+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:45.106 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:44 smithi148 podman[89855]: 2024-09-21 01:17:44.792168019 +0000 UTC m=+0.734143629 container remove 01b17111167b3bd09beadf00aa5ce51180ab9d5c8872ee1febb64dbd14e03545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T01:17:45.363 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:45 smithi148 podman[89945]: 2024-09-21 01:17:45.009681812 +0000 UTC m=+0.015319785 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:17:45.364 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:45 smithi148 podman[89945]: 2024-09-21 01:17:45.117966421 +0000 UTC m=+0.123604453 container create 72b35e204aea14f8583b6a19e6867bd8f5d001cc38de15390d7daf773cdf21ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T01:17:45.364 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:45 smithi148 podman[89945]: 2024-09-21 01:17:45.337767205 +0000 UTC m=+0.343405182 container init 72b35e204aea14f8583b6a19e6867bd8f5d001cc38de15390d7daf773cdf21ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T01:17:45.364 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:45 smithi148 podman[89945]: 2024-09-21 01:17:45.341307557 +0000 UTC m=+0.346945524 container start 72b35e204aea14f8583b6a19e6867bd8f5d001cc38de15390d7daf773cdf21ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:17:45.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:45 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:45.149+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:45.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:45 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:45.149+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:45.491 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:45 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:45.149+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:45.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:45 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:45.270+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:45.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:45 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:45.270+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:45.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:45 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:45.270+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:45.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:45 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:45.270+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:45.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:45 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:45.530+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:45.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:45 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:45.530+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:45.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:45 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:45.530+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:45.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:45 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:45.332+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:45.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:45 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:45.332+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:45.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:45 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:45.332+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:45.815 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:45 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:45.371+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:45.815 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:45 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:45.371+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:45.815 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:45 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:45.371+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:45.815 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:45 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:45.371+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:45.815 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:45 smithi148 podman[89945]: 2024-09-21 01:17:45.437449349 +0000 UTC m=+0.443087330 container attach 72b35e204aea14f8583b6a19e6867bd8f5d001cc38de15390d7daf773cdf21ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:17:45.815 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 21 01:17:45 smithi148 podman[89945]: 2024-09-21 01:17:45.526217682 +0000 UTC m=+0.531855660 container died 72b35e204aea14f8583b6a19e6867bd8f5d001cc38de15390d7daf773cdf21ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T01:17:46.227 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T01:17:46.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:17:46.268 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T01:17:46.268 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T01:17:46.268 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.7 2024-09-21T01:17:46.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:46.189+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:46.491 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:46.189+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:46.491 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:46.189+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:46.491 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:46 smithi157 systemd[1]: Stopping Ceph osd.7 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:17:46.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:46.255+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:46.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:46.255+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:46.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:46.255+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:46.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:46.255+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:46.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:46 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:46.372+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:46.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:46 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:46.372+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:46.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:46 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:46.372+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:46.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:46 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:46.372+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:46.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:46 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:46.331+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:46.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:46 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:46.331+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:46.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:46 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:46.331+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:46.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:46 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:46.570+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:46.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:46 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:46.570+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:46.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:46 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:46.570+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:46.990 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:46.600+0000 7f06aeffa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:17:46.990 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:46.600+0000 7f06aeffa640 -1 osd.7 79 *** Got signal Terminated *** 2024-09-21T01:17:46.990 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:46.600+0000 7f06aeffa640 -1 osd.7 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:17:47.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:47 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:47.230+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:47.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:47 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:47.230+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:47.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:47 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:47.230+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:47.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:47 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:47.250+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:47.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:47 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:47.250+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:47.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:47 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:47.250+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:47.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:47 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:47.250+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:47.603 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:47 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:47.333+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:47.603 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:47 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:47.333+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:47.603 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:47 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:47.333+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:47.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:47 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:47.406+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:47.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:47 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:47.406+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:47.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:47 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:47.406+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:47.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:47 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:47.406+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:47.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:47 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:47.602+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:47.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:47 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:47.602+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:47.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:47 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:47.602+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:48.593 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:48 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:48.303+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:48.593 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:48 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:48.303+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:48.593 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:48 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:48.303+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:48.740 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:48 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:48.254+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:48.740 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:48 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:48.254+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:48.740 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:48 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:48.254+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:48.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:48 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:48.274+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:48.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:48 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:48.274+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:48.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:48 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:48.274+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:48.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:48 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:48.274+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:48.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:48 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:48.375+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:48.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:48 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:48.375+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:48.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:48 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:48.375+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:48.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:48 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:48.375+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:48.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:48 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:48.592+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:48.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:48 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:48.592+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:48.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:48 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:48.592+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:49.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:49 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:49.277+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:49.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:49 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:49.277+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:49.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:49 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:49.277+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:49.491 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:49 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:49.277+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.861529+0000 front 2024-09-21T01:17:26.861552+0000 (oldest deadline 2024-09-21T01:17:49.161607+0000) 2024-09-21T01:17:49.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:49 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:49.232+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:49.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:49 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:49.232+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:49.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:49 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:49.232+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:49.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:49 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:49.232+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:49.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:49 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:49.335+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:49.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:49 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:49.335+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:49.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:49 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:49.335+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:49.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:49 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:49.335+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:49.636 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:49 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:49.263+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:49.636 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:49 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:49.263+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:49.636 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:49 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:49.263+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:49.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:49 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:49.635+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:49.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:49 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:49.635+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:49.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:49 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:49.635+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:50.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:50 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:50.312+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:50.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:50 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:50.312+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:50.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:50 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:50.312+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:50.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:50 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:50.312+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.861529+0000 front 2024-09-21T01:17:26.861552+0000 (oldest deadline 2024-09-21T01:17:49.161607+0000) 2024-09-21T01:17:50.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:50 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:50.194+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:50.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:50 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:50.194+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:50.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:50 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:50.194+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:50.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:50 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:50.194+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:50.623 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:50 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:50.229+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:50.624 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:50 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:50.229+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:50.624 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:50 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:50.229+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:50.624 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:50 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:50.229+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:27.301690+0000 front 2024-09-21T01:17:27.301702+0000 (oldest deadline 2024-09-21T01:17:49.601499+0000) 2024-09-21T01:17:50.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:50 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:50.369+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:50.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:50 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:50.369+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:50.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:50 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:50.369+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:50.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:50 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:50.369+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:50.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:50 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:50.623+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:50.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:50 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:50.623+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:50.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:50 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:50.623+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:51.482 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:51 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:51.225+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:51.482 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:51 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:51.225+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:51.482 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:51 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:51.225+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:51.482 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:51 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:51.225+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:27.301690+0000 front 2024-09-21T01:17:27.301702+0000 (oldest deadline 2024-09-21T01:17:49.601499+0000) 2024-09-21T01:17:51.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:51 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:51.349+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.458449+0000 front 2024-09-21T01:17:03.458486+0000 (oldest deadline 2024-09-21T01:17:28.158650+0000) 2024-09-21T01:17:51.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:51 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:51.349+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.460128+0000 front 2024-09-21T01:17:10.460061+0000 (oldest deadline 2024-09-21T01:17:35.759754+0000) 2024-09-21T01:17:51.490 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:51 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:51.349+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.860579+0000 front 2024-09-21T01:17:19.860727+0000 (oldest deadline 2024-09-21T01:17:40.960676+0000) 2024-09-21T01:17:51.491 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:51 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7[50819]: 2024-09-21T01:17:51.349+0000 7f06ab5e5640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.861529+0000 front 2024-09-21T01:17:26.861552+0000 (oldest deadline 2024-09-21T01:17:49.161607+0000) 2024-09-21T01:17:51.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:51 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:51.209+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:51.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:51 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:51.209+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:51.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:51 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:51.209+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:51.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:51 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:51.209+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:51.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:51 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:51.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:51.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:51 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:51.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:51.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:51 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:51.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:51.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:51 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:51.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:51.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:51 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:51.664+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:51.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:51 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:51.664+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:51.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:51 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:51.664+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:52.353 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:52 smithi157 podman[65583]: 2024-09-21 01:17:52.096517683 +0000 UTC m=+5.631558032 container died ec577399533299a99eb81901fea4086753552232375593b21fadcb59bd990a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-21T01:17:52.353 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:52 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:52.178+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:52.353 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:52 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:52.178+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:52.353 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:52 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:52.178+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:52.353 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:52 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:52.178+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:52.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:52 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:52.324+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:52.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:52 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:52.324+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:52.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:52 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:52.324+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:52.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:52 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:52.324+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:52.646 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:52 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:52.239+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:52.646 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:52 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:52.239+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:52.646 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:52 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:52.239+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:52.646 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:52 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:52.239+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:27.301690+0000 front 2024-09-21T01:17:27.301702+0000 (oldest deadline 2024-09-21T01:17:49.601499+0000) 2024-09-21T01:17:52.647 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:52 smithi157 podman[65583]: 2024-09-21 01:17:52.459329533 +0000 UTC m=+5.994369873 container cleanup ec577399533299a99eb81901fea4086753552232375593b21fadcb59bd990a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:17:52.647 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:52 smithi157 bash[65583]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7 2024-09-21T01:17:52.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:52 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:52.645+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:52.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:52 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:52.645+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:52.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:52 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:52.645+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:52.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:52 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:52.645+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:17:52.990 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:52 smithi157 podman[65608]: 2024-09-21 01:17:52.71922581 +0000 UTC m=+0.624314842 container remove ec577399533299a99eb81901fea4086753552232375593b21fadcb59bd990a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T01:17:53.380 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:53 smithi157 podman[65698]: 2024-09-21 01:17:52.970733717 +0000 UTC m=+0.016043089 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:17:53.381 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:53 smithi157 podman[65698]: 2024-09-21 01:17:53.095076479 +0000 UTC m=+0.140385844 container create 3c07cd74d7d939e3f67811ea18e1f199147f1b1f0ce7126fbcf88c89e5382cf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:17:53.381 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:53 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:53.137+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:53.381 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:53 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:53.137+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:53.381 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:53 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:53.137+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:53.381 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:53 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:53.137+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:53.381 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:53 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:53.137+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:17:53.596 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:53 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:53.285+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:53.596 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:53 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:53.285+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:53.596 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:53 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:53.285+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:53.596 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:53 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:53.285+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:27.301690+0000 front 2024-09-21T01:17:27.301702+0000 (oldest deadline 2024-09-21T01:17:49.601499+0000) 2024-09-21T01:17:53.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:53 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:53.359+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:53.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:53 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:53.359+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:53.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:53 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:53.359+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:53.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:53 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:53.359+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:53.741 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:53 smithi157 podman[65698]: 2024-09-21 01:17:53.380986279 +0000 UTC m=+0.426295642 container init 3c07cd74d7d939e3f67811ea18e1f199147f1b1f0ce7126fbcf88c89e5382cf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-21T01:17:53.741 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:53 smithi157 podman[65698]: 2024-09-21 01:17:53.384464362 +0000 UTC m=+0.429773727 container start 3c07cd74d7d939e3f67811ea18e1f199147f1b1f0ce7126fbcf88c89e5382cf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T01:17:53.741 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:53 smithi157 podman[65698]: 2024-09-21 01:17:53.46412681 +0000 UTC m=+0.509436172 container attach 3c07cd74d7d939e3f67811ea18e1f199147f1b1f0ce7126fbcf88c89e5382cf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T01:17:53.741 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:53 smithi157 podman[65698]: 2024-09-21 01:17:53.573623046 +0000 UTC m=+0.618932409 container died 3c07cd74d7d939e3f67811ea18e1f199147f1b1f0ce7126fbcf88c89e5382cf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:17:53.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:53 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:53.595+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:53.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:53 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:53.595+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:53.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:53 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:53.595+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:53.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:53 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:53.595+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:17:54.100 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T01:17:54.108 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:54 smithi157 podman[65720]: 2024-09-21 01:17:54.076111099 +0000 UTC m=+0.496395774 container remove 3c07cd74d7d939e3f67811ea18e1f199147f1b1f0ce7126fbcf88c89e5382cf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:17:54.108 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:54 smithi157 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.7.service: Deactivated successfully. 2024-09-21T01:17:54.108 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:54 smithi157 systemd[1]: Stopped Ceph osd.7 for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:17:54.108 INFO:journalctl@ceph.osd.7.smithi157.stdout:Sep 21 01:17:54 smithi157 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.7.service: Consumed 5.391s CPU time. 2024-09-21T01:17:54.142 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:17:54.142 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T01:17:54.143 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T01:17:54.143 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.8 2024-09-21T01:17:54.480 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:54 smithi181 systemd[1]: Stopping Ceph osd.8 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:17:54.481 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:54.328+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:54.481 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:54.328+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:54.481 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:54.328+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:54.481 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:54.328+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:27.301690+0000 front 2024-09-21T01:17:27.301702+0000 (oldest deadline 2024-09-21T01:17:49.601499+0000) 2024-09-21T01:17:54.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:54 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:54.152+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:54.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:54 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:54.152+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:54.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:54 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:54.152+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:54.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:54 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:54.152+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:54.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:54 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:54.152+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:17:54.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:54 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:54.348+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:54.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:54 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:54.348+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:54.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:54 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:54.348+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:54.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:54 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:54.348+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:54.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:54 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:54.348+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:17:54.980 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:54.490+0000 7fe94f787640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:17:54.980 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:54.490+0000 7fe94f787640 -1 osd.8 79 *** Got signal Terminated *** 2024-09-21T01:17:54.980 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:54.490+0000 7fe94f787640 -1 osd.8 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:17:54.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:54.592+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:54.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:54.592+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:54.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:54.592+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:54.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:54 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:54.592+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:17:55.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:55 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:55.160+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:55.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:55 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:55.160+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:55.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:55 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:55.160+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:55.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:55 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:55.160+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:55.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:55 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:55.160+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:17:55.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:55.342+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:55.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:55.342+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:55.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:55.342+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:55.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:55.342+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:55.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:55 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:55.342+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:17:55.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:55 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:55.364+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:55.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:55 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:55.364+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:55.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:55 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:55.364+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:55.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:55 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:55.364+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:27.301690+0000 front 2024-09-21T01:17:27.301702+0000 (oldest deadline 2024-09-21T01:17:49.601499+0000) 2024-09-21T01:17:55.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:55 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:55.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:55.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:55 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:55.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:55.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:55 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:55.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:55.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:55 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:55.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:17:56.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:56 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:56.142+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:56.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:56 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:56.142+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:56.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:56 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:56.142+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:56.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:56 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:56.142+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:56.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:56 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:56.142+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:17:56.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:56 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:56.589+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:56.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:56 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:56.589+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:56.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:56 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:56.589+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:56.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:56 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:56.589+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:17:56.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:56 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:56.350+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:56.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:56 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:56.350+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:56.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:56 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:56.350+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:56.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:56 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:56.350+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:27.301690+0000 front 2024-09-21T01:17:27.301702+0000 (oldest deadline 2024-09-21T01:17:49.601499+0000) 2024-09-21T01:17:56.865 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:56 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:56.380+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:56.866 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:56 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:56.380+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:56.866 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:56 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:56.380+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:56.866 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:56 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:56.380+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:56.867 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:56 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:56.380+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:17:57.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:57 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:57.168+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:57.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:57 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:57.168+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:57.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:57 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:57.168+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:57.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:57 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:57.168+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:57.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:57 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:57.168+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:17:57.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:57 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:57.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:57.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:57 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:57.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:57.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:57 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:57.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:57.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:57 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:57.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:57.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:57 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:57.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:17:57.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:57 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:57.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:33.709590+0000 front 2024-09-21T01:17:33.709506+0000 (oldest deadline 2024-09-21T01:17:56.609314+0000) 2024-09-21T01:17:57.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:57 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:57.540+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:57.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:57 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:57.540+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:57.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:57 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:57.540+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:57.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:57 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:57.540+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:17:57.732 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:57 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:57.381+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:57.732 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:57 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:57.381+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:57.732 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:57 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:57.381+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:57.732 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:57 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:57.381+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:27.301690+0000 front 2024-09-21T01:17:27.301702+0000 (oldest deadline 2024-09-21T01:17:49.601499+0000) 2024-09-21T01:17:58.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:58 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:58.217+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:58.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:58 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:58.217+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:58.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:58 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:58.217+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:58.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:58 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:58.217+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:58.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:58 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:58.217+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:17:58.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:58 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:58.217+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:17:58.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:58 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:58.296+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:58.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:58 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:58.296+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:58.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:58 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:58.296+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:58.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:58 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:58.296+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:58.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:58 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:58.296+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:17:58.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:58 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:58.296+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:33.709590+0000 front 2024-09-21T01:17:33.709506+0000 (oldest deadline 2024-09-21T01:17:56.609314+0000) 2024-09-21T01:17:58.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:58 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:58.568+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:58.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:58 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:58.568+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:58.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:58 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:58.568+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:58.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:58 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:58.569+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:17:58.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:58 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:58.383+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:58.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:58 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:58.383+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:58.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:58 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:58.383+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:58.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:58 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:58.383+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:27.301690+0000 front 2024-09-21T01:17:27.301702+0000 (oldest deadline 2024-09-21T01:17:49.601499+0000) 2024-09-21T01:17:59.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:59.188+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:17:59.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:59.188+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:17:59.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:59.188+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:17:59.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:59.188+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:17:59.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:59.188+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:17:59.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:17:59 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:17:59.188+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:17:59.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:59 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:59.305+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:17:59.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:59 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:59.305+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:17:59.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:59 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:59.305+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:17:59.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:59 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:59.305+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:17:59.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:59 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:59.305+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:17:59.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:17:59 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:17:59.305+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:33.709590+0000 front 2024-09-21T01:17:33.709506+0000 (oldest deadline 2024-09-21T01:17:56.609314+0000) 2024-09-21T01:17:59.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:59 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:59.548+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:17:59.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:59 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:59.548+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:17:59.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:59 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:59.548+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:17:59.731 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:17:59 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:17:59.548+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:17:59.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:59 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:59.388+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:04.598255+0000 front 2024-09-21T01:17:04.598101+0000 (oldest deadline 2024-09-21T01:17:26.897958+0000) 2024-09-21T01:17:59.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:59 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:59.388+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.998787+0000 front 2024-09-21T01:17:10.998859+0000 (oldest deadline 2024-09-21T01:17:33.898968+0000) 2024-09-21T01:17:59.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:59 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:59.388+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:18.000017+0000 front 2024-09-21T01:17:18.000085+0000 (oldest deadline 2024-09-21T01:17:42.099971+0000) 2024-09-21T01:17:59.731 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:59 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8[52319]: 2024-09-21T01:17:59.388+0000 7fe947d6a640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:27.301690+0000 front 2024-09-21T01:17:27.301702+0000 (oldest deadline 2024-09-21T01:17:49.601499+0000) 2024-09-21T01:18:00.182 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:17:59 smithi181 podman[66899]: 2024-09-21 01:17:59.873762166 +0000 UTC m=+5.530773170 container died 4ea80c4211b44d832812caa6bad963c9684524bc8a377300255f019f80e4f673 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-21T01:18:00.183 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:18:00 smithi181 podman[66899]: 2024-09-21 01:18:00.182511116 +0000 UTC m=+5.839522122 container cleanup 4ea80c4211b44d832812caa6bad963c9684524bc8a377300255f019f80e4f673 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T01:18:00.480 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:18:00 smithi181 bash[66899]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8 2024-09-21T01:18:00.480 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:18:00 smithi181 podman[66915]: 2024-09-21 01:18:00.408790952 +0000 UTC m=+0.528319356 container remove 4ea80c4211b44d832812caa6bad963c9684524bc8a377300255f019f80e4f673 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:18:00.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:00 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:00.227+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:00.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:00 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:00.227+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:00.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:00 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:00.227+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:00.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:00 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:00.227+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:00.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:00 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:00.227+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:00.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:00 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:00.227+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:00.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:00 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:00.287+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:18:00.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:00 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:00.287+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:18:00.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:00 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:00.287+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:18:00.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:00 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:00.287+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:18:00.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:00 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:00.287+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:18:00.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:00 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:00.287+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:33.709590+0000 front 2024-09-21T01:17:33.709506+0000 (oldest deadline 2024-09-21T01:17:56.609314+0000) 2024-09-21T01:18:00.833 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:18:00 smithi181 podman[66999]: 2024-09-21 01:18:00.71824724 +0000 UTC m=+0.110989600 container create fb058778e5a4efd25ef5edf6c5e1e449eafcd2f01284417b4defd60a334c9590 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:18:00.833 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:18:00 smithi181 podman[66999]: 2024-09-21 01:18:00.623315561 +0000 UTC m=+0.016057915 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:18:00.833 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:00 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:00.517+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:00.833 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:00 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:00.517+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:00.833 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:00 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:00.517+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:00.833 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:00 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:00.517+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:00.833 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:00 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:00.517+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:01.163 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:18:00 smithi181 podman[66999]: 2024-09-21 01:18:00.970528512 +0000 UTC m=+0.363270866 container init fb058778e5a4efd25ef5edf6c5e1e449eafcd2f01284417b4defd60a334c9590 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T01:18:01.163 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:18:00 smithi181 podman[66999]: 2024-09-21 01:18:00.973807923 +0000 UTC m=+0.366550281 container start fb058778e5a4efd25ef5edf6c5e1e449eafcd2f01284417b4defd60a334c9590 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T01:18:01.163 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:18:01 smithi181 podman[66999]: 2024-09-21 01:18:01.028755504 +0000 UTC m=+0.421497873 container attach fb058778e5a4efd25ef5edf6c5e1e449eafcd2f01284417b4defd60a334c9590 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T01:18:01.457 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 01:18:01 smithi181 podman[66999]: 2024-09-21 01:18:01.163665992 +0000 UTC m=+0.556408354 container died fb058778e5a4efd25ef5edf6c5e1e449eafcd2f01284417b4defd60a334c9590 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T01:18:01.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:01 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:01.330+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:18:01.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:01 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:01.330+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:18:01.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:01 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:01.330+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:18:01.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:01 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:01.330+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:18:01.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:01 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:01.330+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:18:01.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:01 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:01.330+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:33.709590+0000 front 2024-09-21T01:17:33.709506+0000 (oldest deadline 2024-09-21T01:17:56.609314+0000) 2024-09-21T01:18:01.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:01 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:01.479+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:01.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:01 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:01.479+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:01.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:01 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:01.479+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:01.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:01 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:01.479+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:01.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:01 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:01.479+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:01.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:01 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:01.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:01.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:01 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:01.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:01.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:01 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:01.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:01.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:01 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:01.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:01.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:01 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:01.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:01.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:01 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:01.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:01.776 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T01:18:01.817 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:01.818 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T01:18:01.818 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T01:18:01.818 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.9 2024-09-21T01:18:02.113 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:01 smithi148 systemd[1]: Stopping Ceph osd.9 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:02.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:02 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:02.219+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:02.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:02 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:02.219+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:02.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:02 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:02.219+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:02.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:02 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:02.219+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:02.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:02 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:02.219+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:02.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:02 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:02.219+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:02.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:02 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:02.117+0000 7f21c5255640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:02.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:02 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:02.117+0000 7f21c5255640 -1 osd.9 79 *** Got signal Terminated *** 2024-09-21T01:18:02.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:02 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:02.117+0000 7f21c5255640 -1 osd.9 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:18:02.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:02 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:02.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:18:02.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:02 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:02.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:18:02.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:02 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:02.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:18:02.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:02 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:02.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:18:02.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:02 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:02.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:18:02.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:02 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:02.336+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:33.709590+0000 front 2024-09-21T01:17:33.709506+0000 (oldest deadline 2024-09-21T01:17:56.609314+0000) 2024-09-21T01:18:02.873 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:02 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:02.487+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:02.873 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:02 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:02.487+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:02.873 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:02 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:02.487+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:02.873 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:02 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:02.487+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:02.873 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:02 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:02.487+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:03.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:03 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:03.232+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:03.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:03 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:03.232+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:03.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:03 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:03.232+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:03.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:03 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:03.232+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:03.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:03 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:03.232+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:03.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:03 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:03.232+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:03.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:03 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:03.373+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:18:03.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:03 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:03.373+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:18:03.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:03 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:03.373+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:18:03.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:03 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:03.373+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:18:03.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:03 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:03.373+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:18:03.864 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:03 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:03.373+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:33.709590+0000 front 2024-09-21T01:17:33.709506+0000 (oldest deadline 2024-09-21T01:17:56.609314+0000) 2024-09-21T01:18:03.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:03 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:03.496+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:03.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:03 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:03.496+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:03.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:03 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:03.496+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:03.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:03 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:03.496+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:03.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:03 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:03.496+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:04.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:04 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:04.194+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:04.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:04 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:04.194+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:04.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:04 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:04.194+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:04.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:04 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:04.194+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:04.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:04 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:04.194+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:04.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:04 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:04.194+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:04.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:04 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:04.354+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:18:04.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:04 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:04.354+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:18:04.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:04 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:04.354+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:18:04.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:04 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:04.354+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:18:04.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:04 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:04.354+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:18:04.614 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:04 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:04.354+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:33.709590+0000 front 2024-09-21T01:17:33.709506+0000 (oldest deadline 2024-09-21T01:17:56.609314+0000) 2024-09-21T01:18:04.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:04 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:04.493+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:04.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:04 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:04.493+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:04.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:04 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:04.493+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:04.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:04 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:04.493+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:04.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:04 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:04.493+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:05.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:05 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:05.199+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:05.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:05 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:05.199+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:05.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:05 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:05.199+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:05.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:05 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:05.199+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:05.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:05 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:05.199+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:05.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:05 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:05.199+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:05.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:05 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:05.399+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:18:05.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:05 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:05.399+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:18:05.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:05 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:05.399+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:18:05.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:05 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:05.399+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:18:05.864 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:05 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:05.399+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:18:05.864 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:05 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:05.399+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:33.709590+0000 front 2024-09-21T01:17:33.709506+0000 (oldest deadline 2024-09-21T01:17:56.609314+0000) 2024-09-21T01:18:05.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:05 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:05.511+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:05.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:05 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:05.511+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:05.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:05 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:05.511+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:05.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:05 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:05.511+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:05.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:05 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:05.511+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:06.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:06 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:06.200+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:06.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:06 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:06.200+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:06.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:06 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:06.200+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:06.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:06 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:06.200+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:06.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:06 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:06.200+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:06.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:06 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:06.200+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:06.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:06 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:06.414+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:52.704260+0000 front 2024-09-21T01:16:52.704277+0000 (oldest deadline 2024-09-21T01:17:18.004401+0000) 2024-09-21T01:18:06.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:06 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:06.414+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.905380+0000 front 2024-09-21T01:17:03.905318+0000 (oldest deadline 2024-09-21T01:17:25.605284+0000) 2024-09-21T01:18:06.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:06 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:06.414+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:10.206843+0000 front 2024-09-21T01:17:10.207004+0000 (oldest deadline 2024-09-21T01:17:36.106797+0000) 2024-09-21T01:18:06.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:06 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:06.414+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:19.007713+0000 front 2024-09-21T01:17:19.007784+0000 (oldest deadline 2024-09-21T01:17:44.307803+0000) 2024-09-21T01:18:06.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:06 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:06.414+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:24.308576+0000 front 2024-09-21T01:17:24.308462+0000 (oldest deadline 2024-09-21T01:17:53.708893+0000) 2024-09-21T01:18:06.863 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:06 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9[65708]: 2024-09-21T01:18:06.414+0000 7f21bd838640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:33.709590+0000 front 2024-09-21T01:17:33.709506+0000 (oldest deadline 2024-09-21T01:17:56.609314+0000) 2024-09-21T01:18:06.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:06 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:06.556+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:06.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:06 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:06.556+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:06.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:06 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:06.556+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:06.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:06 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:06.556+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:06.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:06 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:06.556+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:06.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:06 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:06.556+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:07.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:07 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:07.223+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:07.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:07 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:07.223+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:07.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:07 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:07.223+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:07.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:07 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:07.223+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:07.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:07 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:07.223+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:07.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:07 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:07.223+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:07.778 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:07 smithi148 podman[90061]: 2024-09-21 01:18:07.500543522 +0000 UTC m=+5.485622834 container died ace83319757f8b8f29160588b3a1df9a23562ebf244a99bcc943fe95b893749e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T01:18:07.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:07 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:07.535+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:07.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:07 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:07.535+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:07.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:07 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:07.535+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:07.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:07 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:07.535+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:07.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:07 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:07.535+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:07.981 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:07 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:07.535+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:08.113 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:07 smithi148 podman[90061]: 2024-09-21 01:18:07.951756146 +0000 UTC m=+5.936835458 container cleanup ace83319757f8b8f29160588b3a1df9a23562ebf244a99bcc943fe95b893749e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T01:18:08.113 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:07 smithi148 bash[90061]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9 2024-09-21T01:18:08.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:08 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:08.195+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:08.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:08 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:08.195+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:08.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:08 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:08.195+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:08.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:08 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:08.195+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:08.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:08 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:08.195+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:08.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:08 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:08.195+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:08.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:08 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:08.195+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:42.843559+0000 front 2024-09-21T01:17:42.843653+0000 (oldest deadline 2024-09-21T01:18:08.143447+0000) 2024-09-21T01:18:08.613 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:08 smithi148 podman[90078]: 2024-09-21 01:18:08.286447996 +0000 UTC m=+0.776752535 container remove ace83319757f8b8f29160588b3a1df9a23562ebf244a99bcc943fe95b893749e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T01:18:08.929 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:08 smithi148 podman[90165]: 2024-09-21 01:18:08.535009413 +0000 UTC m=+0.016051440 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:18:08.929 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:08 smithi148 podman[90165]: 2024-09-21 01:18:08.645494432 +0000 UTC m=+0.126536458 container create 66a0539f68e8fa19b9659a42fbd3205c242ea7a832cff1e456602424ee8d6531 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T01:18:08.929 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:08 smithi148 podman[90165]: 2024-09-21 01:18:08.872714194 +0000 UTC m=+0.353756219 container init 66a0539f68e8fa19b9659a42fbd3205c242ea7a832cff1e456602424ee8d6531 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T01:18:08.929 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:08 smithi148 podman[90165]: 2024-09-21 01:18:08.876156344 +0000 UTC m=+0.357198373 container start 66a0539f68e8fa19b9659a42fbd3205c242ea7a832cff1e456602424ee8d6531 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:18:08.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:08 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:08.509+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:08.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:08 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:08.509+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:08.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:08 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:08.509+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:08.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:08 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:08.509+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:08.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:08 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:08.509+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:08.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:08 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:08.509+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:09.337 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:08 smithi148 podman[90165]: 2024-09-21 01:18:08.959027872 +0000 UTC m=+0.440069913 container attach 66a0539f68e8fa19b9659a42fbd3205c242ea7a832cff1e456602424ee8d6531 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T01:18:09.338 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 21 01:18:09 smithi148 podman[90165]: 2024-09-21 01:18:09.069644666 +0000 UTC m=+0.550686693 container died 66a0539f68e8fa19b9659a42fbd3205c242ea7a832cff1e456602424ee8d6531 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T01:18:09.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:09 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:09.203+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:09.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:09 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:09.203+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:09.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:09 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:09.203+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:09.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:09 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:09.203+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:09.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:09 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:09.203+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:09.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:09 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:09.203+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:09.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:09 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:09.203+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:42.843559+0000 front 2024-09-21T01:17:42.843653+0000 (oldest deadline 2024-09-21T01:18:08.143447+0000) 2024-09-21T01:18:09.745 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T01:18:09.783 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:09.784 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T01:18:09.784 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T01:18:09.784 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.10 2024-09-21T01:18:09.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:09 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:09.534+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:09.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:09 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:09.534+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:09.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:09 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:09.534+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:09.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:09 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:09.534+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:09.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:09 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:09.534+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:09.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:09 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:09.534+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:10.078 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:09 smithi157 systemd[1]: Stopping Ceph osd.10 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:10.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:10 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:10.077+0000 7fc02cbf4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:10.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:10 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:10.077+0000 7fc02cbf4640 -1 osd.10 79 *** Got signal Terminated *** 2024-09-21T01:18:10.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:10 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:10.077+0000 7fc02cbf4640 -1 osd.10 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:18:10.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:10 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:10.204+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:10.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:10 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:10.204+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:10.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:10 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:10.204+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:10.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:10 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:10.204+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:10.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:10 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:10.204+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:10.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:10 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:10.204+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:10.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:10 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:10.204+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:42.843559+0000 front 2024-09-21T01:17:42.843653+0000 (oldest deadline 2024-09-21T01:18:08.143447+0000) 2024-09-21T01:18:10.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:10 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:10.526+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:10.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:10 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:10.526+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:10.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:10 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:10.526+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:10.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:10 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:10.526+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:10.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:10 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:10.526+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:10.981 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:10 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:10.526+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:11.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:11 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:11.181+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:11.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:11 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:11.181+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:11.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:11 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:11.181+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:11.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:11 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:11.181+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:11.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:11 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:11.181+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:11.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:11 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:11.181+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:11.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:11 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:11.181+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:42.843559+0000 front 2024-09-21T01:17:42.843653+0000 (oldest deadline 2024-09-21T01:18:08.143447+0000) 2024-09-21T01:18:11.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:11 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:11.573+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:11.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:11 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:11.573+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:11.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:11 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:11.573+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:11.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:11 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:11.573+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:11.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:11 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:11.573+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:11.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:11 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:11.573+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:12.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:12 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:12.221+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:12.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:12 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:12.221+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:12.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:12 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:12.221+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:12.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:12 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:12.221+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:12.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:12 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:12.221+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:12.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:12 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:12.221+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:12.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:12 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:12.221+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:42.843559+0000 front 2024-09-21T01:17:42.843653+0000 (oldest deadline 2024-09-21T01:18:08.143447+0000) 2024-09-21T01:18:12.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:12 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:12.586+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:12.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:12 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:12.586+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:12.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:12 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:12.586+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:12.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:12 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:12.586+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:12.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:12 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:12.586+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:12.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:12 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:12.586+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:13.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:13 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:13.211+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:13.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:13 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:13.211+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:13.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:13 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:13.211+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:13.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:13 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:13.211+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:13.490 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:13 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:13.211+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:13.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:13 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:13.211+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:13.491 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:13 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:13.211+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:42.843559+0000 front 2024-09-21T01:17:42.843653+0000 (oldest deadline 2024-09-21T01:18:08.143447+0000) 2024-09-21T01:18:13.881 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:13 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:13.595+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:13.881 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:13 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:13.595+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:13.882 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:13 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:13.595+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:13.882 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:13 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:13.595+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:13.882 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:13 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:13.595+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:13.882 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:13 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:13.595+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:14.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:14 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:14.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.336641+0000 front 2024-09-21T01:16:56.336656+0000 (oldest deadline 2024-09-21T01:17:20.436584+0000) 2024-09-21T01:18:14.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:14 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:14.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:03.337410+0000 front 2024-09-21T01:17:03.337386+0000 (oldest deadline 2024-09-21T01:17:26.738092+0000) 2024-09-21T01:18:14.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:14 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:14.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:12.039070+0000 front 2024-09-21T01:17:12.038957+0000 (oldest deadline 2024-09-21T01:17:33.138960+0000) 2024-09-21T01:18:14.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:14 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:14.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-21T01:17:20.040948+0000 front 2024-09-21T01:17:20.041157+0000 (oldest deadline 2024-09-21T01:17:44.140806+0000) 2024-09-21T01:18:14.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:14 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:14.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:26.942249+0000 front 2024-09-21T01:17:26.942217+0000 (oldest deadline 2024-09-21T01:17:52.242351+0000) 2024-09-21T01:18:14.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:14 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:14.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:32.243123+0000 front 2024-09-21T01:17:32.242957+0000 (oldest deadline 2024-09-21T01:17:57.542690+0000) 2024-09-21T01:18:14.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:14 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10[57522]: 2024-09-21T01:18:14.259+0000 7fc0251d7640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:42.843559+0000 front 2024-09-21T01:17:42.843653+0000 (oldest deadline 2024-09-21T01:18:08.143447+0000) 2024-09-21T01:18:14.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:14 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:14.587+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:14.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:14 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:14.587+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:14.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:14 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:14.587+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:14.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:14 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:14.587+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:14.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:14 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:14.587+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:14.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:14 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:14.587+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:14.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:14 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:14.587+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2024-09-21T01:17:49.111552+0000 front 2024-09-21T01:17:49.111655+0000 (oldest deadline 2024-09-21T01:18:14.411283+0000) 2024-09-21T01:18:15.811 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:15 smithi157 podman[65799]: 2024-09-21 01:18:15.531515325 +0000 UTC m=+5.548345448 container died d287c9caf1fd468c88680254010912f14494f0bf6fc160b440fbb42d73add5b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T01:18:15.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:15 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:15.579+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:15.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:15 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:15.579+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:15.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:15 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:15.579+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:15.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:15 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:15.579+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:15.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:15 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:15.579+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:15.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:15 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:15.579+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:15.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:15 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:15.579+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2024-09-21T01:17:49.111552+0000 front 2024-09-21T01:17:49.111655+0000 (oldest deadline 2024-09-21T01:18:14.411283+0000) 2024-09-21T01:18:16.153 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:15 smithi157 podman[65799]: 2024-09-21 01:18:15.885785529 +0000 UTC m=+5.902615654 container cleanup d287c9caf1fd468c88680254010912f14494f0bf6fc160b440fbb42d73add5b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T01:18:16.154 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:15 smithi157 bash[65799]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10 2024-09-21T01:18:16.446 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:16 smithi157 podman[65813]: 2024-09-21 01:18:16.15383194 +0000 UTC m=+0.621621594 container remove d287c9caf1fd468c88680254010912f14494f0bf6fc160b440fbb42d73add5b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T01:18:16.740 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:16 smithi157 podman[65903]: 2024-09-21 01:18:16.446207152 +0000 UTC m=+0.095677303 container create ecfc696555784666c3cbfb2259fc60387d9a6d61b0036a19963f5f5be506ff59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:18:16.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:16 smithi157 podman[65903]: 2024-09-21 01:18:16.366268139 +0000 UTC m=+0.015738290 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:18:16.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:16 smithi157 podman[65903]: 2024-09-21 01:18:16.656867898 +0000 UTC m=+0.306338050 container init ecfc696555784666c3cbfb2259fc60387d9a6d61b0036a19963f5f5be506ff59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T01:18:16.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:16 smithi157 podman[65903]: 2024-09-21 01:18:16.66011202 +0000 UTC m=+0.309582170 container start ecfc696555784666c3cbfb2259fc60387d9a6d61b0036a19963f5f5be506ff59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T01:18:16.741 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:16 smithi157 podman[65903]: 2024-09-21 01:18:16.740164807 +0000 UTC m=+0.389634958 container attach ecfc696555784666c3cbfb2259fc60387d9a6d61b0036a19963f5f5be506ff59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T01:18:16.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:16 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:16.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:16.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:16 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:16.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:16.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:16 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:16.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:16.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:16 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:16.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:16.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:16 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:16.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:16.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:16 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:16.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:16.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:16 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:16.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2024-09-21T01:17:49.111552+0000 front 2024-09-21T01:17:49.111655+0000 (oldest deadline 2024-09-21T01:18:14.411283+0000) 2024-09-21T01:18:16.990 INFO:journalctl@ceph.osd.10.smithi157.stdout:Sep 21 01:18:16 smithi157 podman[65903]: 2024-09-21 01:18:16.851645744 +0000 UTC m=+0.501115894 container died ecfc696555784666c3cbfb2259fc60387d9a6d61b0036a19963f5f5be506ff59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T01:18:17.447 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T01:18:17.484 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:17.484 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T01:18:17.484 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T01:18:17.485 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.11 2024-09-21T01:18:17.794 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 systemd[1]: Stopping Ceph osd.11 for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:17.794 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:17.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:17.794 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:17.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:17.794 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:17.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:17.794 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:17.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:17.794 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:17.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:17.794 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:17.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:17.794 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:17.563+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2024-09-21T01:17:49.111552+0000 front 2024-09-21T01:17:49.111655+0000 (oldest deadline 2024-09-21T01:18:14.411283+0000) 2024-09-21T01:18:17.795 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:17.792+0000 7f5c7a6d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:17.795 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:17.792+0000 7f5c7a6d5640 -1 osd.11 79 *** Got signal Terminated *** 2024-09-21T01:18:17.795 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:17 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:17.792+0000 7f5c7a6d5640 -1 osd.11 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:18:18.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:18 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:18.578+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:18.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:18 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:18.578+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:18.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:18 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:18.578+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:18.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:18 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:18.578+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:18.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:18 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:18.578+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:18.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:18 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:18.578+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:18.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:18 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:18.578+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2024-09-21T01:17:49.111552+0000 front 2024-09-21T01:17:49.111655+0000 (oldest deadline 2024-09-21T01:18:14.411283+0000) 2024-09-21T01:18:19.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:19 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:19.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:19.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:19 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:19.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:19.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:19 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:19.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:19.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:19 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:19.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:19.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:19 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:19.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:19.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:19 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:19.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:19.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:19 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:19.564+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2024-09-21T01:17:49.111552+0000 front 2024-09-21T01:17:49.111655+0000 (oldest deadline 2024-09-21T01:18:14.411283+0000) 2024-09-21T01:18:20.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:20 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:20.547+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:20.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:20 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:20.547+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:20.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:20 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:20.547+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:20.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:20 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:20.547+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:20.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:20 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:20.547+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:20.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:20 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:20.547+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:20.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:20 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:20.547+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2024-09-21T01:17:49.111552+0000 front 2024-09-21T01:17:49.111655+0000 (oldest deadline 2024-09-21T01:18:14.411283+0000) 2024-09-21T01:18:21.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:21 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:21.508+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:21.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:21 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:21.508+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:21.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:21 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:21.508+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:21.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:21 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:21.508+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:21.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:21 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:21.508+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:21.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:21 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:21.508+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:21.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:21 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:21.508+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2024-09-21T01:17:49.111552+0000 front 2024-09-21T01:17:49.111655+0000 (oldest deadline 2024-09-21T01:18:14.411283+0000) 2024-09-21T01:18:22.980 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:22.506+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-21T01:16:56.302091+0000 front 2024-09-21T01:16:56.302059+0000 (oldest deadline 2024-09-21T01:17:19.201993+0000) 2024-09-21T01:18:22.991 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:22.506+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2024-09-21T01:17:00.903136+0000 front 2024-09-21T01:17:00.903245+0000 (oldest deadline 2024-09-21T01:17:26.203290+0000) 2024-09-21T01:18:22.991 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:22.506+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T01:17:11.905040+0000 front 2024-09-21T01:17:11.905119+0000 (oldest deadline 2024-09-21T01:17:37.805237+0000) 2024-09-21T01:18:22.991 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:22.506+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2024-09-21T01:17:28.207974+0000 front 2024-09-21T01:17:28.208130+0000 (oldest deadline 2024-09-21T01:17:52.307890+0000) 2024-09-21T01:18:22.991 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:22.506+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T01:17:35.709259+0000 front 2024-09-21T01:17:35.709296+0000 (oldest deadline 2024-09-21T01:18:00.409355+0000) 2024-09-21T01:18:22.991 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:22.506+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-21T01:17:40.409902+0000 front 2024-09-21T01:17:40.409870+0000 (oldest deadline 2024-09-21T01:18:06.309989+0000) 2024-09-21T01:18:22.991 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:22 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11[58553]: 2024-09-21T01:18:22.506+0000 7f5c76cc0640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2024-09-21T01:17:49.111552+0000 front 2024-09-21T01:17:49.111655+0000 (oldest deadline 2024-09-21T01:18:14.411283+0000) 2024-09-21T01:18:23.378 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:23 smithi181 podman[67118]: 2024-09-21 01:18:23.113786177 +0000 UTC m=+5.430519339 container died 4246881716a6d722d45f63ec389bdfe60ae978e5b95e8ffb10c2746b536318de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:18:23.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:23 smithi181 podman[67118]: 2024-09-21 01:18:23.484573662 +0000 UTC m=+5.801306814 container cleanup 4246881716a6d722d45f63ec389bdfe60ae978e5b95e8ffb10c2746b536318de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T01:18:23.730 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:23 smithi181 bash[67118]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11 2024-09-21T01:18:24.093 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:23 smithi181 podman[67133]: 2024-09-21 01:18:23.74413173 +0000 UTC m=+0.628392254 container remove 4246881716a6d722d45f63ec389bdfe60ae978e5b95e8ffb10c2746b536318de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T01:18:24.413 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:24 smithi181 podman[67222]: 2024-09-21 01:18:23.99640943 +0000 UTC m=+0.016007927 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:18:24.413 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:24 smithi181 podman[67222]: 2024-09-21 01:18:24.094863238 +0000 UTC m=+0.114461774 container create 115d64d5e1c0a1856b1020de7f4298e78623998cf3e50b1ca8a03cde08494458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:18:24.413 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:24 smithi181 podman[67222]: 2024-09-21 01:18:24.330616519 +0000 UTC m=+0.350215013 container init 115d64d5e1c0a1856b1020de7f4298e78623998cf3e50b1ca8a03cde08494458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:18:24.413 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:24 smithi181 podman[67222]: 2024-09-21 01:18:24.333882822 +0000 UTC m=+0.353481312 container start 115d64d5e1c0a1856b1020de7f4298e78623998cf3e50b1ca8a03cde08494458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:18:24.414 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:24 smithi181 podman[67222]: 2024-09-21 01:18:24.413615565 +0000 UTC m=+0.433214054 container attach 115d64d5e1c0a1856b1020de7f4298e78623998cf3e50b1ca8a03cde08494458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:18:24.721 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 01:18:24 smithi181 podman[67222]: 2024-09-21 01:18:24.528427085 +0000 UTC m=+0.548025583 container died 115d64d5e1c0a1856b1020de7f4298e78623998cf3e50b1ca8a03cde08494458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:18:25.157 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T01:18:25.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:25.195 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T01:18:25.195 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T01:18:25.195 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.a 2024-09-21T01:18:25.496 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:18:25 smithi148 systemd[1]: Stopping Ceph mds.a for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:25.863 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:18:25 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-a[72428]: 2024-09-21T01:18:25.495+0000 7f8ff9cbe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:25.863 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:18:25 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-a[72428]: 2024-09-21T01:18:25.495+0000 7f8ff9cbe640 -1 mds.a *** got signal Terminated *** 2024-09-21T01:18:27.613 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:18:27 smithi148 podman[90280]: 2024-09-21 01:18:27.267974629 +0000 UTC m=+1.871537719 container died 9e47f141c712e1d9438e24e10343e466ef7bcfbf19a2829b29e666c2b4fda4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:18:28.105 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:18:27 smithi148 podman[90280]: 2024-09-21 01:18:27.820335755 +0000 UTC m=+2.423898899 container cleanup 9e47f141c712e1d9438e24e10343e466ef7bcfbf19a2829b29e666c2b4fda4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-a, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:18:28.105 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 21 01:18:27 smithi148 bash[90280]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-a 2024-09-21T01:18:28.251 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T01:18:28.295 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:28.295 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T01:18:28.296 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T01:18:28.296 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.d 2024-09-21T01:18:28.613 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 21 01:18:28 smithi148 systemd[1]: Stopping Ceph mds.d for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:29.113 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 21 01:18:28 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-d[71405]: 2024-09-21T01:18:28.643+0000 7f31aa184640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:29.113 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 21 01:18:28 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-d[71405]: 2024-09-21T01:18:28.643+0000 7f31aa184640 -1 mds.d *** got signal Terminated *** 2024-09-21T01:18:32.942 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 21 01:18:32 smithi148 podman[90401]: 2024-09-21 01:18:32.653495399 +0000 UTC m=+4.133543257 container died da72c55fed30a26626ddd341349fd76a9062c39e9700cb273605393cd8f92ffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-d, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:18:33.364 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 21 01:18:33 smithi148 podman[90401]: 2024-09-21 01:18:33.107799808 +0000 UTC m=+4.587847666 container cleanup da72c55fed30a26626ddd341349fd76a9062c39e9700cb273605393cd8f92ffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:18:33.364 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 21 01:18:33 smithi148 bash[90401]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-d 2024-09-21T01:18:33.539 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T01:18:33.578 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:33.578 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T01:18:33.579 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T01:18:33.579 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.g 2024-09-21T01:18:33.913 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 21 01:18:33 smithi148 systemd[1]: Stopping Ceph mds.g for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:34.363 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 21 01:18:33 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-g[72149]: 2024-09-21T01:18:33.912+0000 7f1af585b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:34.363 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 21 01:18:33 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-g[72149]: 2024-09-21T01:18:33.912+0000 7f1af585b640 -1 mds.g *** got signal Terminated *** 2024-09-21T01:18:36.945 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 21 01:18:36 smithi148 podman[90532]: 2024-09-21 01:18:36.641193199 +0000 UTC m=+2.836280880 container died 5aa5722d45550557ba8333f1a6d86de05a69cc1a6175cc7e210be28d6323773b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T01:18:37.363 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 21 01:18:37 smithi148 podman[90532]: 2024-09-21 01:18:37.13714492 +0000 UTC m=+3.332232642 container cleanup 5aa5722d45550557ba8333f1a6d86de05a69cc1a6175cc7e210be28d6323773b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-g, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T01:18:37.363 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 21 01:18:37 smithi148 bash[90532]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-g 2024-09-21T01:18:37.506 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T01:18:37.539 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:37.539 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T01:18:37.539 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T01:18:37.540 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.j 2024-09-21T01:18:37.985 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:18:37 smithi148 systemd[1]: Stopping Ceph mds.j for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:38.363 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:18:37 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-j[71026]: 2024-09-21T01:18:37.983+0000 7fc5b7d75640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:38.363 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:18:37 smithi148 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-j[71026]: 2024-09-21T01:18:37.983+0000 7fc5b7d75640 -1 mds.j *** got signal Terminated *** 2024-09-21T01:18:42.260 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:18:41 smithi148 podman[90651]: 2024-09-21 01:18:41.991944565 +0000 UTC m=+4.226562951 container died 57470ec5d4781c770ed1a051f149dcc10fed7ff79c5e099672d33e9ee729c56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:18:42.613 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:18:42 smithi148 podman[90651]: 2024-09-21 01:18:42.384897392 +0000 UTC m=+4.619515810 container cleanup 57470ec5d4781c770ed1a051f149dcc10fed7ff79c5e099672d33e9ee729c56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T01:18:42.613 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 21 01:18:42 smithi148 bash[90651]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-j 2024-09-21T01:18:42.753 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T01:18:42.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:42.786 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T01:18:42.786 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T01:18:42.787 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.b 2024-09-21T01:18:43.102 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:18:42 smithi157 systemd[1]: Stopping Ceph mds.b for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:43.447 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:18:43 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b[62559]: 2024-09-21T01:18:43.101+0000 7f0624b14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:43.447 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:18:43 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b[62559]: 2024-09-21T01:18:43.101+0000 7f0624b14640 -1 mds.b *** got signal Terminated *** 2024-09-21T01:18:45.668 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:18:45 smithi157 podman[66006]: 2024-09-21 01:18:45.31629813 +0000 UTC m=+2.333429906 container died bacbd2badd5706f02936a53f1e1ddc8a7a1cefd3aace4e21a22c19df198a54f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:18:45.919 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:18:45 smithi157 podman[66006]: 2024-09-21 01:18:45.743087956 +0000 UTC m=+2.760219723 container cleanup bacbd2badd5706f02936a53f1e1ddc8a7a1cefd3aace4e21a22c19df198a54f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:18:45.919 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:18:45 smithi157 bash[66006]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b 2024-09-21T01:18:46.168 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T01:18:46.190 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:18:45 smithi157 podman[66029]: 2024-09-21 01:18:45.91922243 +0000 UTC m=+0.595762498 container remove bacbd2badd5706f02936a53f1e1ddc8a7a1cefd3aace4e21a22c19df198a54f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-b, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T01:18:46.190 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:18:46 smithi157 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.b.service: Deactivated successfully. 2024-09-21T01:18:46.190 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:18:46 smithi157 systemd[1]: Stopped Ceph mds.b for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:18:46.190 INFO:journalctl@ceph.mds.b.smithi157.stdout:Sep 21 01:18:46 smithi157 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.b.service: Consumed 1.948s CPU time. 2024-09-21T01:18:46.204 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:46.204 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T01:18:46.204 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T01:18:46.204 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.e 2024-09-21T01:18:46.490 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:18:46 smithi157 systemd[1]: Stopping Ceph mds.e for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:46.990 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:18:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e[62018]: 2024-09-21T01:18:46.529+0000 7f98bf76e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:46.990 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:18:46 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e[62018]: 2024-09-21T01:18:46.529+0000 7f98bf76e640 -1 mds.e *** got signal Terminated *** 2024-09-21T01:18:49.581 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:18:49 smithi157 podman[66139]: 2024-09-21 01:18:49.316051872 +0000 UTC m=+2.890290553 container died 2e6363a72bc6adf6b8c8387e529aed8a174f4eb896193df1d8e95a96d1f02c2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T01:18:49.931 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:18:49 smithi157 podman[66139]: 2024-09-21 01:18:49.671475942 +0000 UTC m=+3.245714624 container cleanup 2e6363a72bc6adf6b8c8387e529aed8a174f4eb896193df1d8e95a96d1f02c2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T01:18:49.931 INFO:journalctl@ceph.mds.e.smithi157.stdout:Sep 21 01:18:49 smithi157 bash[66139]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-e 2024-09-21T01:18:50.104 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T01:18:50.138 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:50.138 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T01:18:50.138 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T01:18:50.139 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.h 2024-09-21T01:18:50.450 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:18:50 smithi157 systemd[1]: Stopping Ceph mds.h for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:50.740 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:18:50 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h[62288]: 2024-09-21T01:18:50.449+0000 7f3c5ac17640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:50.740 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:18:50 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h[62288]: 2024-09-21T01:18:50.449+0000 7f3c5ac17640 -1 mds.h *** got signal Terminated *** 2024-09-21T01:18:53.650 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:18:53 smithi157 podman[66261]: 2024-09-21 01:18:53.311086018 +0000 UTC m=+2.953473893 container died 633b15a168d2615711c8a429360c06754ce6a444cee188e51fe9050d393608dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:18:53.918 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:18:53 smithi157 podman[66261]: 2024-09-21 01:18:53.725179933 +0000 UTC m=+3.367567808 container cleanup 633b15a168d2615711c8a429360c06754ce6a444cee188e51fe9050d393608dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T01:18:53.918 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:18:53 smithi157 bash[66261]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h 2024-09-21T01:18:54.146 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T01:18:54.169 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:18:53 smithi157 podman[66273]: 2024-09-21 01:18:53.918051442 +0000 UTC m=+0.607165034 container remove 633b15a168d2615711c8a429360c06754ce6a444cee188e51fe9050d393608dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-21T01:18:54.169 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:18:54 smithi157 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.h.service: Deactivated successfully. 2024-09-21T01:18:54.169 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:18:54 smithi157 systemd[1]: Stopped Ceph mds.h for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:18:54.169 INFO:journalctl@ceph.mds.h.smithi157.stdout:Sep 21 01:18:54 smithi157 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.h.service: Consumed 1.449s CPU time. 2024-09-21T01:18:54.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:54.179 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T01:18:54.179 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T01:18:54.179 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.k 2024-09-21T01:18:54.490 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:18:54 smithi157 systemd[1]: Stopping Ceph mds.k for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:54.990 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:18:54 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-k[61739]: 2024-09-21T01:18:54.495+0000 7f2677331640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:54.990 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:18:54 smithi157 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-k[61739]: 2024-09-21T01:18:54.495+0000 7f2677331640 -1 mds.k *** got signal Terminated *** 2024-09-21T01:18:58.788 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:18:58 smithi157 podman[66384]: 2024-09-21 01:18:58.506896662 +0000 UTC m=+4.112179924 container died 78d7bf1036324fe05f0c89bc72bae40aa5854a155542a8c6eca9a5348252a3ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:18:59.104 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:18:58 smithi157 podman[66384]: 2024-09-21 01:18:58.862102025 +0000 UTC m=+4.467385286 container cleanup 78d7bf1036324fe05f0c89bc72bae40aa5854a155542a8c6eca9a5348252a3ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T01:18:59.105 INFO:journalctl@ceph.mds.k.smithi157.stdout:Sep 21 01:18:58 smithi157 bash[66384]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-k 2024-09-21T01:18:59.229 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T01:18:59.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:18:59.261 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T01:18:59.261 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T01:18:59.261 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.c 2024-09-21T01:18:59.314 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:18:59 smithi181 systemd[1]: Stopping Ceph mds.c for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:18:59.980 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:18:59 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c[63663]: 2024-09-21T01:18:59.575+0000 7f71d31ab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:18:59.980 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:18:59 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c[63663]: 2024-09-21T01:18:59.575+0000 7f71d31ab640 -1 mds.c *** got signal Terminated *** 2024-09-21T01:19:01.559 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:19:01 smithi181 podman[67325]: 2024-09-21 01:19:01.296567259 +0000 UTC m=+1.820192863 container died daa2361f1b8037285e2dca6bf2eb8f8aa9c4f11f517966036dfc020b8fac1aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:19:01.943 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:19:01 smithi181 podman[67325]: 2024-09-21 01:19:01.658478375 +0000 UTC m=+2.182103975 container cleanup daa2361f1b8037285e2dca6bf2eb8f8aa9c4f11f517966036dfc020b8fac1aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T01:19:01.943 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 01:19:01 smithi181 bash[67325]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-c 2024-09-21T01:19:02.066 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T01:19:02.103 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:19:02.103 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T01:19:02.103 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T01:19:02.103 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.f 2024-09-21T01:19:02.230 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:19:02 smithi181 systemd[1]: Stopping Ceph mds.f for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:19:02.730 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:19:02 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f[63394]: 2024-09-21T01:19:02.436+0000 7f9ac10e2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:19:02.730 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:19:02 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f[63394]: 2024-09-21T01:19:02.436+0000 7f9ac10e2640 -1 mds.f *** got signal Terminated *** 2024-09-21T01:19:05.571 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:19:05 smithi181 podman[67460]: 2024-09-21 01:19:05.305289016 +0000 UTC m=+2.979783971 container died 2dc2a45cc738281502b1639a2da0fc662f5be31cd921dce492e47950c50fe75a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:19:05.913 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:19:05 smithi181 podman[67460]: 2024-09-21 01:19:05.662235621 +0000 UTC m=+3.336730577 container cleanup 2dc2a45cc738281502b1639a2da0fc662f5be31cd921dce492e47950c50fe75a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2) 2024-09-21T01:19:05.913 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 01:19:05 smithi181 bash[67460]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-f 2024-09-21T01:19:06.045 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T01:19:06.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:19:06.079 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T01:19:06.079 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T01:19:06.079 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.i 2024-09-21T01:19:06.230 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:19:06 smithi181 systemd[1]: Stopping Ceph mds.i for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:19:06.730 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:19:06 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i[63930]: 2024-09-21T01:19:06.398+0000 7f2fc9f48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:19:06.730 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:19:06 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i[63930]: 2024-09-21T01:19:06.398+0000 7f2fc9f48640 -1 mds.i *** got signal Terminated *** 2024-09-21T01:19:09.634 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:19:09 smithi181 podman[67580]: 2024-09-21 01:19:09.296036764 +0000 UTC m=+2.999682348 container died 18d5f9f638a27bca74a080aa058cbaf24f8f2229dc86396a67911cbf47093c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T01:19:09.959 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:19:09 smithi181 podman[67580]: 2024-09-21 01:19:09.715947935 +0000 UTC m=+3.419593550 container cleanup 18d5f9f638a27bca74a080aa058cbaf24f8f2229dc86396a67911cbf47093c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T01:19:09.959 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:19:09 smithi181 bash[67580]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i 2024-09-21T01:19:10.199 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T01:19:10.220 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:19:09 smithi181 podman[67594]: 2024-09-21 01:19:09.958957083 +0000 UTC m=+0.652240431 container remove 18d5f9f638a27bca74a080aa058cbaf24f8f2229dc86396a67911cbf47093c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T01:19:10.220 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:19:10 smithi181 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.i.service: Deactivated successfully. 2024-09-21T01:19:10.220 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:19:10 smithi181 systemd[1]: Stopped Ceph mds.i for 3872f802-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:19:10.220 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 01:19:10 smithi181 systemd[1]: ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.i.service: Consumed 1.296s CPU time. 2024-09-21T01:19:10.231 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:19:10.231 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T01:19:10.231 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T01:19:10.231 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.l 2024-09-21T01:19:10.480 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:19:10 smithi181 systemd[1]: Stopping Ceph mds.l for 3872f802-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:19:10.980 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:19:10 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-l[63128]: 2024-09-21T01:19:10.586+0000 7f82246a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:19:10.980 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:19:10 smithi181 ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-l[63128]: 2024-09-21T01:19:10.586+0000 7f82246a3640 -1 mds.l *** got signal Terminated *** 2024-09-21T01:19:13.046 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:19:12 smithi181 podman[67700]: 2024-09-21 01:19:12.763258831 +0000 UTC m=+2.320242243 container died cdaf53a052f0601d5ff7bce0e5781bf02686f28b17c4aeac37d0099f8906af01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-l, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T01:19:13.379 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:19:13 smithi181 podman[67700]: 2024-09-21 01:19:13.128241889 +0000 UTC m=+2.685225293 container cleanup cdaf53a052f0601d5ff7bce0e5781bf02686f28b17c4aeac37d0099f8906af01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T01:19:13.379 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 01:19:13 smithi181 bash[67700]: ceph-3872f802-77b5-11ef-baf5-efdc52797490-mds-l 2024-09-21T01:19:13.543 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3872f802-77b5-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T01:19:13.575 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:19:13.576 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T01:19:13.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3872f802-77b5-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:19:13.781 INFO:teuthology.orchestra.run.smithi148.stdout:Deleting cluster with fsid: 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:19:16.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3872f802-77b5-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:19:16.439 INFO:teuthology.orchestra.run.smithi157.stdout:Deleting cluster with fsid: 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:19:18.953 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3872f802-77b5-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:19:19.153 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:19:21.614 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:19:21.647 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:19:21.681 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:19:21.708 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T01:19:21.710 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354/remote/smithi148/crash 2024-09-21T01:19:21.711 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:19:21.751 INFO:teuthology.orchestra.run.smithi148.stderr:tar: /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:19:21.751 INFO:teuthology.orchestra.run.smithi148.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:19:21.753 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354/remote/smithi157/crash 2024-09-21T01:19:21.754 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:19:21.791 INFO:teuthology.orchestra.run.smithi157.stderr:tar: /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:19:21.792 INFO:teuthology.orchestra.run.smithi157.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:19:21.793 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354/remote/smithi181/crash 2024-09-21T01:19:21.794 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:19:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:tar: /var/lib/ceph/3872f802-77b5-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:19:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:19:21.836 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T01:19:21.836 DEBUG:teuthology.orchestra.run.smithi148:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T01:19:21.873 INFO:tasks.cephadm:Compressing logs... 2024-09-21T01:19:21.874 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:19:21.917 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:19:21.920 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:19:21.941 INFO:teuthology.orchestra.run.smithi148.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T01:19:21.941 INFO:teuthology.orchestra.run.smithi148.stderr:: No such file or directory 2024-09-21T01:19:21.941 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T01:19:21.944 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:19:21.944 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:19:21.945 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T01:19:21.945 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:19:21.945 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T01:19:21.945 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T01:19:21.945 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T01:19:21.945 INFO:teuthology.orchestra.run.smithi148.stderr: 82.6% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:19:21.945 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:19:21.949 INFO:teuthology.orchestra.run.smithi157.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T01:19:21.949 INFO:teuthology.orchestra.run.smithi157.stderr:: No such file or directory 2024-09-21T01:19:21.949 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T01:19:21.950 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T01:19:21.950 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:19:21.950 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T01:19:21.950 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T01:19:21.950 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T01:19:21.950 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:19:21.954 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:19:21.954 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.4.log: /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:19:21.954 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T01:19:21.954 INFO:teuthology.orchestra.run.smithi157.stderr: 95.1% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T01:19:21.954 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log: 82.6% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:19:21.954 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:19:21.957 INFO:teuthology.orchestra.run.smithi148.stderr: 95.0% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T01:19:21.957 INFO:teuthology.orchestra.run.smithi148.stderr: 95.0% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T01:19:21.957 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:19:21.958 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T01:19:21.958 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T01:19:21.958 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T01:19:21.958 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mgr.x.log: 86.3% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:19:21.958 INFO:teuthology.orchestra.run.smithi148.stderr: 95.0% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T01:19:21.958 INFO:teuthology.orchestra.run.smithi148.stderr: 90.9% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:19:21.959 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T01:19:21.959 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.log: 86.3% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:19:21.959 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T01:19:21.959 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.h.log: 91.5% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T01:19:21.960 INFO:teuthology.orchestra.run.smithi181.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:19:21.960 INFO:teuthology.orchestra.run.smithi181.stderr:: No such file or directory 2024-09-21T01:19:21.960 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:19:21.960 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T01:19:21.960 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T01:19:21.960 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:19:21.960 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr: 82.5% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.2.log: --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.log: 90.3% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr: 86.3% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.8.log: 95.0% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr: 91.7% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T01:19:21.961 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T01:19:21.962 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:19:21.963 INFO:teuthology.orchestra.run.smithi157.stderr: 90.9% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:19:21.963 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T01:19:21.963 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:19:21.964 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T01:19:21.964 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:19:21.964 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 95.0% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T01:19:21.966 INFO:teuthology.orchestra.run.smithi148.stderr: 92.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:19:21.974 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:19:21.979 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:19:21.983 INFO:teuthology.orchestra.run.smithi181.stderr: 92.6% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T01:19:22.004 INFO:teuthology.orchestra.run.smithi181.stderr: 93.9% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T01:19:22.017 INFO:teuthology.orchestra.run.smithi157.stderr: 92.8% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T01:19:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: 93.4% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T01:19:22.096 INFO:teuthology.orchestra.run.smithi181.stderr: 92.2% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T01:19:22.132 INFO:teuthology.orchestra.run.smithi181.stderr: 93.2% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T01:19:22.148 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T01:19:22.155 INFO:teuthology.orchestra.run.smithi148.stderr: 90.0% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T01:19:22.163 INFO:teuthology.orchestra.run.smithi157.stderr: 92.9% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T01:19:22.185 INFO:teuthology.orchestra.run.smithi148.stderr: 92.8% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T01:19:22.187 INFO:teuthology.orchestra.run.smithi181.stderr: 91.7% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T01:19:22.198 INFO:teuthology.orchestra.run.smithi148.stderr: 93.0% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T01:19:22.205 INFO:teuthology.orchestra.run.smithi181.stderr: 92.9% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T01:19:22.214 INFO:teuthology.orchestra.run.smithi157.stderr: 93.2% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T01:19:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: 92.8% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T01:19:22.240 INFO:teuthology.orchestra.run.smithi148.stderr: 93.1% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T01:19:22.241 INFO:teuthology.orchestra.run.smithi181.stderr: 92.9% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T01:19:22.260 INFO:teuthology.orchestra.run.smithi157.stderr: 93.0% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T01:19:22.272 INFO:teuthology.orchestra.run.smithi157.stderr: 92.8% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T01:19:22.275 INFO:teuthology.orchestra.run.smithi181.stderr: 92.9% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T01:19:22.277 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-21T01:19:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m0.343s 2024-09-21T01:19:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m1.509s 2024-09-21T01:19:22.277 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.072s 2024-09-21T01:19:22.328 INFO:teuthology.orchestra.run.smithi157.stderr: 93.0% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T01:19:22.330 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-09-21T01:19:22.330 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m0.396s 2024-09-21T01:19:22.330 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m1.786s 2024-09-21T01:19:22.330 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.086s 2024-09-21T01:19:22.532 INFO:teuthology.orchestra.run.smithi148.stderr: 90.6% -- replaced with /var/log/ceph/3872f802-77b5-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T01:19:22.534 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-21T01:19:22.534 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m0.604s 2024-09-21T01:19:22.534 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m1.846s 2024-09-21T01:19:22.534 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.078s 2024-09-21T01:19:22.535 INFO:tasks.cephadm:Archiving logs... 2024-09-21T01:19:22.535 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354/remote/smithi148/log 2024-09-21T01:19:22.536 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:19:22.855 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354/remote/smithi157/log 2024-09-21T01:19:22.856 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:19:23.108 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354/remote/smithi181/log 2024-09-21T01:19:23.109 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:19:23.339 INFO:tasks.cephadm:Removing cluster... 2024-09-21T01:19:23.339 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3872f802-77b5-11ef-baf5-efdc52797490 --force 2024-09-21T01:19:23.532 INFO:teuthology.orchestra.run.smithi148.stdout:Deleting cluster with fsid: 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:19:23.784 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3872f802-77b5-11ef-baf5-efdc52797490 --force 2024-09-21T01:19:23.987 INFO:teuthology.orchestra.run.smithi157.stdout:Deleting cluster with fsid: 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:19:24.249 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3872f802-77b5-11ef-baf5-efdc52797490 --force 2024-09-21T01:19:24.450 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: 3872f802-77b5-11ef-baf5-efdc52797490 2024-09-21T01:19:24.706 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T01:19:24.707 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:19:24.724 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:19:24.740 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:19:24.758 INFO:tasks.cephadm:Teardown complete 2024-09-21T01:19:24.758 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T01:19:24.774 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T01:19:24.775 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:19:24.777 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:19:24.783 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:19:24.889 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T01:19:24.899 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T01:19:24.899 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:19:24.902 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:19:24.904 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:19:24.914 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:19:24.916 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:19:24.918 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:19:24.920 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:19:24.920 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-21T01:19:24.920 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 +358us[ +324us] +/- 37ms 2024-09-21T01:19:24.920 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -1188us[-1222us] +/- 64ms 2024-09-21T01:19:24.920 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +584us[ +551us] +/- 69ms 2024-09-21T01:19:24.920 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:19:24.922 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:19:24.922 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-09-21T01:19:24.922 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +353us[ +350us] +/- 37ms 2024-09-21T01:19:24.922 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -1169us[-1172us] +/- 64ms 2024-09-21T01:19:24.922 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +575us[ +575us] +/- 69ms 2024-09-21T01:19:24.922 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:19:24.923 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:19:24.923 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-21T01:19:24.923 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +358us[ +367us] +/- 37ms 2024-09-21T01:19:24.924 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -1174us[-1174us] +/- 64ms 2024-09-21T01:19:24.924 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +584us[ +593us] +/- 69ms 2024-09-21T01:19:24.924 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:19:24.924 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T01:19:24.935 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T01:19:24.935 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T01:19:24.945 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:19:25.037 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:19:25.102 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:19:25.167 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:19:25.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:19:25.196 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:19:25.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:19:25.224 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:19:25.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:19:25.252 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T01:19:25.262 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T01:19:25.279 INFO:teuthology.task.internal:Duration was 1386.489015 seconds 2024-09-21T01:19:25.279 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T01:19:25.289 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T01:19:25.289 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:19:25.291 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:19:25.294 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:19:25.328 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:19:25.330 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:19:25.332 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:19:25.782 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T01:19:25.782 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T01:19:25.783 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:19:25.803 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-09-21T01:19:25.803 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:19:25.850 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-09-21T01:19:25.851 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:19:25.878 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T01:19:25.879 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:19:25.881 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:19:25.893 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:19:25.946 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T01:19:25.946 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:19:25.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:19:25.960 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:19:26.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T01:19:26.536 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T01:19:26.537 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:19:26.561 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:19:26.588 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:19:26.614 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T01:19:26.625 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:19:26.627 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:19:26.632 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:19:26.648 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-21T01:19:26.653 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-09-21T01:19:26.677 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-09-21T01:19:26.702 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:19:26.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:19:26.734 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:19:26.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:19:26.749 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:19:26.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:19:26.764 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T01:19:26.775 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T01:19:26.776 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354/remote/smithi148 2024-09-21T01:19:26.776 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:19:26.823 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354/remote/smithi157 2024-09-21T01:19:26.823 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:19:26.859 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913354/remote/smithi181 2024-09-21T01:19:26.859 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:19:26.894 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T01:19:26.894 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:19:26.896 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:19:26.899 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:19:26.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T01:19:26.959 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T01:19:26.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T01:19:26.992 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T01:19:26.992 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:19:26.995 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:19:26.997 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:19:27.009 INFO:teuthology.orchestra.run.smithi148.stdout: 265863 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:19 /home/ubuntu/cephtest 2024-09-21T01:19:27.010 INFO:teuthology.orchestra.run.smithi157.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:19 /home/ubuntu/cephtest 2024-09-21T01:19:27.012 INFO:teuthology.orchestra.run.smithi181.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:19 /home/ubuntu/cephtest 2024-09-21T01:19:27.013 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T01:19:27.024 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T01:19:27.048 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/fsync-tester}} duration: 1386.489015340805 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T01:19:27.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T01:19:27.132 INFO:teuthology.run:pass